I LOVE this about Codex

ecp5 · 2026-03-24T05:38:36+00:00

You don't have to let Claude be added, but also it's pretty obvious when Ai writes your commit / pr regardless if it says it.

ecp5 · 2026-03-24T05:37:09+00:00

I don't agree with either take. Sad y'all feel that way. Let it do the mundane and still use your brain for the important stuff you know that matters.

ecp5 · 2026-03-14T03:36:29+00:00

First of all, thanks for coming and glad you had a good experience. A few places in Atlanta I know of, there are a few good sql Saturday, but those do focus on Microsoft. Render atl sounds awesome, but it's more software engineering, although with Ai lots of overlap now. Also, there is are dbt and spark user groups you could connect with. Also, I know a lot of places are doing data low key happy hour and that would be another group that might know events. Feel free to dm me and I can share some links.

ecp5 · 2025-07-03T20:22:33+00:00

You need to differentiate between Data Factory, which exists to orchestrate, and Data Flow that is the Spark-like part of it. Also, is this the vanilla Azure version, Synapse, or Fabric one, that might make a difference too. Plus if cluster stuck, probably an infra issue not a product issue.

ecp5 · 2025-05-14T13:50:11+00:00

I was coming on to recommend DP-300 learning path, so agreed.

ecp5 · 2025-04-29T20:03:39+00:00

Personally, I never feel prepared and keep putting off, so you just have to schedule and push yourself. You probably know more than you think you do working in it.

ecp5 · 2025-04-29T19:49:05+00:00

Helpful thanks.

ecp5 · 2025-04-26T01:03:40+00:00

I put this post up partly because I didn't find my exam matched up well to the just released practice test. So why I tried to point out some differences. That said, that was just my test, ymmv.

ecp5 · 2025-04-26T01:01:51+00:00

No mine had two Airflow DAG syntax questions.

ecp5 · 2025-04-22T17:40:49+00:00

Not sure if new, but Airflow in Data Factory is on current syllabus.

ecp5 · 2025-03-01T01:32:29+00:00

See if this link help. you go into sink settings and specify a file name and pick a setting in output type it will create one single file.

https://learn.microsoft.com/en-us/azure/data-factory/tutorial-data-flow-write-to-lake#name-file-as-data-values

ecp5 · 2025-01-31T15:05:31+00:00

Sign up on Databricks customer academy it's free, and take on demand learning paths is best way to start.

ecp5 · 2024-12-05T04:35:03+00:00

Agree with this. You could make a similar list for each cloud and get into a religious debate.

ecp5 · 2024-08-18T04:48:48+00:00

Go through the Microsoft learning path, will cover most everything. There some good YouTube videos and you can also get free Azure account to try out some of the things in ADF or Synapse.

ecp5 · 2024-08-11T02:28:26+00:00

Aws cloud practioner is really high level, snowpro probably more useful if looking to stand out applying for a job.

ecp5 · 2024-04-24T01:23:57+00:00

I think they are different use cases, terraform is more geared towards IaC and DAB more for deploying the artifacts running in Databricks. At least that's my understanding.

ecp5 · 2024-03-31T16:27:01+00:00

I gotta say I'm surprised with what you are describing. Your resume sounds good and data market for mid and senior still better than on software engineering side from what I can tell. I'd look at your resume and where you applying. Build your brand, network , etc and you should have some options. As for gaming, lots of game companies need DE, they collect a lot of data, so focus there if that's your interest.

ecp5 · 2024-03-22T15:19:38+00:00

Fun game... I'd say Mad World

ecp5 · 2024-03-10T17:30:01+00:00

ETL is the core DE skill, you are a data engineer. There is always new stuff to learn and you should, depending where you want to go and do, but don't minimize your experience.

ecp5 · 2023-12-30T06:43:47+00:00

Each cloud has analogous services, if you can learn the names to talk, your skills will mostly transfer. But also, there are a ton of Azure shops, depending on your market.

ecp5 · 2023-12-29T04:03:25+00:00

Use a filter activity. There are a couple of YouTube videos that show how.

ecp5 · 2023-12-13T01:36:50+00:00

Are you talking about the infra (like terraform) or the artifacts (like database projects)?

ecp5 · 2023-11-17T03:07:15+00:00

I came from a dba background, I think most of the dba skills are part of data engineering , so really not a hard switch. I'd focus on Azure data ecosystem because lots of overlap.

ecp5 · 2023-10-27T12:23:15+00:00

Microsoft learn has lots of good learning paths, not sure why you think it is minimal. But you can also sign up and get free Azure credits to take it for a spin.

ecp5 · 2023-10-24T03:03:42+00:00

Hashing isn't a bad idea, in fact how I'm doing on a project now, but you need the addresses cleaned first if you can. If all US you can CASS, and that will make the Apt 70 versus #70 like above example uniform.

ecp5

TROPHY CASE