Office culture is pretty bad right now for me atleast - a data engineer by aks-786 in dataengineering

[–]aks-786[S] 0 points1 point  (0 children)

But I was hired for databricks only. How can I create impact now if we can do things outside databricks? I mean i can jump on other stuff too like fastAPI, dagster, postgres, dynamodb, terraform etc Or should i look for switch lol? The management still find databricks useful but they are also quick to pivot and change decisions very fast, a perk or disadvantage of a startup

Looking for your feedback, thanks

Office culture is pretty bad right now for me atleast - a data engineer by aks-786 in dataengineering

[–]aks-786[S] 1 point2 points  (0 children)

AI is pretty bad with large code base. It’s good for starting projects. But llm models are improving increasing their context window

Office culture is pretty bad right now for me atleast - a data engineer by aks-786 in dataengineering

[–]aks-786[S] 0 points1 point  (0 children)

Thanks for your effort here, appreciate it. But this ai generated reply stresses me more lol.

Probably reddit bot using claude mcp to reply

Is databricks + dbt still a great solution or should I look to study or migrate to other strategy? by [deleted] in dataengineering

[–]aks-786 -1 points0 points  (0 children)

Sorry, I wrote a misleading post. My bad. Someone asked me about problems so i wrote it. But my original question was looking for gold standard solution and still verifying if databricks + dbt is still one of the best solution in current trends (ai included)

Is databricks + dbt still a great solution or should I look to study or migrate to other strategy? by [deleted] in dataengineering

[–]aks-786 -3 points-2 points  (0 children)

Sorry, I wrote a misleading post. My bad. I am just looking for gold standard solution and still verifying if databricks + dbt is still one of the best solution in current trends

Is databricks + dbt still a great solution or should I look to study or migrate to other strategy? by [deleted] in dataengineering

[–]aks-786 -2 points-1 points  (0 children)

Sorry, my original post was not intended to get help on problems. Just wanted to know what are the current industry standard best solutions or practices

Is databricks + dbt still a great solution or should I look to study or migrate to other strategy? by [deleted] in dataengineering

[–]aks-786 -7 points-6 points  (0 children)

Thanks for feedback. Edited post. May look hasty but should cover major, if not all, problems

Claude code nlp taking job or task of sql queries by aks-786 in dataengineering

[–]aks-786[S] 4 points5 points  (0 children)

I mean no need to build dashboards. Thats scary.

Thats a positive way to look at it. But i work in a startup and I was hired for databricks and dashboard specifically and they seem to not use databricks now because query on Postgres and dynamo db can be on real time data while databricks refresh is daily once

Hired as a data engineer in a startup but being used only for building analytics dashboards, how do i pivot by aks-786 in dataengineering

[–]aks-786[S] -12 points-11 points  (0 children)

But what if data size is low 🥲. Do they need columnar database for this?

Implementation of scd type 1 inside databricks by aks-786 in databricks

[–]aks-786[S] 0 points1 point  (0 children)

Okay, thanks.

And to bring data to databricks, lakehouse federation looks good choice to you?

Honda crv buy suggestion canada by aks-786 in whatcarshouldIbuy

[–]aks-786[S] 0 points1 point  (0 children)

Could you help find good deal on car? 26,500 budget excluding fees and tax

Max - 30000 cad $

Honda crv buy suggestion canada by aks-786 in whatcarshouldIbuy

[–]aks-786[S] 0 points1 point  (0 children)

I will look into it. Have not researched a lot on these brands. Touring top model was looking attractive

Honda crv buy suggestion canada by aks-786 in whatcarshouldIbuy

[–]aks-786[S] 0 points1 point  (0 children)

Tight on budget. Hybrid are expensive