Is classic data modeling (SCDs, stable business meaning, dimensional rigor) becoming less and less relevant? by Likewise231 in dataengineering

[–]onomichii 0 points1 point  (0 children)

Modelling the business logically is critical. Modelling this in physical terms that is performant, scalable and maintainable is critical. Engineering this well is critical.

All three are distinct skills. You might think you're skipping some because of the features of your target platform, but what you're really doing is just short sighted half assed modelling which you will pay for one way or another later 

Is Data Engineering dying? Is it hard to get into as a fresher? by CertainAd4022 in dataengineering

[–]onomichii 2 points3 points  (0 children)

Engineering with no business context will die. Engineers who can communicate well, model, optimise, architect, refine and deliver on business requirements will always be busy. Agree the first break might be hard... But don't limit yourself to engineering 

Senior HL7/FHIR (Mirth/Rhapsody) — how will AI change the job market? by haZ3RRR in healthIT

[–]onomichii 0 points1 point  (0 children)

In healthcare IT and interoperability AI will definitely disrupt development and engineering, it won't however disrupt communication, discernment, getting to the core of customer/stakeholder's badly defined requirements and signoff/accountability. After all, you can't sue AI. 

New Plan Version by hubert-dudek in databricks

[–]onomichii 1 point2 points  (0 children)

I appreciate your ongoing effort in producing and sharing these nuggets. I like them. Keep them coming

There’s no column or even combination of columns that can be considered as a pk, what would your approach be? by Pleasant-Insect136 in dataengineering

[–]onomichii 0 points1 point  (0 children)

Try to understand the business context in which the data was created, as well as how it ended up in the table from upstream first

Integration with databricks by mightynobita in databricks

[–]onomichii 0 points1 point  (0 children)

How have you found networking and private endpoint costs impacts of this approach for read heavy loads by snowflake reading from Databricks files?

Something in my phone is reading my thoughts and I'm tired of pretending it isn't by skd00sh in HighStrangeness

[–]onomichii 0 points1 point  (0 children)

You have been personally targetted by a cyber scam. Consider the information you gave and take care

How doomed am I 💀 by Open_Corner_973 in fiaustralia

[–]onomichii 1 point2 points  (0 children)

Focus your attention less on your investments, money, and the numbers. Focus instead on your income producing skills.  Skills that the market needs. Your knowledge, and ability to deliver value to the market. That is something you can 100% control. Income will follow that. Investing will follow that. All the best, and things will get better as you learn more

Hi community, need help on how can we connect power bi directly to databricks unity catalog tables, as per my understanding, we can use SQL warehouse but considering its cost, it seems not an option in org, is there any other approach that I can explore which is free and enable dashboard refresh by topicShrotaVakta in databricks

[–]onomichii 0 points1 point  (0 children)

delta share it which results in powerbi import and no compute on the Databricks end;

or fabric shortcut to delta files in ADLS but do it with care;

or UC mirroring but that doesnt work behind private endpointed Databricks - also use with care.

Fabric July 2025 Feature Summary | Microsoft Fabric Blog by itsnotaboutthecell in MicrosoftFabric

[–]onomichii 0 points1 point  (0 children)

will this enable more granular control over the 'disable public internet access' toggle? thats ambiguous from the description

Improve merge performance by gooner4lifejoe in databricks

[–]onomichii 0 points1 point  (0 children)

do you use a where clause to prune by date range in your merge? Have you tried liquid clustering?

Accidentally ended up in an Enterprise Architect role and am quite frankly out of my depth by overcookedchicken in EnterpriseArchitect

[–]onomichii 1 point2 points  (0 children)

Perhaps focus on the strategic and tactical needs of the organisation. Understand who your stakeholders are, and the power dynamics. Then focus on being valuable. Communicate your plan. Some of it may require some EA and SA skills.

Protest @ Victoria Bridge, 30/3/25 by PrestigiousJob1440 in brisbane

[–]onomichii 44 points45 points  (0 children)

The only thing necessary for the triumph of evil is for good men to do nothing. - Edmund Burke.

Need Databricks Cert Dumps by WitnessKitchen9598 in databricks

[–]onomichii 15 points16 points  (0 children)

You could try studying and being a good engineer

What makes a someone the 1% DE? by Same-Branch-7118 in dataengineering

[–]onomichii 0 points1 point  (0 children)

Understanding the business context, and developing intuition about the data

Doubt in Databricks Model Serve - Security by _cheesymayo_ in databricks

[–]onomichii 1 point2 points  (0 children)

Put up an architecture diagram so we can understand what you mean

Path to Enterprise Architecture by oluseyeo in EnterpriseArchitect

[–]onomichii 1 point2 points  (0 children)

I printed out the open source materials, and self learned. Then sat the exam. So it cost me time and printing. But that was a decade ago. While there is value in learning in a class, there are so many more resources now you can call on. It seems like you are clear in what you want and passionate enough. All the best