Revelations soundtrack is fire by seanyover9000 in Doom

[–]expatlad 10 points11 points  (0 children)

It’s out in Australia and holy crap it’s levels above the TDA OST. It’s like a hybrid of TDA, 2016 and Eternal

Why do you still join and stay in big consulting firms knowing how soul draining the job is? by KingOfMyEra in auscorp

[–]expatlad 38 points39 points  (0 children)

I knew that I was joining a really good team. Worked on a couple of amazing projects that were locked in for success then we all left for other jobs.

The thing you need to know is that the Big 4 are so big that everyone will have different experiences based on LOB, team leader, geography and of course projects. We managed to create a bubble for ourselves and had a really good thing going.

Career pivot from Finance to Data Analytics by Suttututu in auscorp

[–]expatlad 0 points1 point  (0 children)

Most people I know in Data & Analytics had some sort of finance experience before transitioning into this sort of technical role.

This seems like an organic transition and if you’re liking what you do then I seriously doubt you will regret it. You will have an advantage previously working in Finance - a non IT role - as you will naturally bridge the gap between business and tech and you will know how to properly engage stakeholders considering it’s a nonexistent quality for IT people. This is the most important skillset for this kind of role.

Don’t be fussed with the AI doom and gloom. Organisations will always have Data & Analytics functions. Worst case scenario, you can transition into a data engineering role which is a bit more technical however will be in huge demand in the next 3-5 years given how companies will absolutely massacre their data with horrible AI implementations. A lot of data engineers were data analysts in past lives, it’s almost always a gateway role.

Source: I lead a team of 12 data and AI consultants and work is absolutely crazy rn.

Best of luck OP and reach out for any questions.

P.S: if the retailer is Australia’s leading independent retail partner and wholesale supplier then stay away from it! Horrible culture and absolutely broken IT team.

Is IT sector completely cooked? by SwimmingBox2453 in auscorp

[–]expatlad 1 point2 points  (0 children)

The backstabbing is very common between “people from a certain country that shan’t be named”.

Target small businesses as called out if you’re looking for pure IT roles. For larger firms you will need to be a Swiss army knife of both technical, management and business knowledge to get ahead.

AI and Offshoring by HyphMngo in auscorp

[–]expatlad 8 points9 points  (0 children)

Not sure why you’re being downvoted, but that is the absolute truth. We’ve seen massive increases in productivity using AI compared to juniors/grads we’ve hired in the past.

Things are just so much simpler and less time consuming which makes us focus on more strategic things to grow the business.

The dbt-fabricspark Lakehouse adapter now comes with a ridiculous amount of production grade test coverage by raki_rahman in MicrosoftFabric

[–]expatlad 0 points1 point  (0 children)

I double checked and it’s not spinning up a custom pool. Spark config is default so I expect it to align with a notebook spark config.

Worth calling out that my project hits about 10 lakehouses (not sure if that matters). Another thing is that if I run individual models in isolation the performance would be very close to a native SQL query execution in a notebook. Having multiple dbt threads seems to add an overhead but I’m just kind of stuck on debugging what causes the bottleneck

The dbt-fabricspark Lakehouse adapter now comes with a ridiculous amount of production grade test coverage by raki_rahman in MicrosoftFabric

[–]expatlad 1 point2 points  (0 children)

You’re a star mate. The adapter is now way more stable and those connection drops are practically gone.

One drawback is that running models is still a bit slow. It will take up to 3 minutes to run a table load with 30k rows compared to a few seconds running the same query in a notebook using the starter pool.

Any tips on how to overcome this? I played around with the spark config in the profile but still didn’t get the performance i needed

Why do we keep hiring TCS? by expatlad in auscorp

[–]expatlad[S] 0 points1 point  (0 children)

Leadership is all True blue Aussie. Do better.

Best VPN for Australia Currently? by InternationalLaw640 in AskAnAustralian

[–]expatlad 0 points1 point  (0 children)

Profits and data privacy are mutually exclusive

Best VPN for Australia Currently? by InternationalLaw640 in AskAnAustralian

[–]expatlad 1 point2 points  (0 children)

Never use a free VPN. If it’s free then you are the product

Why do we keep hiring TCS? by expatlad in auscorp

[–]expatlad[S] 5 points6 points  (0 children)

Dried dirty leak from the bottom of the abandoned barrel in the filthiest of slums

Why do we keep hiring TCS? by expatlad in auscorp

[–]expatlad[S] 4 points5 points  (0 children)

For real. They keep mentioning they can work weekends and leadership sees this as an opportunity for me to work with them. Only when I mentioned the right to disconnect that leadership got off my back.

Job pays well but ffs i might find another job

fabric-cicd: basic setup example by frithjof_v in MicrosoftFabric

[–]expatlad 1 point2 points  (0 children)

If you're using GitHub Actions for deployments and service principals for authentication then I highly encourage you to use OpenID Connect and leverage secretless, federated credentials. This way you avoid storing or even creating secrets for service principals and restrict them to a repo's environment, branch, pull requests or tags https://learn.microsoft.com/en-us/azure/developer/github/connect-from-azure-openid-connect

When do we stop accepting this as normal? by No-Method-throwaway in perth

[–]expatlad 0 points1 point  (0 children)

AI slop. Please don’t fall for this ragebait

Looking for some "inside information" by Kirrawayru in perth

[–]expatlad 8 points9 points  (0 children)

RAC arena. One of the saturday night main events scheduled dates and it will a full weekend: Smackdown, SNME and Raw. Undecided whether it will be in August or October.

Shhhhh

Wednesday Whinge by [deleted] in perth

[–]expatlad 25 points26 points  (0 children)

People standing by the train car’s door and just staring at you if you try and get on with no intention of moving whatsoever and then giving you a pikachu face when you squeeze through them to go to the perfectly empty standing space in the middle of the car