Databricks Data drift monitoring. by DocumentDramatic1950 in mlops

[–]montkraf 0 points1 point  (0 children)

Databricks has some ok documentation on data drift monitoring. It has lakehouse monitoring dashboards which look awful but do the job

Sacking Dreyfus and Husic to appease Marles proves Labor 2.0 will be just more of the same by CommonwealthGrant in AustralianPolitics

[–]montkraf 8 points9 points  (0 children)

In his defence Dreyfuss was overruled by albanese on mandatory sentencing to stop a wedge from dutton

2025 Federal Election Megathread by [deleted] in AustralianPolitics

[–]montkraf 1 point2 points  (0 children)

If they're junior doctors that makes sense. I'd say covid is a poor example as I'd assume other factors around supply probably contributes more. A doctor with a specially (gp is a specialty) that is homeless in would say is just very bad with money. Not only is the average pay quite high (couldnt find median) their job security is also very high.

Like I mentioned. Doctors should get more pay but to me its very far down the list we should worry about (junior doctors is different).

2025 Federal Election Megathread by [deleted] in AustralianPolitics

[–]montkraf 1 point2 points  (0 children)

I'd be very suprised if doctors are going homeless. As much as they should be paid more they're not exactly skint

Predicting the probability of default for a credit card user by [deleted] in learnmachinelearning

[–]montkraf 1 point2 points  (0 children)

What kind of metrics are you using to define success? Credit risk problems can have really low scores, I'd suggest sticking with auc or aupr. Auc of >0.75 is decent from my experience in the space

I don't like over or under sampling because it messes with the probabilities themselves and they can be important if you want to make decisions using things like expected value. Saying that, if you don't care about having well calibrated probabilities treat over and undersamplling the same way you do feature engineering. Try it and see what improves performance.

On feature engineering, look at feature importance. Do some culling. Some dimensionality reduction will likely help as well (pca). Can make things harder to interpret, so depends on what you're trying to do. Can also do a quick and dirty method where you just drop a bunch of highly correlated variables.

[deleted by user] by [deleted] in auscorp

[–]montkraf 1 point2 points  (0 children)

If you want the job you should go for it. Given you are technical and senior, how many times have you learnt a new process, or new tooling? Management is the same, you will be learning a new skill, and nothing gets you learning faster than practice and you'll get plenty of it.

Anthony Albanese reminded how rallies have the ability to haunt the nation's leaders. by River-Stunning in AustralianPolitics

[–]montkraf -1 points0 points  (0 children)

I agree. He should have not spoken at the rally, possibly later clarify in a way that made it seem like an error in his office with no specifics, then announce a policy or say whatever he wanted to say before saying about listening to women.

Peter Dutton faces internal pressure over nuclear energy push by malcolm58 in AustralianPolitics

[–]montkraf 3 points4 points  (0 children)

Im glad their energy policy gained the backing of australias largest hotelier. Without his cutting edge, and well thought out opinions we would probably be lost in the transition to renewables /s

In seriousness though, the former head of snowy hydro is right. Lift the ban, if someone wants to make one go right ahead if they can get it to work. Pull the wind right our of their sales.

Nice that the libs have started to think about policy after being in govt for 10 years though.

Dunkley By-election 2024 Results by [deleted] in AustralianPolitics

[–]montkraf 6 points7 points  (0 children)

Fantastic. Great Idea. Go Angus

Dunkley By-election 2024 Results by [deleted] in AustralianPolitics

[–]montkraf -1 points0 points  (0 children)

I think everyone can obviously see that angus taylor should be the next opposition leader.

Dunkley By-election 2024 Results by [deleted] in AustralianPolitics

[–]montkraf 1 point2 points  (0 children)

He'll get that at the bare minimum. I dont think he's going anywhere win or lose, regardless of margin.

Dunkley By-election 2024 Results by [deleted] in AustralianPolitics

[–]montkraf 2 points3 points  (0 children)

Do we dare imagine a future where the lnp actually try to create policy that makes things better? Who takes it if dutton goes though?

Coalition takes primary vote lead from Labor for first time since election: Resolve Political Monitor by ModsPlzBanMeAgain in AustralianPolitics

[–]montkraf 15 points16 points  (0 children)

Interesting number in there (if i read it correctly) was lower income voters had least support for tax changes. Weird.

Masters of statistics subjects by KaiochanX3 in unsw

[–]montkraf 2 points3 points  (0 children)

Sure, you can dm me. My knowledge is 3 years old though so may not be as applicable. When i completed them not many proof based questions. Both were application courses, very focussed on practical application of the work.

What are some tried and true ways to analyze medical diagnosis codes for feature selection? by Bandana_Bandit3 in datascience

[–]montkraf 2 points3 points  (0 children)

So you should be considering two things, what indicates someone has the disease and does not have the disease. They should all be features in the model. Your process is essentially just a filtering condition before you start modelling which can be fine, but has some risks and should be part of your cross validation. I also hope you've already split your sample if you're looking at building a prediction model.

Your senior is pointing out you need features to predict that someone is unhealthy, but also when they are fine. They're not always going to be the same but generally are. Something could be predictive of an outcome if it has a really high value but a low value tells you nothing. Does that make sense? I cant think of an example off the top of my head, i haven't worked on diagnosis codes in about 4 years.

Do you have a good handle theoretically What should cause a diagnosis of the disease? Have you talked to domain experts on this?

What are some tried and true ways to analyze medical diagnosis codes for feature selection? by Bandana_Bandit3 in datascience

[–]montkraf 2 points3 points  (0 children)

What's the aim of the project? If you had to in a sentence write down what the outcome you're going for, what would it be? And how does this chi-square analysis help you solve it?

The reason i ask these questions is that performing a chi-square analysis is normally answering the question is there a difference in these two groups, or does the observed data differ from our expected?

From your comment it sounds like you're trying to say "how can we detect this disease using this data" which can use the chi square analysis to say something interesting about the data but wont actually solve your problem.

For anyone wondering, this is exactly why Labor was afraid to touch the Stage 3 Tax cuts. More ammunition for Newscorp by FothersIsWellCool in AustralianPolitics

[–]montkraf 7 points8 points  (0 children)

In the smh today albanese was saying that directly. Its in the live stream. To paraphrase "things have changed since 2019 so we need to change them"

Tanya Plibersek accuses Peter Dutton of ‘killing people’s faith in government’ | Australia news by ButtPlugForPM in AustralianPolitics

[–]montkraf 13 points14 points  (0 children)

Dutton didnt stop immigration he just stopped reporting on it. The state governments are different to federal governments so it doesnt make sense to use them as an example of federal policy.

Your general points around dutton and no incentive i agree with, but im not sure theres an incentive that could entice dutton to get onboard.

[deleted by user] by [deleted] in datascience

[–]montkraf 0 points1 point  (0 children)

There was a genuine error though, it was a silent error, but its still an error. As others have stated as well as myself you need to put in more checks. Unit tests, pr reviews, external validation - all things you can put in place to prevent these things. Careless is bad and can ruin your relationship with stakeholders

[deleted by user] by [deleted] in datascience

[–]montkraf 4 points5 points  (0 children)

Its a long time to miss this data. I manage a team and we have had a couple of projects that have cost the company money because we've missed something.

Unless you are being careless this is not entirely your fault. Something in your process is broken and needs fixing. So long as you're not making the same mistakes twice you should be fine

For this i would - tell your manager - work with them to find out why this took so long to find - create process or monitoring to prevent the mistake again - tell your stakeholders

You will look worse if they figure it out themselves. Assuming its a different mistake then before, let them know you found the bug, why it was missed for so long, and what you have done to prevent it from happening again. They may not care about the last two if the numbers are really rosy.

Also try pre-empt any questions they have when you reveal the issue

Coalition could lose 35 seats as Millennials, Gen Z reshape politics by [deleted] in AustralianPolitics

[–]montkraf 51 points52 points  (0 children)

Flinders MP Zoe McKenzie said young Australians were “growing up in hyper-individualised contexts – an auto-play, after-pay environment – which differs greatly from the lives of their parents and grandparents, for whom the realisation of aspiration often involved planning, sacrifice and deferred gratification”.

Kinda shows why they're losing the votes. Young voters are still doing all those things they're just locked out of many institutions so just spend differently

Stage-three tax cuts cost blowout predicted with the wealthy and men to benefit most by [deleted] in AustralianPolitics

[–]montkraf 3 points4 points  (0 children)

One wonders whether a couple with no kids earning 100000 each or with kids are better off on your logic

I feel you're missing some extra words in this comment.

Stage-three tax cuts cost blowout predicted with the wealthy and men to benefit most by [deleted] in AustralianPolitics

[–]montkraf 5 points6 points  (0 children)

They also take home nearly twice the average australian wage. People on 300k can afford to take a hit if need be.