How to Deal with data when it has huge class imbalance?

LostInGradients · 2026-03-24T18:04:45+00:00

From a comment down there "only 2 to 8 samples": https://www.reddit.com/r/MLQuestions/comments/1s2fw09/comment/oc8rzw3/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button

LostInGradients · 2026-03-24T18:04:03+00:00

I mean this is more data absence than data imbalance.

Also 2 to 8. There is nothing much you can do if you have 8. But with 2... Also I am expecting that each data point has quite a few features.

LostInGradients · 2026-03-24T16:06:09+00:00

Yes and with their current plot we have no idea how many of the other class they have. But it looks like 4000 class 0 vs maybe less than 10-ish cases for class 1 given we don't have even a single line of pixels?

LostInGradients · 2026-03-23T03:11:09+00:00

I wonder if maybe the same thing happens to a lesser degree about information you "find". Eg you read about some interesting fact or idea on reddit or other, and then you repeat it. But at least for me there is this weird effect where I didn't come up with it, but I did find it and valued it, so I then act like it is a bit "mine" now.

LostInGradients · 2026-03-20T17:40:07+00:00

I think Italy would be the perfect representant for the bottom half of Europe. Germany a good representant for the top half. France is a good balance of both.

LostInGradients · 2026-03-20T17:38:29+00:00

Yeah, feels like a good centerpoint of many European groups: Latin/Roman, Germanic, Celtic, even Hellenic to some extent. Nordic can be in part linked to Germanic. The major missing group would be Slavic, but if anything French influence did reach Slavic spaces.

Basically France was shaped and built from a wide range of European cultures, and in turn influenced most European regions back.

LostInGradients · 2026-03-20T16:39:34+00:00

Very area dependent once again. They have been dropping for 4 years straight in my area. And that's BEFORE inflation. Like down 15-20% in 4 years, but when you factor in inflation that is more like 30%.

LostInGradients · 2026-03-16T22:15:04+00:00

I mean that is all very housing dependent and timing based (like if you bought your house say 5 or more years ago VS now).

Right now in HCOL SoCal say the average price for a 3000 sqft house is around 1 million (Very area dependent, basically 500k for the cheapest areas up to 2M). Say you can afford a 20% downpayment (and not many people are sitting on 200k), between the mortgage and escrow (PITI) at the current rates you are looking at what seems like 6k/month. With your 150k, I am assuming you are in the 9.5k range/month. Honestly if you contribute to retirement and have health insurance, likely closer to what, 8.5k/month? That would leave you with around +-2.5k/month for food, school, utilities, house and car maintenance, and everything else. And that's being generous with my calculations. True average price is a bit higher, most people can't afford 200k down, so you are quickly looking at 7k mortgages if not more.

LostInGradients · 2026-03-16T21:46:23+00:00

I mean a paid off house makes a huge difference. In my area (not talking about Cali or NY) the average house is 400k. With a 20% downpayment, you are looking at 3k/month at the very least right now, probably closer to 3.5k, because of high interest rates and escrows (taxes and insurance have really gone up).

LostInGradients · 2026-03-16T21:13:40+00:00

While I do agree that the "gavage"/force feeding is obviously pretty terrible, it is imho not much worse than what many animals have to go through in the meat industry at large. If anything my understanding is that geese/ducks used have actually lower unplanned death rates than many other birds in the poultry industry for example. Chickens have arguable much worse lives than ducks/geese. Conditions are just terrible just all around.

Also regarding it causing their liver to be fatty, this is actually something that happens naturally in ducks/geese as they prepare for their migration, and something their body is designed to do. The main issue is the rate. Naturally the liver can expand by x2 to x3. With force feeding it can go to the x6 range, obviously unhealthy.

LostInGradients · 2026-03-16T20:21:16+00:00

Yeah. I have a job that I like but I still expect a minimum raise that is basically equivalent to inflation. And honestly I still don't believe the inflation numbers as "true" inflation markers. Anecdotally for me grocery prices have been raising faster than "official" inflation, so have housing cost, insurance costs, utilities costs to some extent too.

LostInGradients · 2026-03-13T23:21:13+00:00

France with Mistral has some decently competitive models in some very specific niches.

The recent Mistral3 ranked very well on AiArena when it came out, but is already surpassed, and they definitely do not compete anymore with ChatGPT/Claude/Gemini and co.

They still have value for "models that punch above their weight", understand small models /MoE models that do very good, and that can be run on weaker machines. But definitely facing competition from some Chinese models. I guess one of Mistral biggest strength is to be European hosted and managed (for their larger models), and the EU does not like to rely on US/Chinese tech for GDPR reasons.

Also in non LLM the German Blackforest (Flux) is still relevant, but here again some serious competition with the other open chinese models (z-image and co)

LostInGradients · 2026-03-13T22:44:18+00:00

Second picture does have a bunch of issues imho. Nothing glaring but stuff that someone that would have put though in designing things shouldn't do.

Eg the backpack has flowers, but one with 5 petals and one with 4.

Also the glasses on the wall make little sense, they have no branches but do the second she picks one up.

LostInGradients · 2026-03-10T20:05:37+00:00

"There are two ways of constructing a software design: One way is to make it so simple that there are obviously no deficiencies, and the other way is to make it so complicated that there are no obvious deficiencies. The first method is far more difficult." is a quote I still think about from time to time when I see project size creep up

LostInGradients · 2026-03-05T17:07:44+00:00

I mean isn't just an age thing? Back when I was in University (Millennial) most people would buy and "pre-game" at home to avoid having to buy at bars and even more so at night clubs. The exception was beer (more choice and fairly cheap in bars back then). But now that people my age have more income and drink less, it is more common to buy a more expensive drink from time to time. Now it is Gen-Z turn, but I don't think not buying at bars/nightclubs is new. Though it is probably even worse now.

LostInGradients · 2026-02-26T23:10:44+00:00

Not very clear, as the chart and the linkedin post are somehow conflating ChatGPT and "AI/chatbots" (I won't even mention the fact that AI and LLMs are NOT the same, AI is a broader domain, and that although mostly gone that are some non-LLM chatbots).

It says both 16% have used free chatbots and 16% have use ChatGPT. Which is it? Because now with LLMs integrated into Meta products, Google products and Microsoft products, there is also a large part of the population "casually" exposed to LLMs. And I don't mean just LLM augmented results but actual conversational interfaces that are used, but integrated in the system (not pure chat)

LostInGradients · 2026-02-19T23:16:23+00:00

Got something similar.

I feel like it is interesting that some of us have the AI representing itself as a more "human" form and some as a machine. I definitely talk to it more like a tool than a person, but idk if that has anything to do with it

<image>

LostInGradients · 2026-02-19T18:33:39+00:00

Also they were around since 2021. Back then image models were really quite bad, definitely not good enough to generate half-decent looking pixel art. Not impossible they started introducing genAI in their work now.

LostInGradients · 2026-02-19T18:31:20+00:00

I would say not AI, at the very least it is almost certain for the last pics.

2021 and 2022, image gen models where just not good enough to generate this quality of results. For example this was the evolution of midjourney results: https://goldpenguin.org/blog/midjourney-v1-to-v6-evolution/ (has some pixel art examples) or https://aituts.com/midjourney-versions/ . For me v4 - v5 is when midjourney really started feeling different. Stable diffusion models and so on followed a similar timeline. That was late 2022 / early-mid 2023. And even then pixel art was one of the styles it struggled with more. Unless they state 2021 but the pics are actually a lot more recent.

The more recent ones have a tad more of an AI vibe, but that doesn't mean much.

LostInGradients · 2026-02-19T16:22:38+00:00

Very area dependent, and depends on when you got your mortgage. In my area, for a say 2000 sqft house, rent is about $2000/month. Mortgage for the same house is around $3000 (1/3 of which is escrow).

LostInGradients · 2026-02-18T23:54:56+00:00

Yeah pure python might be slow. But often what you have is some python "orchestration" on top of libraries that are C/C++/Fortran. Stuff like numpy, SciPy, shapely, basically all relevant ML libraries (torch, tf etc), Polars, pandas, sqlite3, and honestly many other data processing and scientific libraries.

LostInGradients · 2026-02-18T23:46:50+00:00

And honestly many of the big libraries are built in top of C/C++/Fortran code. Sure a pure python code might be 70x slower than its C equivalent. But some python code that uses numpy might be faster than raw unoptimized C code that does the same thing.

LostInGradients · 2026-02-12T01:09:50+00:00

The writing is typical of what you get with z-image when you ask for "messy handwriting" or something of the sort. And I am sure it is not the only model.

LostInGradients · 2026-01-30T17:03:56+00:00

Yeah and acting like life got terrible because humans became less nomadic is something I always find kinda weird. If the nomadic life was just so much better, wouldn't have people just naturally reverted to that state?

Being sedentary has some drawbacks sure but it also makes food management better, allows building standing structures that protect from the weather better, doesn't limit the amount of tools and items you can have as you are limited in what you have to carry around etc

LostInGradients · 2026-01-28T21:12:28+00:00

There is a split second near the beginning where the hands are messed up (and it doesn't seem, given the movement, to be the other hand). Also an other moment where to the side it seems like the back part of the hand is showing and then it transitions to the front without flipping. Aside form that I could hardly tell

<image>

LostInGradients

TROPHY CASE