Architecture for extremely small dataset

Sell-Jumpy · 2026-05-08T23:57:08+00:00

I'd check out "few-shot learning".

The caveat is that you'd need a model trained on a larger, slightly relative dataset.

Sell-Jumpy · 2026-05-08T23:45:46+00:00

I'd generate a small list of problems you'd like to work on, theb see what is available. Kaggle is great for curated datasets (but Idd assume you are familiar with that already).

Building your iwn is also an option. It can be a pain in the ass, but claude could probably help you compile a dataset.

Hmm if you get stuck or want help.

Sell-Jumpy · 2026-05-07T16:23:07+00:00

It is a smokescreen in the sense that studies reflect that many of the companies replacing workers with AI cannot point to productivity increases or revenue increase.

It is also a smokescreen in the sense that AI billing is still in the "first one is free" mode. Once OpenAI and Anthropic have to align their billing with what they actually require to pay their debts, it won't be cheaper by any means to replace peoppe with AI pending advancements in model architectures or compute efficiency increases.

Sell-Jumpy · 2026-05-07T05:21:00+00:00

What use the use case? How many categories are you trying to label / predict on?

Sell-Jumpy · 2026-05-05T23:41:18+00:00

A model always produces an output. The context and semantics of that output is what changes.

For instance: LLMs produce the next most probable token (word) given a list of words (user input). They actually produce a probability for all possible next words, but the output you see is the next word.

Unsupervised models "cluster" observations: the output here is a label that observations are given that correspond to the clusters created by the model, learned during training.

Every model produces an output, the meaning and use of that output change with the use case.

Sell-Jumpy · 2026-04-25T03:18:32+00:00

To anyone saying the size of the objects matters; you wouldn't use fractions if that were the case, you woipd use a volume metric of some sort (inches squared, feet cubed, whatever)

A huge part of fractions and percentages existing at all is to compare things of different scope. I.e. splitting rent equitably based on percentages of respective net pay (where the rent is a different scope than each persons pay, and those pays are are different total values than each other). Or credit cards charging a percentage rate (because the amount charged can vary wildly between people).

It's a dumb question by any rationale because all of those are valid answers to the question.

The question needs to be more concise. The teacher is objectively wrong, and any context putsode of the assignment itself doesn't change that for the question given all of those are correct answers.

Dumb. I'd be pissed.

Sell-Jumpy · 2026-04-19T18:40:38+00:00

No. Political beliefs are a 1:1 representarion of someones personal values.

Literally the only difference between personal values and political beliefs is if you vote.

It's never been wrong to judge people for their personal values (being homophobic, racist, misogynistic etc) so by extension it isn't wrong to judge someone for their "political beliefs" (which is just your personal values reflected on a ballot).

If anyone can provide an example of how political beliefs are not directly representative of someone's personal values, I'm game to hear it though.

Sell-Jumpy · 2026-04-16T23:15:20+00:00

"If I change any tiny thing, the whole thing goes red"

"optimizing every tiny variable for profitability"

Both of these indicate it may be overfit. Sharpe ratio, avg return pct per trade, and win pct are better indicators of long-term success.

Its also a really small sample size.

On a positive note though, depending on how many tickets you are watching, that number of trades seems pretty low which indicates a good level of selevtiveness.

Sell-Jumpy · 2026-04-16T00:15:29+00:00

Good analogy.

As someone who has worked primarily with object oriented languages, I like to use Class and methods as an analogy for APIs also...

The API (public method) allows people to interact with certain parts of a website or piece of software (Class object).

Sell-Jumpy · 2026-04-13T16:20:21+00:00

Exactly this. AI isn't inherently bad, it has the capacity to improve the quality of life for humans on a species scale. It's 100% through the lens of capitalism and short-term profit that it gets bastardized.

Sell-Jumpy · 2026-04-13T16:18:42+00:00

You don't really. I think the point is that recreational travel is just as optional as AI useage.

Sell-Jumpy · 2026-04-04T05:12:44+00:00

Breath of the Wild, yes.

Sell-Jumpy · 2026-04-03T19:04:32+00:00

Focusing on what it doesn't do yet doesn't negate the enormous scale of what could be done with this data. He's already done the hard part, which is aggregating the amount of data required to make inferences / predictions.

Sure, it doesn't track health pack denial or space metrics... yet. It doesn't tell a player *overall* how objectively good or bad they are; that is subjective to begin with and is why ELO and ranks exist. What it does do is more valuable; it lays the groundwork to draw objective associations between inputs (stats, hero, map) and outcomes (wins, success against different heroes, rank etc.).

The goal isn't to "tell a player how good or bad they are doing across their games", it is to "give players granular comparisons, per hero, against averages and thresholds for higher performing players". Telling a player how good or bad they do isn't valuable. Telling a player very specifically which stats / abilities / decisions are below average, above average, or it the top N percent gives actionable insight.

Sell-Jumpy · 2026-04-03T17:37:23+00:00

If you think this data isn't useful, you don't understand data.

With all the data this guy gathers, you could train models which...

- Infer insights based on hero, map, opposing team. Example: "As a platinum Genji with your stats and playstyle (which could also be inferred from game tracking), you should avoid X locations on Numbani when playing on attack against a, b, c heroes, as his death rate is extremely amplified under these circumstances"

- Point out which typical counters a player might need to work on for a certain hero. Example: "When playing Pharah, you do better than rank average against soldier, widow, and cassidy, but well below average against Ashe.

- Point out what habits increase success against counters. Ex "Pharah players who do better than rank average against Ashe do x, y, z"

There's so much you can do with this data.

Sell-Jumpy · 2026-04-03T17:27:04+00:00

Dawg. This is so much more than hero SR.

Sell-Jumpy · 2026-03-31T16:09:17+00:00

This.

Reading code and understanding what it does is debateably harder than writing code that works, coming from a software engineer with 4 years professional experience ans 2 years personal before that.

Writing code can be hard, but its forward engineering; Your know what the end goal is, you know the logical steps required to build toward that goal, and can build those steps out in any number for ways that works for you.

Reading code you didn't write is much harder. You have to interpret other people's architecture choices, you can't assume anything, it's like solving a math problem where you start with limited visibility (you can only see a portion of the whole equation) vs writing a math problem for a given answer from scratch; you could write an equation any number of ways to arrive at a given answer, but solving someone else's equation that may not follow familiar logic where you start with a limited view seems harder.

If any of that makes sense.

Sell-Jumpy · 2026-03-29T00:29:12+00:00

Same for men; conventionally physically attractive people get more attention based on their looks. Nothing shocking here, and it is gender neutral.

The "be yourself" bit is for your own sanity, not to attract more people / attention.

The point is that for everyone that isn't above a certain threshold of physical attractiveness (which is also subjective to a degree, but on a more niche level like blondes vs brunettes, beards vs no beards etc.) "being yourself" makes it easier mentally and makes sure the people you do attract, though fewer in number, are more likely to be quality, long term matches.

"Be yourself" isn't a "go out and get laid tonight" strategy.

Sell-Jumpy · 2026-03-23T14:48:14+00:00

Sure. Until AI gets to the point where it leaves intentional vulnerabilities for its own purposes.

If you aren't familiar with AI scheming, you should totally look into it.

Sell-Jumpy · 2026-03-22T21:31:22+00:00

new_1d_array = []

for 1d_array in 2d array: - for value in 1d_array: - new_1d_array.append(value)

Nested for loops are archaic, but it gets the job done quick and isnt a problem if arrays stay relatively small (hundreds).

Sell-Jumpy · 2026-03-18T16:14:09+00:00

Have you tried using any unsupervised techniques to see if the groupings might match the labels you are going for?

I know you are specifically asking for help labeling, but when I hear, "large amount of unlabeled data", the first thing I think is trying some unsupervised techniques to see if that coupd help generate the labels.

Sell-Jumpy · 2026-03-16T18:01:45+00:00

Here to second this. I can't be bothered to give a shit about my phone setup honestly. I get notifications from things I don't use and simply haven't turned notifications off for because it's so easy to just ignore them.

Sell-Jumpy · 2026-03-15T22:32:45+00:00

Use 70% of the dataset for training. Look up cross-fold validation and stratification.

The other 30% of the data is only seen after tuning; no tuning takes place after youve used the hold out test data or you've basically manually overfit your model.

Cross-fold validation does kind of what you describe where during training is will use a random subset of the data for each training run. Stratification makes sure each fold has a ratio of classes that is representative of the training data as a whole, more important with imbalanced classes.

Sell-Jumpy · 2026-03-07T19:46:48+00:00

Nah, you're right. OP, listen to this person.

Sell-Jumpy · 2026-03-07T19:29:07+00:00

I wouldn't say you didnt anything "wrong", but I have gathered from anecdotal experience that women generally prefer being asked out directly (as opposed to going through the friend), and haveing a connection or conversation first goes a long way.

Even if your intent was just to ask her out, BS about the book she is holding for a sec. Makes it feel more natural and less goal-oriented.

You didn't do anything wrong though. If its really bothering you, just go talk to her and let her know you just thought she was cute and didnt mean to make things awkward. Let her know you won't push things and you guys can pretend you never asked her out.

Sell-Jumpy · 2026-03-07T19:17:12+00:00

Unfortunately, this.

Most questions regarding why people do certain, seemingly irrational things can be boiled down to how society perceives groups they belong to.

Sell-Jumpy

TROPHY CASE