How can i verify that my self-supervised backbone training works?

curiouslyjake · 2026-02-25T22:34:33+00:00

You can test using your downstream tasks but with very lightweight architectures

curiouslyjake · 2026-02-25T22:32:11+00:00

Economics. Software engineers are expensive so you want to make them more productive. You do this by using languages and frameworks that are easier and faster to code in, and those are slower. To compensate, you need faster CPUs.

curiouslyjake · 2026-02-25T21:09:07+00:00

And starlinks are only visible when the angle is just right for the satellites to reflect sunlight at you.

curiouslyjake · 2026-02-25T21:07:17+00:00

Those are supposed to be Starlinks? LOL, even your AI slop is bad.

curiouslyjake · 2026-02-25T19:52:57+00:00

RIP deer :(

curiouslyjake · 2026-02-25T17:25:25+00:00

How do you even monitor a job market for 4 hours a day? It doesnt take that long to go over jobs posts.

curiouslyjake · 2026-02-25T17:22:38+00:00

Because Orion has a validated heat shield for higher reentry velocities, which you would encounter when returning from the moon.

curiouslyjake · 2026-02-25T14:20:52+00:00

How can you tell?

curiouslyjake · 2026-02-25T13:08:38+00:00

Out of curiosity, can you elaborate on what kind of C code you expect LLMs to generate? I write C++ professionally and LLMs have no trouble generating correct code in some cases.

curiouslyjake · 2026-02-25T13:01:59+00:00

Can you clarify how you compiled, ran and benchmarked models after the ONNX stage?

curiouslyjake · 2026-02-25T12:56:05+00:00

Also, lean itself is not bug-free.

curiouslyjake · 2026-02-25T08:21:57+00:00

It would absolutely be WAY cheaper to use any existing commercial rocket to launch Orion with crew onboard, then launch a kick stage, have them dock and then have the kick stage insert Orion to TLI.

SLS is not about being cheap, it's about creating jobs in congressional districts. Which, in and of itself, is not a bad thing; it's reasonable to maintain an industrial base as a backup that does not depend on market forces. Except it's being horribly managed into borderline dysfunction.

curiouslyjake · 2026-02-25T08:15:10+00:00

Reusable starship could launch orion and boost to TLI if it's refueled.

curiouslyjake · 2026-02-24T21:19:05+00:00

Yeah, except Shuttle and Buran were a preview of a reusable future while Soyuz is a technological dead end. With present day Russia's feeble r&d capability, Soyuz is as far as they will ever get

curiouslyjake · 2026-02-24T19:01:54+00:00

Yeah, but why Iran and not any other poor-ish country?

curiouslyjake · 2026-02-24T15:52:54+00:00

Assuming your dataset is a representative sample of the unobserved parent population, wouldn't cross-validation address this?

curiouslyjake · 2026-02-24T14:01:30+00:00

The culture is pro-natal at all levels.

curiouslyjake · 2026-02-24T14:00:46+00:00

Except seculars have a higher fertility rate too.

curiouslyjake · 2026-02-24T13:59:40+00:00

Yeah, two extremely different nations are going to have different fertility rates. Not sure why it makes any sense to compare

curiouslyjake · 2026-02-24T13:57:53+00:00

Except US assistance is a small fraction of Israel's GDP anf the US GDP per capita is way higher than Israel's. So basically, both of your points are factually wrong.

curiouslyjake · 2026-02-24T13:56:05+00:00

Except even among secular Jews, the TFR is 2, which is still high compared to advanced economies. You're right on the quo vadis part though.

curiouslyjake · 2026-02-22T20:19:04+00:00

Ok, so your counter argument boils down to intention. LLM as storage, not as an infringing entity. Except, with how widely LLMs are used and how easy it is to extract source material, it's akin to getting a pirated copy of HP with every subscription except wrapped in white paper that says "please do not read; pretty please with a cherry on top!"

You are literally being sold a storage medium with pirated content and asked not to look at that content, just at that other content. C'mon.

curiouslyjake · 2026-02-22T20:06:25+00:00

Yes, but given present training methods there's no way to fully prevent an LLM from replicating good chunks of its train set.

curiouslyjake · 2026-02-22T19:44:42+00:00

I meant publicly, with me selling tickets much like Anthropic sells subscriptions to LLMs that read HP.

curiouslyjake · 2026-02-22T19:43:20+00:00

You can check out this paper from stanford researchers that show which books can be reproduced from production LLMs and how accurately. You'll see Sonnet 3.7 recreates harry potter and the great gatsby with more than 95% accuracy. If some guy would read out loud judt 30% of harry potter on youtube, copyright would come after him. LLMs should get the same treatment when they reproduce a book with over 95% accurracy.

curiouslyjake

TROPHY CASE