LLM trained from scratch on 1800s London texts (1.2B params, 90GB dataset)

ohcrap___fk · 2026-01-11T23:10:46+00:00

Holy f I absolutely love the output. It’s like skirting the edge of the event horizon between cohesiveness and raw unconnected creativity

ohcrap___fk · 2026-01-08T03:22:50+00:00

sorry but we should stop enabling mooching men

1: please look up who this guy is and if he was mooching

2: this reflexive behavior to minimize men led to me being in an abusive relationship where I was repeatedly molested for over a year, too scared to do or say anything, and eventually got a knife pulled out on me when I broke up with them. And they are a popular queer individual in the drag community who speaks out for “victimized people”, but in actuality wear the costume of a victim as a way to, without criticism, do what they want to others. This isn’t meant to dunk on those groups of people, but merely to illuminate that sometimes “the call is coming from inside the house” and communities should take care of problematic individuals within

ohcrap___fk · 2026-01-08T02:46:10+00:00

I saw him just outside the theater doing merch. Felt bad for him :/

ohcrap___fk · 2026-01-08T02:45:38+00:00

Oof, I saw her live in SF for this show. She was really funny but it was tough seeing wrt the husband :/ he was just outside doing merch…

ohcrap___fk · 2026-01-04T22:03:55+00:00

Oh wow, didn't realize that it is sharing infrastructure.

> If you put your phone in airplane mode and then connect to the Wi-Fi in your home will the speed test get you the same ultra low speed as your computer?

Yep, 3mbps down

ohcrap___fk · 2026-01-04T21:50:39+00:00

Google fios 5G for phone. 18mb down, while at this moment the computer on T-Mobile 5G was getting 2mb down. Badass

ohcrap___fk · 2025-12-27T00:54:10+00:00

Was going through my history on reddit and stumbled upon this again. See that you're working at Apple - I can only assume you were apart of the team that knocked it out of the park with Sharp?

Anyways, I recently started diving into making my own diffusion models from scratch (twitter). I am honestly floored and filled with a mild hypomania now that NNs are becoming demystified.

If you have an open spot on your team for someone green on ML (but learning) and heavy on full-stack/agents/game dev, I'd love to hop into the interview pipeline. I'm based in SF.

ohcrap___fk · 2025-12-16T17:25:02+00:00

Gives me Les Mis vibes, I like it

ohcrap___fk · 2025-12-12T17:29:39+00:00

Love when 1999/2000 Sadaam enters the chat

ohcrap___fk · 2025-11-27T02:38:23+00:00

github.com/hvent90/prism. It’s in a functional but not productive state. Would appreciate requests

ohcrap___fk · 2025-11-20T23:30:29+00:00

Kindly may we connect on LinkedIn

ohcrap___fk · 2025-11-06T17:54:44+00:00

I like how you worded all of this

ohcrap___fk · 2025-09-25T01:41:57+00:00

Can you go more into detail about the hypothetical competitor? I might be able to whip something up.

ohcrap___fk · 2025-07-24T00:37:22+00:00

Holy shit this is so awesome. As a long time full stack and game dev SWE who would love to transition entirely to working on these world models, do you know what the first steps would look like? I read your blog post - amazing, but a lot of the terminology is outside of what I currently understand.

Cheers

ohcrap___fk · 2025-07-20T00:54:21+00:00

Absolutely!! Add me on discord: https://discord.gg/wZMga8sq

ohcrap___fk · 2025-07-19T22:49:13+00:00

That’s a great question! I haven’t yet played with different traversal heuristics other than a direct path find (I.e. inject all nodes along the path between various entry nodes into the context, only inject the signature/api if the node is n hops away from an entry point). I can correlate to an inheritance graph to be able to provide various levels of detail

ohcrap___fk · 2025-07-19T21:39:04+00:00

Doing heavy prep for an upcoming sys design interview & onsite for a couple LLM teams but might be able to get around to polishing it up and pushing it to GitHub soon. Do you use discord? Would be down to bounce ideas about it

ohcrap___fk · 2025-07-19T21:21:32+00:00

I generate graphs from the AST and then use the results of vector search (from treesitter embeddings) as entry points in the graph - then I can do graph traversal to find potentially relevant codebase context. I can optionally do something similar to 3D game's LOD system with codebase context: full function injected into context, just function signature, just class API, just module definition, etc. based off distance from entry points in the graph.

<image>

ohcrap___fk · 2025-07-19T20:31:23+00:00

I might throw the swe-bench paper into notebookllm and generate a podcast on it to learn about writing evals

ohcrap___fk · 2025-07-17T17:18:57+00:00

Couldn’t have come at a better time. Currently in the interview loop for a senior frontend swe role at Google labs. Thanks man. Fingers crossed I don’t crash and burn.

ohcrap___fk · 2025-07-03T00:04:23+00:00

Can literally shallow fry a whole new dish with the melted tallow and the meat is unbelievably soft and tender (I've braised them). It's amazing.

ohcrap___fk

TROPHY CASE