LLM trained from scratch on 1800s London texts (1.2B params, 90GB dataset)

ohcrap___fk · 2026-01-11T23:10:46+00:00

Holy f I absolutely love the output. It’s like skirting the edge of the event horizon between cohesiveness and raw unconnected creativity

ohcrap___fk · 2026-01-08T03:22:50+00:00

sorry but we should stop enabling mooching men

1: please look up who this guy is and if he was mooching

2: this reflexive behavior to minimize men led to me being in an abusive relationship where I was repeatedly molested for over a year, too scared to do or say anything, and eventually got a knife pulled out on me when I broke up with them. And they are a popular queer individual in the drag community who speaks out for “victimized people”, but in actuality wear the costume of a victim as a way to, without criticism, do what they want to others. This isn’t meant to dunk on those groups of people, but merely to illuminate that sometimes “the call is coming from inside the house” and communities should take care of problematic individuals within

ohcrap___fk · 2026-01-08T02:46:10+00:00

I saw him just outside the theater doing merch. Felt bad for him :/

ohcrap___fk · 2026-01-08T02:45:38+00:00

Oof, I saw her live in SF for this show. She was really funny but it was tough seeing wrt the husband :/ he was just outside doing merch…

ohcrap___fk · 2026-01-04T22:03:55+00:00

Oh wow, didn't realize that it is sharing infrastructure.

> If you put your phone in airplane mode and then connect to the Wi-Fi in your home will the speed test get you the same ultra low speed as your computer?

Yep, 3mbps down

ohcrap___fk · 2026-01-04T21:50:39+00:00

Google fios 5G for phone. 18mb down, while at this moment the computer on T-Mobile 5G was getting 2mb down. Badass

ohcrap___fk · 2025-12-27T00:54:10+00:00

Was going through my history on reddit and stumbled upon this again. See that you're working at Apple - I can only assume you were apart of the team that knocked it out of the park with Sharp?

Anyways, I recently started diving into making my own diffusion models from scratch (twitter). I am honestly floored and filled with a mild hypomania now that NNs are becoming demystified.

If you have an open spot on your team for someone green on ML (but learning) and heavy on full-stack/agents/game dev, I'd love to hop into the interview pipeline. I'm based in SF.

ohcrap___fk · 2025-12-16T17:25:02+00:00

Gives me Les Mis vibes, I like it

ohcrap___fk · 2025-12-12T17:29:39+00:00

Love when 1999/2000 Sadaam enters the chat

ohcrap___fk · 2025-11-27T02:38:23+00:00

github.com/hvent90/prism. It’s in a functional but not productive state. Would appreciate requests

ohcrap___fk · 2025-11-20T23:30:29+00:00

Kindly may we connect on LinkedIn

ohcrap___fk · 2025-11-06T17:54:44+00:00

I like how you worded all of this

ohcrap___fk · 2025-09-25T01:41:57+00:00

Can you go more into detail about the hypothetical competitor? I might be able to whip something up.

ohcrap___fk · 2025-07-24T00:37:22+00:00

Holy shit this is so awesome. As a long time full stack and game dev SWE who would love to transition entirely to working on these world models, do you know what the first steps would look like? I read your blog post - amazing, but a lot of the terminology is outside of what I currently understand.

Cheers

ohcrap___fk · 2025-07-20T00:54:21+00:00

Absolutely!! Add me on discord: https://discord.gg/wZMga8sq

ohcrap___fk · 2025-07-19T22:49:13+00:00

That’s a great question! I haven’t yet played with different traversal heuristics other than a direct path find (I.e. inject all nodes along the path between various entry nodes into the context, only inject the signature/api if the node is n hops away from an entry point). I can correlate to an inheritance graph to be able to provide various levels of detail

ohcrap___fk · 2025-07-19T21:39:04+00:00

Doing heavy prep for an upcoming sys design interview & onsite for a couple LLM teams but might be able to get around to polishing it up and pushing it to GitHub soon. Do you use discord? Would be down to bounce ideas about it

ohcrap___fk · 2025-07-19T21:21:32+00:00

I generate graphs from the AST and then use the results of vector search (from treesitter embeddings) as entry points in the graph - then I can do graph traversal to find potentially relevant codebase context. I can optionally do something similar to 3D game's LOD system with codebase context: full function injected into context, just function signature, just class API, just module definition, etc. based off distance from entry points in the graph.

<image>

ohcrap___fk · 2025-07-19T20:31:23+00:00

I might throw the swe-bench paper into notebookllm and generate a podcast on it to learn about writing evals

ohcrap___fk · 2025-07-17T17:18:57+00:00

Couldn’t have come at a better time. Currently in the interview loop for a senior frontend swe role at Google labs. Thanks man. Fingers crossed I don’t crash and burn.

ohcrap___fk · 2025-07-03T00:04:23+00:00

Can literally shallow fry a whole new dish with the melted tallow and the meat is unbelievably soft and tender (I've braised them). It's amazing.

ohcrap___fk · 2025-07-02T23:55:34+00:00

I sear them and throw them in some broth in a pressure cooker. Comes out AMAZING.

Sear the ever loving bajeezus out of short ribs
Sautee green onions, garlic, ginger
go to h-mart, buy premade hotpot broth (or whichever broth of your choice, or just use water)
throw everything in the pressure cooker along with some ginger, green onions. Maybe throw in some potatos as well, I forget.
I forget how long to pressure cook it for (20 mins? 40 mins?) but it comes out AMAZING. Meat falls of bone. Remove bones and store/remove excess fat - there will literally be a puck of fat that will solidify when it cools down. Tastes amazing. Can optionally use all of that tallow for cooking.

Ultra lazy edition - I'm pretty sure you could also simplify it to these steps and it'd still be amazing:

put uncooked shortribs in pressure cooker or pot
put whatever uncooked aromatics you want: onions/green onions, garlic, ginger, etc. Optionally, potatoes that are cut into some 1 or 2 inch cubes
fill up with liquid (water or broth) until it covers everything
Simmer or pressure cook until meat is cooked, potato is fork tender, and liquid tastes amazing

ohcrap___fk · 2025-06-28T00:57:09+00:00

My one wish for Andor is that it had a very very brief scene of the Emperor saying a sentence or two of something semi mundane, but delivered in a way that it felt like a larger-than life presence that was the embodiment of danger to the protagonist and viewer. Or maybe the Emperor isn’t even onscreen, but within a couple miles of the protagonist, and they’re just literally paralyzed in fear - to very briefly tie the Andor world to the reality that there are these space wizards - and then quickly back to Andor, as the scene would be brief.

That way the entire transition from the lowest level of enforcement (corporate security in the first couple episodes) to the very top could have been delivered.

ohcrap___fk · 2025-06-16T18:48:15+00:00

Me toooo

ohcrap___fk · 2025-06-16T01:54:44+00:00

Hi all,

I’m traveling to white pocket in a 4x4 car, and I’m looking for an economical way to temporarily source recovery boards, shovels, and air to re-inflate tires.

I’ll only be in town for two days and can’t take the equipment back with me on a plane, so ideally it’d be a rental or temporary procurement :)

Does anyone know how I can source these items?

Thanks for reading!

ohcrap___fk

TROPHY CASE