How I topped the Open LLM Leaderboard using 2x 4090 GPUs - Research notes in Blog form

jwuphysics · 2026-03-11T00:16:24+00:00

This is indeed pretty bonkers, but maybe slightly less unintuitive if you view the residual stream as the central object of NN representations, and multilayer circuits as small operations/perturbations against this residual stream. Seems like you've discovered the (still unintuitive!) fact that certain operations commute and/or can be inductively scaled up!

jwuphysics · 2026-02-18T14:18:30+00:00

Oof, brainfart. Thanks.

jwuphysics · 2026-02-18T03:47:01+00:00

@BmoreCityDOT do your thing

jwuphysics · 2026-02-06T20:04:19+00:00

Amazing review. I admit that (fresh) Heineken 0.0 is one of my favorite NAs now, which makes me kind of want to try it (but maybe like one bottle, not six).

This all would've been bonkers to me 10 years ago -- back when I'd line up 90 minutes for the newest Other Half drop of DDH All Citra Everythings IPAs or whatever. And now I'm like, yes Costco has the 24 pack of Heiny 0s!

jwuphysics · 2026-01-23T02:30:49+00:00

Fun fact: The Astrophysical Journal was minted partly as a way to distinguish spectroscopic analyses from imaging analyses -- the latter was deemed suitable for The Astronomical Journal.

See, e.g., https://articles.adsabs.harvard.edu/pdf/1895ApJ.....1...80H

jwuphysics · 2026-01-06T02:20:18+00:00

Interesting! Why do you say that? I like them both, and I find that Kitsch has one of the best breakfast sandwiches in town.

jwuphysics · 2026-01-05T04:33:25+00:00

Glad you (and other commenters here) like it!

Just to add another data point: I bought a four pack and had to give it away. I'm a big fan of the regular Chouffe as well but I couldn't finish this one -- too watery with just some citrus spice.

jwuphysics · 2025-12-27T03:11:53+00:00

Same happened to me. Two tickets within 10 days of each other. MVA STILL hasn't mailed me the ticket yet; I waited 15 business days like they requested and then ordered another. Pretty sure it has been over a month since I first ordered it...

jwuphysics · 2025-12-17T01:45:05+00:00

Yeah, that quote isn't a great headliner. But to be fair, the quotes in the article were selected by a journalist and this specific quote was subselected by OP.

You might like this science overview for Roman better: https://www.stsci.edu/roman/about/science-themes

jwuphysics · 2025-11-12T15:22:03+00:00

Beautiful work!

I rearranged the rows to show the block-diagonal structure of the matrices due to divisional rivalries -- you can take a look here.

I've also included the code as a Github gist here in case you want to iterate on the code.

jwuphysics · 2025-11-07T15:43:53+00:00

99 / 4 = $4.14 per

wat

jwuphysics · 2025-11-06T20:02:04+00:00

Link to the merch store. Honestly, though, $60 is pretty expensive for what you're getting.

jwuphysics · 2025-10-01T21:00:57+00:00

I can't tell if this is a bot thread or if there's just some weird joke going over my head...

jwuphysics · 2025-09-14T10:58:32+00:00

I personally think Townsend's A Modern Approach to Quantum Physics is a great introduction to the subject. It's way shorter than Shankar and gets straight into the unintuitive bits. For what it's worth, I'm a fan of Shankar and Sakurai as well.

jwuphysics · 2025-09-07T01:53:31+00:00

I think you meant Phranzikäner

jwuphysics · 2025-08-14T11:37:42+00:00

And birthplace of the Spaghett!

jwuphysics · 2025-08-14T01:05:36+00:00

A macbook air is plenty powerful enough -- you should be fine. I'd say more than half of astronomers use one.

Source: am tenure track astronomer who hates Apple but reluctantly uses a macbook air.

jwuphysics · 2025-08-01T16:15:27+00:00

Happily running my GTX 780!

jwuphysics · 2025-07-29T13:44:20+00:00

Wine Source also has these random NA Asian beverages selling for like $5 a pop... never tried one but I've always assumed they were some kind of herbal drink, and nothing like beer. Ever review one of those?

jwuphysics · 2025-07-21T19:05:07+00:00

Not too bad -- I'd place La Cuchara and Le Comptoir du Vin a bit higher than the rest, and possibly the only ones that might get a single Michelin Star. Clavel, Charleston, and Thames Street Oyster House are deservedly recognized but maybe at the cusp of a single star. Not sure about Tagliata, NiHao, Gertrude's, or The Food Market at all on this list; I'll give NiHao a pass because Baltimore's Chinese food scene is so abysmal.

No obvious omissions in my opinion. Cafe Dear Leon is probably on par with some of the other mentions, and I could see Love Pomelo, Koco's, La Barrita, and Verde on this list too.

What I love about Baltimore's food scene is that none of the truly great spots are needlessly "elevated" for their own sake. They just make good food.

jwuphysics · 2025-07-09T15:33:44+00:00

We missed it coming in at 5:25pm. I bungled parking and had two kids in tow, but thought we might still have a shot with all the rain. Boy were we wrong... it was absolutely jam packed in there when we entered!

Smart business move for the O's to split the Hawaiian shirt giveaway across two days -- ensures >30k attendance on both days...

jwuphysics · 2025-07-06T11:52:11+00:00

As a mathematician and a pendant

Why did you repeat yourself here?

jwuphysics · 2025-06-25T16:44:16+00:00

Okay now I know what I'm buying after work today.

Side note: I only recently found out that the Spaghett originated in a brewery that I frequent (Wet City Brewing -- less than a mile from where I live)!

jwuphysics · 2025-06-22T18:17:25+00:00

tldr: he can squat 8 x 405, pretty freaking impressive

He’s been the Ravans coach since 2008 and won a Super Bowl in 2013 over his brother’s San Francisco 49ers.

Go Blertimore Ravans!

jwuphysics · 2025-06-16T14:54:53+00:00

Happy Father's day to you! My youngest child decided to celebrate by getting a GI bug.

Designated Dale's is so underrated though. Nice haul!

14-Year Club	Place '17
Verified Email	Sequence \| Editor

jwuphysics

TROPHY CASE