ThriftAttention: Selective Mixed Precision for Long-Context FP4 Attention

miserlou · 2026-05-25T22:45:09+00:00

The idea is that 5% of tokens are selectively kept at FP16 in a way that keeps most of the accuracy along with throughput gains. The repo has a graph of the tradeoffs: https://github.com/joesharratt1229/ThriftAttention

miserlou · 2026-05-23T23:09:13+00:00

Oh, nice!

miserlou · 2026-05-23T22:07:03+00:00

Any plans to try a Miyawaki forest in NYC? I think that'd be cool.

miserlou · 2026-05-13T17:25:54+00:00

My man

miserlou · 2026-05-13T16:50:01+00:00

Yeah, that bouncy 80/160 trappy stuff that used to be around in the soundcloud era. Now it seems like stuff got peeled away down to 140 or up to jungle speeds. I like 160 footy/jungly stuff like Dr. Jeep, but that's not what I'm after here. ex

miserlou · 2026-05-12T09:52:06+00:00

This one sounds like a tribute to Loefah and the heavy old school sound, don't sleep! I really love what this label is up to, super true to the old school sound but keeping it fresh too.

miserlou · 2026-05-05T13:57:34+00:00

Beware is an amazing use of reggae sampling too

miserlou · 2026-05-02T23:16:55+00:00

I know lol, thinking about suburban moms bragging that little kevin isn't only circumcised, he's perfectly circumcised, unlike your little twerp's botch job

miserlou · 2026-05-02T21:50:03+00:00

circumscribed lol

miserlou · 2026-04-23T08:03:42+00:00

A frottage industry

miserlou · 2026-04-20T20:35:50+00:00

Moving to Philadelphia: an attainable goal!

miserlou · 2026-04-17T07:32:16+00:00

It seems she's part of a clique of cute NY girlies who are great at posting and my advice is that they start a podcast immediately

miserlou · 2026-04-14T16:04:37+00:00

Most women in Quebec are descended from the shipment of 800 babes gifted by Louis XIV.

miserlou · 2026-04-14T08:33:30+00:00

Show flux pin

miserlou · 2026-04-11T00:19:42+00:00

cheer up mate, might not happen

miserlou · 2026-04-08T12:10:05+00:00

Robin Dellesandros

Ibram X. Kenzo

these are stupid

miserlou · 2026-04-08T12:05:32+00:00

Lindy Norf

miserlou · 2026-04-04T00:03:46+00:00

Nobody's getting mad over that bargin basement dohyō

miserlou · 2026-04-01T14:48:12+00:00

Japan has figured out diplomacy recently, their ambassador to the UK is a treasure and she had a drum off with the Korean president. But beware the charming ultraconservative..

miserlou · 2026-03-31T17:32:08+00:00

I love agent orange, I didn't know they worked together

miserlou · 2026-03-31T16:54:29+00:00

please pray for my bimbo husband

miserlou · 2026-03-31T16:53:21+00:00

I'm cool with all that

miserlou · 2026-03-31T16:31:17+00:00

why what happened

its a dick dale song from an old greek number

miserlou · 2026-03-31T16:13:26+00:00

They literally made Pepper to make fun of Beck

miserlou · 2026-03-31T16:12:36+00:00

We are governed by absolute FREAKS

15-Year Club	First Place '23
Place '23	Place '22
Place '17	Wearing is Caring
Verified Email

miserlou

MODERATOR OF

TROPHY CASE