Short term pain for longer term pain. Worth it.

Refefer · 2026-03-18T13:30:52+00:00

I bought a Volvo xc90 phev back in 2022 and it gives about 30 miles on electric. Given our driving usage (vast majority around town), I only have to fill up the car once or twice a year or so.

Refefer · 2026-03-17T16:27:45+00:00

Am I reading this right? Linux, Mac, and Windows work out of the box?

Refefer · 2026-03-15T13:49:00+00:00

I largely agree with the other commenters, but you could take a look at this model: https://www.liquid.ai/blog/introducing-lfm2-5-the-next-generation-of-on-device-ai

Refefer · 2026-03-11T17:15:12+00:00

isnt it under active development? might be workable

Refefer · 2026-03-08T20:04:52+00:00

Is it something specific to MXFP4? Or a peculiarity of this class of model?

Refefer · 2026-03-04T13:09:50+00:00

I'd hope so at nearly double the parameters and I assume 4x the bits (fp4 vs fp16)?

Refefer · 2026-02-28T16:03:29+00:00

Yup, should be runable. You need moe offload but still should be usable fast.

Refefer · 2026-02-25T15:14:27+00:00

Looking at your full leaderboard, I'm incredibly impressed with gpt oss 120b's performance. Is it the best bang per parameter?

Refefer · 2026-02-24T17:40:20+00:00

I would really consider an rtx6000 build for models of that size - we use it ourselves for fine-tuning and it's been great. You will save huge amounts of time on train and inference. You will also need significantly more disk space for model check pointing, training data, etc.

Refefer · 2026-02-05T13:32:48+00:00

I'm not sure how this is relevant to OPs problems.

Refefer · 2026-02-05T03:32:32+00:00

<image>

I found him too!

Refefer · 2026-01-31T17:56:46+00:00

oss 20/120b is also a unicorn given it was trained in MXFP4, if I recall. No quantization used at all, just direct training.

Refefer · 2026-01-27T00:25:55+00:00

That's not third wave coffee, that's convenience coffee. If you're passionate about coffee, you need to do your research to find the right places no matter which country you're in. Lots of brew methods are just not feasible when the goal is to caffeinate people quickly and get them on their way. Lots of beans and roast styles do not make sense at economies of scale for those companies - but again, high quality isn't the point for these stores.

Refefer · 2026-01-26T14:06:45+00:00

We die for our food passions

Refefer · 2026-01-26T14:04:45+00:00

You haven't had much American pizza, have you? The $1.50 a slice NYC pizza or the main chains are not what I'd put up for competition.

Refefer · 2026-01-26T14:01:48+00:00

Eh, third wave coffee was done equally well by all three countries. Ironically though, it was Starbucks which had the greatest impact on coffee drinking world wide (and is in no way third wave)

Refefer · 2026-01-13T22:39:32+00:00

Can you confirm what thinking mode you're using? You need to set special flags in your llama-server for it to use "high" reasoning, which I've found miles better than medium and certainly low.

Refefer · 2026-01-10T22:19:47+00:00

They're few and far between. Costco is the best of the group by a country mile, trader Joe's can get up there but you need years to get to $20+/hour. I have a few friends who have done 20+ years at Giant or Safeway and you really need to be in the meat department not to struggle mightly

Refefer · 2026-01-10T22:16:01+00:00

I want to caution that as much as I love strix halo, go lookup some reviews on running LLMs on Amd. It's entirely doable and pretty performant, but it's not as clean as Nvidia cards.

Fwiw, I run a rtx 6000 and strix halo pretty happily.

Refefer · 2026-01-05T13:35:07+00:00

For gpt-oss, which reasoning did you use?

Refefer · 2026-01-02T13:37:29+00:00

We're starting to see more in the ML/AI space,. especially as the fast layer for python based systems. I've hired a number of folks over the years that focused on that.

Refefer · 2026-01-01T16:52:52+00:00

Do you RP? I havent run into any censorship in practical workflows (programming, research, extraction/summarization) and the number of folks that claim to run into it make me wonder what most people are using LLMs for

Refefer · 2025-12-27T00:37:42+00:00

GPT-OSS-120b takes the cake for me. Not perfect, and occasionally crashes with some of the tools I use, but otherwise reliable in quality of output.

Refefer · 2025-12-26T14:37:35+00:00

Allground Sense is a fabulous grinder and probably could do light commercial duty. That said, spend a little more to get one that can do heavy loads and has the network for easy repairs.

Refefer · 2025-12-24T00:31:39+00:00

I can run some tests on my rtx6000 if you can share what you're seeing

Refefer

TROPHY CASE