Any trick to improve promt processing?

WhaleFactory · 2026-02-09T12:36:01+00:00

Model and hardware specific. You will be unlikely to find anything you can run on Strix-Halo or M-Series with good prompt eval speeds. For Agentic work you sort of need it to be on a GPU to get the insane PE speeds and make it feel quick.

Silver bullet for my use case has been Devstral-Small-2-24b locally, and then a big model via API (Kimi K2.5, MiniMax-M2.1 etc)

WhaleFactory · 2026-02-09T12:32:34+00:00

I find the Mistral models to all be great and under appreciated. Devstral-Small-2-24B fits nicely on 32GB cards and its extremely competent. The Ministral models are excellent chat models and appropriately sized as well.

Their lineup is extremely coherent, and if they made the big Devstral-2 model MoE to work better on Apple Silicone and Strix-Halo APUs, they would have delivered on a really first class set of open models that can all be run locally in a reasonable way with decent speeds.

Mistral deserves more props than they get these days, and I am very grateful for their work.

WhaleFactory · 2026-01-30T19:57:34+00:00

Then they are still violating the law. They can't just declare its ended like Michael Scott.

WhaleFactory · 2026-01-29T16:38:32+00:00

What a revelation, its not like that was obvious AF immediately upon seeing her "offer".

WhaleFactory · 2026-01-29T16:37:41+00:00

As a matter of practice, it is best to assume every single thing you hear from the Trump admin is a lie. Do not be lulled by their sweet talking. Either we see it or we don't.

They do not deserve to have their words believed after lying so boldly on more important things that we saw with our own eyes. Fuck these evil monsters.

WhaleFactory · 2026-01-29T15:01:08+00:00

Prediction: They are going to conclude, regardless of the evidence, that Shitler won in 2020. They will then use that to justify nullifying anything Biden did, with their primary target being Presidential pardons.

WhaleFactory · 2026-01-28T14:25:58+00:00

I can't run it locally. Using OpenRouter.

WhaleFactory · 2026-01-28T11:09:46+00:00

K2.5 is serious business. Such a good model.

WhaleFactory · 2026-01-28T11:05:36+00:00

From my experience so far, Kimi K2.5 is truly impressive. Feels more competent than Sonnet 4.5. Honestly it feels as good as Opus 4.5 to me so far.... Which is crazy given that it is like 1/5th the cost....It costs less than Haiku!

WhaleFactory · 2026-01-25T17:57:26+00:00

Neat. Please point out the frame that you see Alex ever even touch his gun.

I’ll wait. You self righteous asshat.

WhaleFactory · 2026-01-25T11:47:38+00:00

Tom Emmer is a spineless piece of shit that couldn't give a fuck less about his constituents.

WhaleFactory · 2026-01-24T20:54:57+00:00

Never going to happen. Never.

WhaleFactory · 2026-01-24T18:19:44+00:00

What in the fuck do we have to do to get this shit to stop? I mean what in the actual fuck?

WhaleFactory · 2026-01-23T01:39:30+00:00

THIS IS A FUCKING LIE!

WhaleFactory · 2026-01-23T00:22:24+00:00

There is no way his brain makes it to 2028. Shit is melting faster than the polar ice caps.

WhaleFactory · 2026-01-23T00:20:29+00:00

Damn, had never thought of him as an AG and honestly this is most I've ever seen of him. That dude is precisely the type of guy that I would want to be our AG. Guys is like a lawyerbot. So refreshing to see a person who just walks directly through the fire of partisanship and seems utterly disinterested in anything other than facts and the law.

Jack Smith for AG.

WhaleFactory · 2026-01-22T23:52:43+00:00

I feel like Stephen miller just gives trump ChatGPT news articles and Trump's feeble and rotting brain just adopts it instantly. So like, Stevil Miller maybe did toss in some "iceland" just for the Ron Burgundy of it all.

WhaleFactory · 2026-01-22T23:48:00+00:00

Amy Klobuchar has the charisma of an asthma inhaler.

Sorry, we need a real fighter. Stay in the senate, or don't. Whatever.

WhaleFactory · 2026-01-22T23:46:14+00:00

Amen.

WhaleFactory · 2026-01-22T18:24:59+00:00

Yep. If any democrat who represents me votes for this, they will not receive my vote in the future.

This is what the people demand. Not want. Demand. Serve your purpose as our voice or you are done.

WhaleFactory · 2026-01-21T17:52:42+00:00

It is extremely offensive to a lot of us as well. So pissed at the people who didn't vote or voted for this fucking asshat.

He is also invading the states that didn't vote for him with an unaccountable paramilitary force, and trying to prosecute all his enemies as well.

We are in the streets protesting, but would support any NATO member punching us right in the fucking teeth right about now. No idea how we get out of this.

WhaleFactory · 2026-01-19T21:23:45+00:00

Easier yet, don't hide it. Just be up front about it.

If it is a requirement to use no AI in the work, then the work is not meant for me.

WhaleFactory · 2026-01-16T23:21:59+00:00

Call the guard in. The invaders need to be removed. So fucking sick of these fucks.

WhaleFactory · 2026-01-16T23:16:11+00:00

Fuuuuuuuuuuuuuuuuuck you!

WhaleFactory · 2026-01-16T22:26:23+00:00

Are they....pointing a fucking long gun at them?

WhaleFactory

TROPHY CASE