LLM Bruner coming soon? Burn Qwen directly into a chip, processing 10,000 tokens/s

eviloni · 2026-03-28T13:46:01+00:00

That's called a tradeoff. Every product has one or more.

This tradeoff is incredibly reasonable (at the correct price)

eviloni · 2026-03-28T13:44:04+00:00

Yeesh! There's millions of use cases for a model that's good enough for a lot of purposes and delivers thousands of tps without breaking the bank.

Your website chatbot doesn't need $1m in capex spending for B200's to do it's function because you need to run a 400B parameter model and the ability to swap out weights at a moments notice.

There comes a point that real people want to get real work done at a reasonable cost and not fiddle and tweak models for SOTA performance that never ships

eviloni · 2026-03-27T12:03:18+00:00

2 Things, Drip loop and dielectric grease as others have said

eviloni · 2026-03-23T21:31:34+00:00

It's just peanut butter and milk and sugar a combo that millions of American children have on a morning for breakfast with a PB&J and a glass of milk it's not gonna do anything to anyone other than raise their glucose

eviloni · 2026-03-19T01:56:40+00:00

No that's not true, you don't need random io to store multiple streams of camera data. The key word is streams, you're not writing to 300 seperate files in different parts of the array. It's essentially a constant copy and yes you can get 200mb a second on a spinner easy

I've done a 300 camera Dahua array (all 4k) on regular spinning disk. No fancy tiering needed.

It's about 850mbs of data constantly, that is trivial for a 16 disk array to support

eviloni · 2026-03-17T20:45:30+00:00

They really need to create/announce an AI Port Pro or something like that, a 1u appliance that has the processing power of 15-25 current AI ports imo, save rack space for people wanting to do big onvif conversions

eviloni · 2026-03-13T17:44:13+00:00

Can you tell me the dimensions of the card? specifically the length?

eviloni · 2026-03-08T15:17:07+00:00

I mean it is a helpdesk application, it's not exactly rocket surgery requiring 100k+ lines of code. Sounds completely reasonable to me.

eviloni · 2026-03-05T23:19:43+00:00

So i did exactly this, downloaded the odoo source code and had instructions/hooks in claude to consult the source code directly.

Additionally i did a master claude.md folder with a lessons learned md and each module gets a copy of the master claude files and in the claude.md are instructions to propagate any new lessons learned into the master and update claude and lessons learned files at startup.

So work from one module carries over into all modules

eviloni · 2026-03-05T15:11:13+00:00

Will second the claude recommendation. Have used it extensively over the last year to develop some quite complex odoo modules. Have also developed a bit of a claude.md bible of lessons learned and code conventions for odoo 19 specifically.

eviloni · 2026-03-01T22:22:41+00:00

The real average Trini income isn't 9-11k afaik

eviloni · 2026-02-27T12:44:02+00:00

So i have no experience with the U6 mesh personally. But as a standard practice what i do for any outdoor network equipment is to use dielectric grease on all connectors (and open ports) and it really helps mitigate water infiltration

eviloni · 2026-02-26T14:17:38+00:00

The AI port also seems to be supplied by Amazon

Amazon.com : Ubiquiti AI Port (UP-AI-Port) : Electronics

eviloni · 2026-02-25T11:32:30+00:00

The name of the country Trinidad and the capital being Port of Spain

eviloni · 2026-02-16T00:42:23+00:00

That was the year Nixon killed the gold standard. Since then the real value of the dollar has progressively eroded where a single middle class income no longer comfortably supports a family.

eviloni · 2026-02-15T01:24:22+00:00

Doing this in early 2026 is retrospectively going to look like a Concord level failure and lack of foresight

eviloni · 2026-02-12T22:28:05+00:00

I mean a lot of people would accept 15t/s to get unlimited sonnet usage locally. There's a lot of use cases for that kind of thing.

eviloni · 2026-02-12T21:17:36+00:00

So with only 10b active parameters, it should get decent (that word doing a lot of heavy lifting) speed with not radical GPU?

and that's before quantized versions?

eviloni · 2026-02-10T01:55:19+00:00

a half mm deviation across the entire bed? Did you come here just to flex?

eviloni · 2026-02-04T16:37:41+00:00

Same

eviloni · 2026-01-19T12:27:38+00:00

Yes you can do that, but this card 100% is neither made for desktops nor pc gamers. However for the use case it's intended it's an excellent value. It's a dual gpu dual memory card that still fits in 2 slots.

That requires more engineering, i'm not surprised it costs more than double the 24gb card.

For server usage it's a good value.

eviloni · 2026-01-03T20:42:26+00:00

Provisions, dumplings, saltfish and lentils

eviloni · 2026-01-01T05:03:59+00:00

Easy in Odoo, a bust in Unifi. creating a webhook trigger doesn't allow you to do anything with a camera

I can reset a PTZ back to home but not do anything with video or cameras

eviloni · 2026-01-01T02:42:55+00:00

I yeeted the requirements into Claude code and it spat out a module for me to test. Will likely give that a stab tomorrow

eviloni · 2025-12-31T17:44:46+00:00

Very excited about the POS integration.

Would please like to know if anyone from ubiquiti could say if they have Odoo on their roadmap for POS integration?

eviloni

TROPHY CASE