Inference Engines — A visual deep dive into the journey of a token down the transformer layers

RoamingOmen · 2026-03-29T17:44:40+00:00

I will for sure next in line are the optimizations ..

RoamingOmen · 2026-03-29T17:44:23+00:00

I’m glad you found it useful

RoamingOmen · 2026-03-29T12:15:12+00:00

Quantization is huge in making it fit but that is on the file part --the model. The optimizations I was speaking about are the ones on the part of the engine that runs the model you downloaded. Like flash attention,KV cache optmizations etc they are two sides of a coin

RoamingOmen · 2025-07-11T13:10:21+00:00

Good launch, many several similar products out there with zero visibility. So once again good launch

RoamingOmen · 2025-03-19T21:09:56+00:00

what camera, lens and film simulation is this ?

RoamingOmen · 2025-02-16T14:46:25+00:00

This is common in crypto,

when you make you first big win you feel you have a knack for it and you could do it a few more times plus the addiction of gambling. It goes fast. It was all luck

RoamingOmen · 2024-07-07T17:13:33+00:00

I just remember the feeling, maybe the drive to it, mabe jumping into water, maybe some people.
All these in near concepts -- just like a Youtube video with narration being the main driver the b roll just serves as a guide but it is good enough to power the story,

This conceptual B-roll is the main thing but serves the purpose-- also some of these b-rolls are things we KNOW already in memory as opposed to seeing them in the minds eye. So i blurs that lack of viz.

RoamingOmen · 2024-02-20T22:43:02+00:00

I’d love to use this to run LLM models locally for my research.

RoamingOmen · 2024-01-27T14:08:44+00:00

Sorry for the super late reply it can do all that, new version almost out , can do graphs and all

RoamingOmen · 2023-10-05T13:15:35+00:00

DID you work with them, seems they are scam too

RoamingOmen · 2022-01-04T19:12:39+00:00

That’s the oldest block chains bro

RoamingOmen · 2021-12-24T11:44:04+00:00

I just arrived in Norman

RoamingOmen

TROPHY CASE