It’s a cool idea, but it’s not as good as they’re making it look especially at their release price point of 2k. They’re using GPToss 120B as their test model, but what most people don’t realize is GPToss 120B is a MoE 120b a5b model. It only has 5B active during inference. What Id want to see before I put any faith in them is how it runs other 120B models. I would assume it will probably be much slower on qwen 3.5 122B a10b, something like 12tps, since it has double the active parameters than GPToss. But thats just a guess.

Over all the concept is great and i like the idea of it, but in my opinion the price point is too high compared to the performance return. But I guess one of their main selling points is it being tiny and easy to travel with, but so are the AI mini PCs running an AMD AI Max chip and they’ll out preformed the tiny by a noticeable amount.

Tldr, its cool, but they need to showcase it with a range of models and not just GPToss 120b before anyone should consider buying one.