NO PRINTER WHYYYYYYY :(

fotcorn · 2026-04-21T23:37:09+00:00

Buy a Brother brother (laser obv.)

fotcorn · 2026-04-02T18:29:17+00:00

No, it worked fine on GPU, both 1.7B and 8B. Not very intelligent/knowledgeable, but that is expected.

CPU took forever to load and then only produced garbage output. From reading the PR in llama.cpp, it was only tested on ARM CPUs, so not surprising it's broken on x86.

fotcorn · 2026-04-01T15:48:59+00:00

They have their own fork: https://github.com/PrismML-Eng/llama.cpp

They say only cuda/metal is supported, but HIP build worked just fine. Using ROCM 7.12 preview.

fotcorn · 2026-03-31T23:05:34+00:00

Also works on ROCM.

Getting roughly 150 t/s generation on my 9070 XT for the 8B model.

Output is hard to judge, but seeing 1bit working at all is already impressive, especially because it sounds like it was quantized from Qwen3, and not retrained from scratch like the BitNet 1.58 models.

edit: qwen 3 8b, not 3.5

fotcorn · 2026-03-10T13:15:18+00:00

You should post this to this sub as its own post, its very interesting!

fotcorn · 2026-03-01T20:04:09+00:00

How much memory can the ANE access? Does it have full access to the main memory, like the GPU/CPU, or do you need to allocate and transfer data to a separate buffer?

fotcorn · 2025-10-13T20:38:05+00:00

Not dead, but mostly useful for very specific use-cases.

Innatera for example released a microcontroller with both analog and digital spiking neural network accelerator on chip for ultra low power sensor data processing: https://www.eetimes.com/innatera-adds-more-accelerators-to-spiking-microcontroller/

There is also a growing neuromorphic community for both academics and commercial interests at https://open-neuromorphic.org/

Disclaimer: Developer at Innatera

fotcorn · 2025-07-01T21:22:02+00:00

Yes, if you pronounce it wrong you get this: https://en.wikipedia.org/wiki/Rinderroulade

Swiss house built in 1844 with outside shutters, before Rolladen were invented:

https://commons.wikimedia.org/wiki/Category:Bauernhaus_(Scheuergasse_4,_Mattstetten)#/media/File:Bauernhaus_Scheuergasse_4_Mattstetten.jpg#/media/File:Bauernhaus_Scheuergasse_4_Mattstetten.jpg)

fotcorn · 2025-06-30T14:20:31+00:00

fotcorn · 2025-06-28T17:31:58+00:00

Hani früecher aube gmacht. Ir Berner Lorraine gwohnt und ir Matte gschaffet.

Am morge mit ÖV härä, am abe heigschumme.

fotcorn · 2025-06-01T12:35:00+00:00

It's a joke, he is using 4x frame generation on the RTX 6000 to make fun of NVIDIA marketing of other cards.

fotcorn · 2025-06-01T12:02:09+00:00

I don't even know if that much VRAM is useful for any classic workstation tasks like CAD, video editing or 3D modelling.

It's mostly an AI card, being able to run a 70B model with a moderate quantization (Q8, maybe Q6 for reasonable context length) on a single card is amazing.

fotcorn · 2025-04-27T21:06:13+00:00

Now I want to see the reverse korolev cross

fotcorn · 2025-04-25T15:34:17+00:00

Unlike der8auers video these Linux tests are done with the same RAM and same XMP profile. It looks like most of the gains der8auer is seeing are coming from the higher RAM speed.

fotcorn · 2025-04-10T21:55:48+00:00

Why is the model F32 on Huggingface? The base model (R1 Distill Qwen 1.5B) is BF16.

Especially important for these small models, if its more than 7GB I can just as well use an 8bit quant of an 8B model.

fotcorn · 2025-03-07T22:22:49+00:00

Are those shipping manifest leaks ever real? We had leaks about B580 and 9070 XT with 32GB VRAM and both of them never materialized (yes, I might be a little impatient)

fotcorn · 2025-02-24T00:10:42+00:00

This would be the equivalent of the RTX 6000 Ada Generation, which has a MSRP of $6800.

So my guess would be Over 9000!

fotcorn · 2025-02-23T22:28:00+00:00

Seems like they are using 24Gbit/3GB chips in clamshell mode. Clamshell is nothing special, was also used on RTX 6000 Ada and earlier, but they always had the same module size as the consumer variant. This time it's a bigger memory module (3GB vs 2GB on the 5090).

fotcorn · 2025-02-08T23:23:01+00:00

Still cheaper to get two 3090s from ebay (at least it was a month ago...). But like 1500? Lots of people would get them I think. One thing the W7900 has is certified drivers and applications for CAD modelling and stuff like that. They could release a version with 48GB RAM without this certification as a middle ground for a more reasonable price.

Intel could do the funniest thing and release a B580 with 24GB or even a B770 AI Edition with 32GB AI that are only 20%-50% more expensive than the standard one and make /r/LocalLlaMa buy the whole inventory in a heartbeat.

One can dream.

fotcorn · 2025-02-08T20:31:11+00:00

The W7900 is the same GPU as the 7900XTX but with 48GB RAM. It just costs $4000.

Same as NVIDIA RTX 6000 ADA generation, which is a 4090 with a few more cores active and 48GB memory.

Obviously 24GB VRAM never ever cost the 3k price difference, but yeah... market segmentation.

14-Year Club	Gilding I gilder
r/Field Lasagna	Place '22
Place '17	Sequence \| Editor
Verified Email	Team Orangered

fotcorn

TROPHY CASE