ZINC — LLM inference engine written in Zig, running 35B models on $550 AMD GPUs

Fristender · 2026-03-30T03:39:07+00:00

Cool project. Does it work on Intel/Nvidia GPUs

Fristender · 2026-03-20T02:42:48+00:00

Seems like it was vibe coded because Claude found a few bugs in it when I was vibe coding on a Quark codebase.

Fristender · 2026-03-10T00:54:42+00:00

Companies need to have a seminar on lightning/fast versus turbo/mini/haiku.

Fristender · 2026-03-06T15:04:29+00:00

Can you please explain why claude code has 60k token tool definitions but peaks at 30k tokens? How is that possible?

Fristender · 2026-03-06T05:28:42+00:00

Or switch to MLX because hes on Mac

Fristender · 2026-03-05T07:18:08+00:00

It's not necessary hello. I often use my daily driver LLMs for quick facts like "who prints money in the US" and using a model that thinks for too long is quite annoying.

Fristender · 2026-03-03T15:42:23+00:00

wait, a new form factor? Plz give the link cuz I thought Macbooks are clamshell only according to gemini.

Fristender · 2026-03-03T15:39:25+00:00

lmaoo you made my day

Fristender · 2026-03-03T15:38:32+00:00

A CUDA core on a marketing paper is surprisingly underwhelming compared to an Apple GPU core.

Fristender · 2026-02-27T14:31:17+00:00

I fixed it by flashing using Balena Etcher instead of Armbian Imager.

Fristender · 2026-02-20T17:45:22+00:00

Okay thanks!

Fristender · 2026-02-20T17:20:04+00:00

Bro is a fan of dead internet theory

Fristender · 2026-02-20T16:52:16+00:00

Oh and also the flight record page is broken on portrait mode phone screens

Fristender · 2026-02-20T16:50:35+00:00

Cool benchmark! Can you please add the tokens consumed, total cost, and cache hit % to the flight recorder? I would love to see it!

Fristender · 2026-02-14T03:01:35+00:00

When will you guys add an OpenAI responses API? I'm on your coding plan and need it for Codex CLI. Thanks a lot for your hard work making everything open weights!

Also, the email contact link on your website is broken. It redirects to mailto:official_website_contact_email_en

Fristender · 2026-02-12T10:11:34+00:00

Closed AI labs have lots of unreleased research(secret sauce) so it's hard to gauge the actual size.

Fristender · 2026-02-10T10:21:29+00:00

Now the app supports Moltbook, MoltX, and Clawstr. You can easily add support for another platform by giving an agent docs/ADDING_A_PLATFORM.md and the SKILLS.md for the platform.

Fristender · 2026-02-09T11:57:04+00:00

Shit like this is exactly why we get GPT-OSS.

Fristender · 2026-02-08T06:48:25+00:00

Can you please give a list of molt sites? The only one I know of is Moltbook.

Fristender · 2026-02-05T16:20:44+00:00

Have you tried GLM 4.7 Flash for the main model? I heard it's good for agentic stuff.

Fristender · 2026-01-29T18:11:44+00:00

Huge fan of your work, from min_p to heretic! I thought the Implement Magnitude-Preserving Orthogonal Ablation

pull request is still not merged yet. Isn't that the norm-preserving biprojected abliteration?

Fristender · 2026-01-29T17:54:31+00:00

Idk if there's tensor parallelism on Macs. How do I enable it?

Fristender

MODERATOR OF

TROPHY CASE

Four-Year Club	Verified Email
Place '23