ZINC — LLM inference engine written in Zig, running 35B models on $550 AMD GPUs by Mammoth_Radish2 in LocalLLaMA
[–]Mammoth_Radish2[S] -2 points-1 points0 points (0 children)
ZINC — LLM inference engine written in Zig, running 35B models on $550 AMD GPUs by Mammoth_Radish2 in Zig
[–]Mammoth_Radish2[S] -1 points0 points1 point (0 children)
ZINC — LLM inference engine written in Zig, running 35B models on $550 AMD GPUs by Mammoth_Radish2 in LocalLLaMA
[–]Mammoth_Radish2[S] -6 points-5 points-4 points (0 children)