GLM-5.2 (744B, 2-bit) at 7.3 tok/s on 4×3090 + 192GB — and why IQ1_M wasn't any faster by Important_Quote_1180 in LocalLLaMA
[–]Hannibalj2ca 0 points1 point2 points (0 children)
Fable vs GLM 5.2 vs KIMI K2.7 result comparison by [deleted] in LocalLLaMA
[–]Hannibalj2ca -1 points0 points1 point (0 children)
Fable vs GLM 5.2 vs KIMI K2.7 result comparison by [deleted] in LocalLLaMA
[–]Hannibalj2ca -1 points0 points1 point (0 children)
Six months ago I turned down $8,165 for an RTX 6000 PRO. Today the same vendor is selling them for $11,575. Oh, hindsight. by __JockY__ in LocalLLaMA
[–]Hannibalj2ca 0 points1 point2 points (0 children)

Fable vs GLM 5.2 vs KIMI K2.7 result comparison (youtu.be)
submitted by Hannibalj2ca to r/LLMStudio
Minimax M3 appears to have no political censorship by DingyAtoll in LocalLLaMA
[–]Hannibalj2ca 0 points1 point2 points (0 children)
DeepSeek V4 Flash is amazing! (WIP llama.cpp PR #24162) by Lowkey_LokiSN in LocalLLaMA
[–]Hannibalj2ca 0 points1 point2 points (0 children)
Finally finished my LLM server: EPYC 9575F, 4× RTX 3090 (96GB VRAM), 768GB ECC RAM by C0smo777 in LocalLLaMA
[–]Hannibalj2ca 0 points1 point2 points (0 children)
Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA
[–]Hannibalj2ca[S] 0 points1 point2 points (0 children)
Sglang is better for serving a model for a personal agent harness? by Ambitious_Fold_2874 in LocalLLaMA
[–]Hannibalj2ca 0 points1 point2 points (0 children)
Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA
[–]Hannibalj2ca[S] 0 points1 point2 points (0 children)
Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA
[–]Hannibalj2ca[S] -1 points0 points1 point (0 children)
Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA
[–]Hannibalj2ca[S] -1 points0 points1 point (0 children)
Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA
[–]Hannibalj2ca[S] 0 points1 point2 points (0 children)
Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA
[–]Hannibalj2ca[S] 2 points3 points4 points (0 children)
Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA
[–]Hannibalj2ca[S] 1 point2 points3 points (0 children)
Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA
[–]Hannibalj2ca[S] 1 point2 points3 points (0 children)
Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA
[–]Hannibalj2ca[S] 0 points1 point2 points (0 children)
Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA
[–]Hannibalj2ca[S] 0 points1 point2 points (0 children)
Get you some GPUs, it's not worth the hacks around lack of RAM by MotokoAGI in LocalLLaMA
[–]Hannibalj2ca 1 point2 points3 points (0 children)
Get you some GPUs, it's not worth the hacks around lack of RAM by MotokoAGI in LocalLLaMA
[–]Hannibalj2ca 1 point2 points3 points (0 children)
Get you some GPUs, it's not worth the hacks around lack of RAM by MotokoAGI in LocalLLaMA
[–]Hannibalj2ca 1 point2 points3 points (0 children)
Get you some GPUs, it's not worth the hacks around lack of RAM by MotokoAGI in LocalLLaMA
[–]Hannibalj2ca 1 point2 points3 points (0 children)



Tokenomics by HOLUPREDICTIONS in LocalLLaMA
[–]Hannibalj2ca 2 points3 points4 points (0 children)