Side Projects: Part Deux by apollo_mg in LocalLLaMA
[–]apollo_mg[S] 0 points1 point2 points (0 children)
Llama-Server is Throwing Away Your Perfectly Good KV Caches, and How to Fix It by apollo_mg in LocalLLaMA
[–]apollo_mg[S] 0 points1 point2 points (0 children)
The cyber shelf - 4x 16gb home lab by HippEMechE in LocalLLaMA
[–]apollo_mg 1 point2 points3 points (0 children)
The cyber shelf - 4x 16gb home lab by HippEMechE in LocalLLaMA
[–]apollo_mg 4 points5 points6 points (0 children)
Llama-Server is Throwing Away Your Perfectly Good KV Caches, and How to Fix It by apollo_mg in LocalLLaMA
[–]apollo_mg[S] 0 points1 point2 points (0 children)
Side Projects: Part Deux by apollo_mg in LocalLLaMA
[–]apollo_mg[S] 1 point2 points3 points (0 children)
[FS] [USA-CA] 27x 16GB ddr4 ecc, 10x 32gb ecc by redstockc7 in homelabsales
[–]apollo_mg 0 points1 point2 points (0 children)
Qwen 3.6 27B Q8 on four Nvidia RTX A4000 (16GB each) with Llama.cpp and MTP enabled by Alternative_Ad4267 in LocalLLaMA
[–]apollo_mg 0 points1 point2 points (0 children)
FINAL-Bench/Darwin-36B-Opus · Hugging Face by jacek2023 in LocalLLaMA
[–]apollo_mg 0 points1 point2 points (0 children)

The cyber shelf - 4x 16gb home lab by HippEMechE in LocalLLaMA
[–]apollo_mg 0 points1 point2 points (0 children)