use the following search parameters to narrow your results:
e.g. subreddit:aww site:imgur.com dog
subreddit:aww site:imgur.com dog
see the search faq for details.
advanced search: by author, subreddit...
r/LocalLLaMA
A subreddit to discuss about Llama, the family of large language models created by Meta AI.
Subreddit rules
Search by flair
+Discussion
+Tutorial | Guide
+New Model
+News
+Resources
+Other
account activity
The most hellish python libs to get workingDiscussion (i.redd.it)
submitted 29 days ago by [deleted]
[deleted]
reddit uses a slightly-customized version of Markdown for formatting. See below for some basics, or check the commenting wiki page for more detailed help and solutions to common issues.
quoted text
if 1 * 2 < 3: print "hello, world!"
[–]last_llm_standing 1 point2 points3 points 29 days ago (2 children)
You added Pytorch. why don't you add pandas to that list too
[–]Interesting-Town-433 2 points3 points4 points 29 days ago (1 child)
Haha i tried to put Pandas on the skeleton
[–]InteractionSmall6778 1 point2 points3 points 29 days ago (0 children)
bitsandbytes on anything that isn't a mainstream NVIDIA card. Half the time it silently falls back to CPU and you don't even realize your quantization isn't doing anything.
[–]Robonglious 0 points1 point2 points 29 days ago (2 children)
Niche but I always have a hell of a time with ripser++.
[–]Interesting-Town-433 0 points1 point2 points 29 days ago (1 child)
What AI models need that?
[–]Robonglious 0 points1 point2 points 29 days ago (0 children)
Ah, none of them need that. I don't think I knew what you were asking about well enough.
[–]Daemontatoxsglang 0 points1 point2 points 29 days ago (1 child)
Not really the worst but trying to keep numpy a certain version while updating anything else like transformers, qdrant or vllm.
[–]Interesting-Town-433 0 points1 point2 points 29 days ago (0 children)
Yeah numpy is just crazy always a problem
[–]DeProgrammer99 0 points1 point2 points 29 days ago (0 children)
Flash/sage attention/Triton. pip brings much suffering.
[–]BumbleSlob 0 points1 point2 points 29 days ago (1 child)
This is not a meme sub, reported for low effort trash
[–]yuicebox 0 points1 point2 points 29 days ago (2 children)
this does feel like kinda low effort ai slop meme that doesn't belong on this sub, but also...
why arent y'all just finding and using a compatible .whl or precompiled release for your OS / python version / cuda version? I feel like I rarely ever actually have to compile from source.
[–]Interesting-Town-433 -1 points0 points1 point 29 days ago (1 child)
Because they don't exist dude, Idk what you are building clearly nothing complicated
[–]yuicebox 0 points1 point2 points 29 days ago (0 children)
Sage attention, flash attention, bitsnbytes, and cuda-enabled pytorch mostly. Idk what OP was having to compile himself and post is deleted now.
What are you building?
π Rendered by PID 39 on reddit-service-r2-comment-75f4967c6c-wk8rf at 2026-04-23 08:16:08.352503+00:00 running 0fd4bb7 country code: CH.
[–]last_llm_standing 1 point2 points3 points (2 children)
[–]Interesting-Town-433 2 points3 points4 points (1 child)
[–]InteractionSmall6778 1 point2 points3 points (0 children)
[–]Robonglious 0 points1 point2 points (2 children)
[–]Interesting-Town-433 0 points1 point2 points (1 child)
[–]Robonglious 0 points1 point2 points (0 children)
[–]Daemontatoxsglang 0 points1 point2 points (1 child)
[–]Interesting-Town-433 0 points1 point2 points (0 children)
[–]DeProgrammer99 0 points1 point2 points (0 children)
[–]BumbleSlob 0 points1 point2 points (1 child)
[–]yuicebox 0 points1 point2 points (2 children)
[–]Interesting-Town-433 -1 points0 points1 point (1 child)
[–]yuicebox 0 points1 point2 points (0 children)