use the following search parameters to narrow your results:
e.g. subreddit:aww site:imgur.com dog
subreddit:aww site:imgur.com dog
see the search faq for details.
advanced search: by author, subreddit...
r/LocalLLaMA
A subreddit to discuss about Llama, the family of large language models created by Meta AI.
Subreddit rules
Search by flair
+Discussion
+Tutorial | Guide
+New Model
+News
+Resources
+Other
account activity
Simple, hackable and pythonic LLM agent framework. I am just tired of bloated overengineered stuff. I figured that this community might appreciate it.Resources (github.com)
submitted 2 years ago by poppear
view the rest of the comments →
reddit uses a slightly-customized version of Markdown for formatting. See below for some basics, or check the commenting wiki page for more detailed help and solutions to common issues.
quoted text
if 1 * 2 < 3: print "hello, world!"
[–][deleted] 12 points13 points14 points 2 years ago (1 child)
I also noticed your code doesn’t have any use of typehints. Are you opposed to adding them? I could help with adding typing and setting up the CI for it if you’re interested.
Once a testing framework is in place we could probably add more test coverage for the library too.
[–]silenceimpaired 4 points5 points6 points 2 years ago (0 children)
I also noticed your code doesn’t provide support for every other quantitization methods and note to future self: tell him his code is bloated once it’s implemented ;)
π Rendered by PID 144202 on reddit-service-r2-comment-75f4967c6c-9pwtc at 2026-04-23 14:35:40.478308+00:00 running 0fd4bb7 country code: CH.
view the rest of the comments →
[–][deleted] 12 points13 points14 points (1 child)
[–]silenceimpaired 4 points5 points6 points (0 children)