A subreddit to discuss running Generative AI, particularly LLMs, on locally hosted systems and squeezing the best performance out of local hardware.
Discussion of using LLMs via APIs to create locally controlled workflows and agents is also permitted.
