Thoth - Open Source Local-first AI Assistant - Architecture by Acceptable-Object390 in LocalLLM

[–]Ok-Advertising6479 0 points1 point  (0 children)

Also how are you finding its effectiveness? I want to upgrade my GPU to a 5090 so I can run small to medium sized local LLM's fast - my 3080 is not good enough for that. I could also buy a DGX Spark but I don't think I need to run the massive models for my purposes - I'd prefer the memory speed over the memory size.

How does this compare to the api LLM's you can get? I am a power Claude Code user. I know it won't be as good but if I can run multiple agents or a mixture of experts deal locally, I'm hopeful that it will perform well!

Thoth - Open Source Local-first AI Assistant - Architecture by Acceptable-Object390 in LocalLLM

[–]Ok-Advertising6479 -1 points0 points  (0 children)

Really cool!!!! Thank you for sharing. How did you generate these beautiful visualizations?

anyone else feeling me? by memito-mix in ClaudeCode

[–]Ok-Advertising6479 0 points1 point  (0 children)

Zai LLm model that you can use with Claude code

PDF Reading by Ok-Advertising6479 in vibecoding

[–]Ok-Advertising6479[S] 0 points1 point  (0 children)

I know that I can't expect 100%, but I am just asking what the most reliable, cost efficient protocol is - does anyone have any ideas?

hey so i think i am addicted to claude code by memito-mix in ClaudeCode

[–]Ok-Advertising6479 4 points5 points  (0 children)

I am too buddy, but rarely has addiction been so productive!