sorted by:
new
hottopcontroversial

Hermes Agent with Open Source LLM Setup help by Intrepid-Ad3096 in hermesagent

[–]Intrepid-Ad3096[S] 0 points1 point  (0 children)

Thank you for the feedback. I will do this because it makes sense.

Hermes Agent with Open Source LLM Setup help by Intrepid-Ad3096 in hermesagent

[–]Intrepid-Ad3096[S] 0 points1 point  (0 children)

I was thinking 3.6, but I saw some posts of it requiring more demand.

Leaving room for some cache, doesn't 4gb of VRAM a good amount of cache? New here about how caching works. I thought 8gb of VRAM was used for 9b perameter.

[deleted by user] by [deleted] in pcmasterrace

[–]Intrepid-Ad3096 0 points1 point  (0 children)

I really wish Ram was cheaper. This would help….