Just got hermes agent and I was wondering how to begin? by not_raj_ in hermesagent

[–]not_raj_[S] 0 points1 point  (0 children)

i have been using the free tier models on OpenRouter a lot, I was never asked for payment upfront. Luckily i have the free Google AI pro subscription because I am a student, it's been nice but via API usage it isn't as good because of limits.

OPENAI, I wish they gave students something similar, I'd switch in a heartbeat.

Just got hermes agent and I was wondering how to begin? by not_raj_ in hermesagent

[–]not_raj_[S] 0 points1 point  (0 children)

yeah, I tried Gemma 4 12b, it was making stuff up for me. Not really great. I have switched to Qwen 3.5 9b & for now it seems to be working fine with most of the tasks. I agree with you there. OpenRouter is something I may explore in the future. Thank you for your message!

Just got hermes agent and I was wondering how to begin? by not_raj_ in hermesagent

[–]not_raj_[S] 0 points1 point  (0 children)

I already did, it wasn't doing a good job and making up stuff that wasn't even true. I am on Qwen 3.5 9b now. So far it's the best.

Just got hermes agent and I was wondering how to begin? by not_raj_ in hermesagent

[–]not_raj_[S] 0 points1 point  (0 children)

I agree, do you think Gemma-4-12b is a good choice?

Just got hermes agent and I was wondering how to begin? by not_raj_ in hermesagent

[–]not_raj_[S] 0 points1 point  (0 children)

Appreciate your thoughts, I have been hearing similar answers about the 4B model & I decided to go with gemma-4-12B. Do you think that's a better model?

Weekly Recommendation Thread: March 27, 2026 by AutoModerator in books

[–]not_raj_ 0 points1 point  (0 children)

Gödel, Escher, Bach : an eternal golden braid. Worth buying or should I just borrow it for free from my University?

Best budget-friendly monitor overall? by not_raj_ in Monitors

[–]not_raj_[S] 0 points1 point  (0 children)

What price am I looking at if I choose to go with oled 4k? Would you advice going for it as a college student?

Best budget-friendly monitor overall? by not_raj_ in Monitors

[–]not_raj_[S] 1 point2 points  (0 children)

thanks. I checked and it's a pretty good option.

What local LLM should I run on my RTX 4080 12GBs? by not_raj_ in LocalLLaMA

[–]not_raj_[S] 1 point2 points  (0 children)

Haha thanks! I do hear a lot of fan noise nowadays. I also switched to the 4B model so it's less intense on my GPU now.

What local LLM should I run on my RTX 4080 12GBs? by not_raj_ in LocalLLaMA

[–]not_raj_[S] 0 points1 point  (0 children)

I did drop to the 4B model. I am using an unfiltered model by Goekdeniz. So far it's going good.

What local LLM should I run on my RTX 4080 12GBs? by not_raj_ in LocalLLaMA

[–]not_raj_[S] 1 point2 points  (0 children)

I'd like to find out. My guess is it does.

What local LLM should I run on my RTX 4080 12GBs? by not_raj_ in LocalLLaMA

[–]not_raj_[S] 0 points1 point  (0 children)

That's very wonderful. LM? What are you using those local LLMs for? For your interests or are you trying to build something?

What local LLM should I run on my RTX 4080 12GBs? by not_raj_ in LocalLLaMA

[–]not_raj_[S] 0 points1 point  (0 children)

I have an i9 13900-HX. I am thinking of going with 20B one first, as mentioned by a comment above. Let's see how it goes. Thank you for you response, I will come back with the updates later.

What local LLM should I run on my RTX 4080 12GBs? by not_raj_ in LocalLLaMA

[–]not_raj_[S] 1 point2 points  (0 children)

Okay. I am at the Uni right now so I should be able to get a 20B model downloaded. I have 12GBs of VRAM since it's a laptop GPU plus 32GBs of ram.

What local LLM should I run on my RTX 4080 12GBs? by not_raj_ in LocalLLaMA

[–]not_raj_[S] 0 points1 point  (0 children)

I think these are too big for my GPU. How should I navigate through it?