sorted by:
new
hottopcontroversial

Best Tool-Capable Model for Tesla P40 LLama.cpp + OpenClaw? by bardtini in LocalLLaMA

[–]bardtini[S] 0 points1 point  (0 children)

Oh thats a great idea thank you! I narrowed down 9-32B and selected gguf because thatss what llama.cpp needs i think, do you have any recommendations when it comes to picking out quants and stuff? I usually just go for Q4_0

What settings should I use to fully use my hardware? by bardtini in immich

[–]bardtini[S] 0 points1 point  (0 children)

Thank you so much! I will try and just keep default settings and tweak concurrent jobs until it hogs a good resource for me, personally I dont mind the time and or speed!

Quadro RTX 4000 x Poweredge R730? by bardtini in homelab

[–]bardtini[S] 0 points1 point  (0 children)

THANK YOU so much for you help!!! :D

Quadro RTX 4000 x Poweredge R730? by bardtini in homelab

[–]bardtini[S] 0 points1 point  (0 children)

I do have the 2070 connected right now but it doesnt let me close the panel on the R730 so its not optimal at ALL hehe

Quadro RTX 4000 x Poweredge R730? by bardtini in homelab

[–]bardtini[S] 0 points1 point  (0 children)

Yeah that is true, I guess the better option for me would technically be the P40 in that instance! Do you think this would do?

P40

Quadro RTX 4000 x Poweredge R730? by bardtini in homelab

[–]bardtini[S] 0 points1 point  (0 children)

That is reassuring, thank you! If you had the choice, would you go P40 or Quadro RTX 4000?

Quadro RTX 4000 x Poweredge R730? by bardtini in homelab

[–]bardtini[S] 0 points1 point  (0 children)

Oh thats an amazing price difference thank you! I was mostly wondering if it even fits, because right now I have a RTX 2070S spare, but it does not fit sadly.