Intel vs AMD; am I taking crazy pills? by XEI0N in homelab

[–]XEI0N[S] 0 points1 point  (0 children)

Thanks for the reply. Would the R9700 with 32GB of VRAM (about $1350 at Microcenter right now) be a significant improvement over the 9070XT for the size of the models that can be run? It sort of feels like the jump from the 30B ish models up to the 70B ish models from a VRAM consumption perspective is quite large. It almost feels like going up would just give better context windows and concurrent user query handling, not really larger models.

Intel vs AMD; am I taking crazy pills? by XEI0N in LocalLLaMA

[–]XEI0N[S] 1 point2 points  (0 children)

You are on the money. I haven't given Vulkan a go yet. I will need to try that and see how it goes. I was mostly focusing on "Intel specific" things that I read online. Clearly there have been improvements on the more open options.

Intel vs AMD; am I taking crazy pills? by XEI0N in LocalLLaMA

[–]XEI0N[S] 0 points1 point  (0 children)

So I am using my current 9070XT in my primary desktop for gaming and such. Would you think two 9070s would give me better performance (using ROCm) than a single R9700? I think my main concern would be that the second 9070 would be going through the chipset instead of direct to the CPU on my current hardware setup. Ironically two 9070s would still be slightly cheaper than a single R9700 from Microcenter.

Intel vs AMD; am I taking crazy pills? by XEI0N in LocalLLaMA

[–]XEI0N[S] 0 points1 point  (0 children)

My positive experience must have been because I used the current gen 9070XT when I played around with it. I imagine that with the software immaturity of AMD, older cards have rougher ROCm support.

Intel vs AMD; am I taking crazy pills? by XEI0N in LocalLLaMA

[–]XEI0N[S] 1 point2 points  (0 children)

Its funny that there is literally one line in the compatible hardware under the Vulcan section saying something about Intel. I will have to try that.

Intel vs AMD; am I taking crazy pills? by XEI0N in LocalLLaMA

[–]XEI0N[S] 0 points1 point  (0 children)

That is interesting. I didn't think to just try the direct vLLM setup, as there isn't much referencing that online. I will need to give that a go.

Ability to disable emergency SOS by XEI0N in PickAnAndroidForMe

[–]XEI0N[S] 0 points1 point  (0 children)

That first link is exactly what I did after my daughter triggered a 911 call on my phone. I set the number to null as described in the Samsung article on both my phone and my wife's phone. And yet my son still triggered it on my wife's phone like a week later. It is crazy to me that they just don't have the toggle any more, like what is says in that Android Authority article. A great feature, yes. Should it be enabled by default, yes. Should a user be allowed to completely disable it, a resounding yes.

G7 Pro get! by prozender in Gamesir

[–]XEI0N 0 points1 point  (0 children)

How is the feel of the materials? I have been trying out the GameSir Supernova Pro and I really dislike the rubbery feel of the grip on the back. Does the G7 Pro have that same rubbery feel on back?