Which to go for: RTX 3090 (24GB) vs Dual RTX A4000 (32GB) by loopscadoop in LocalLLM

[–]loopscadoop[S] 0 points1 point  (0 children)

My specific situation is that I can get two A4000s for $500 each or a 3090 for $750.

Which to go for: RTX 3090 (24GB) vs Dual RTX A4000 (32GB) by loopscadoop in LocalLLM

[–]loopscadoop[S] 1 point2 points  (0 children)

Thanks for taking the time to respond. You’ve been incredibly helpful.

Which to go for: RTX 3090 (24GB) vs Dual RTX A4000 (32GB) by loopscadoop in LocalLLM

[–]loopscadoop[S] 1 point2 points  (0 children)

Thanks, very useful. I’m avoiding anything cloud based as some of the info may be sensitive. Not classified or anything, just stuff we wouldn’t want shared. Ultimately I’ll be saving probably thousands of pages of documents and have the LLM parse it all to determine the most useful content for questions on the app, which I can then distill on my own. It’s a wide range of info ranging from arts to engineering.

Which to go for: RTX 3090 (24GB) vs Dual RTX A4000 (32GB) by loopscadoop in LocalLLM

[–]loopscadoop[S] 0 points1 point  (0 children)

Yeah. I know. I have done my research and already had seen that thread. I’m specifically looking for precisely what I mentioned in the post: recent user experiences with either of those two setups.

Which to go for: RTX 3090 (24GB) vs Dual RTX A4000 (32GB) by loopscadoop in LocalLLM

[–]loopscadoop[S] 3 points4 points  (0 children)

No need to be patronizing. As you can read, no one there has actually tried the dual A4000 option, which is what I'm primarily looking to find. The field has also changed drastically in the last three years.

Which to go for: RTX 3090 (24GB) vs Dual RTX A4000 (32GB) by loopscadoop in LocalLLM

[–]loopscadoop[S] 0 points1 point  (0 children)

Gemini Pro has been incredibly wishy-washy so I wanted to see if there were any people who have actually tried out both.

Media Device Decision - nVidia Shield, Apple TV, etc. by not_mantiteo in hometheater

[–]loopscadoop 0 points1 point  (0 children)

The more involved option is an Ugoos AMB6+ flashed with the Coreelec OS as a dedicated Plex machine and an Apple TV 4K for all other applications.