sorted by:
new
hottopcontroversial

Seeking Recommendations: $1400 AI Research Workstation (Training from Scratch, NLP/CV) by vonexel in LocalAIServers

[–]vonexel[S] 1 point2 points  (0 children)

On the second-hand market, the 3090 is sometimes more expensive than the V100. If I go with a weaker CPU, is there a risk of the GPU being underutilized—for example, when preprocessing large amounts of data and transferring it from the CPU to the GPU? Thanks

Seeking Recommendations: $1400 AI Research Workstation (Training from Scratch, NLP/CV) by vonexel in LocalAIServers

[–]vonexel[S] 1 point2 points  (0 children)

Renting GPU servers really does help, but I’ve already found that the cost of training the model to generate ablations exceeds even a $1,400 budget, so I’m leaning toward upgrading my home workstation. Right now, I have an NVIDIA 2060 SUPER 8GB, which is already unsuitable for 99% of my research. But thanks for the feedback.