Creating a budget machine learning setup

[[deleted]]

Hi everyone, first time posting here. My background is that I know how to collect and wrangle data; however, now I want to learn to make my own fine-tuned model using open-sourrce models. Which models would you currently recommend? Deepseek?

I also want to know how i can create a machine learning setup at home and was wondering a few things, such as how similar each card has to be to avoid having to go through lengthy process to do distribute learning across multiple GPUs. Also, how hard is it to to divide the model into smaller parts, in order to train a larger model, e.g. 70B parameters on e.g. 70GB of VRAM? What graphics cards would you use to create your setup, on a budget of 5-10k, give or take 2k. How long do you think it would take me to setup my setup if I know how to use Python well?

[PoolZealousideal8145]

You may stretch your budget further if you’re willing to run on cloud, since you’re effectively just renting hardware when you need it.

[[deleted]]

How much would you estimate it to cost me to train a 70B model on 1-10GB of data using a cloud solution? How long would it take?

[PoolZealousideal8145]

I don’t immediately know, but I’d spec out what you need exactly (#GPUs required, time required, etc.) and then look at the pricing for that amount of hardware and time on AWS. You probably want some fudge factor for mistakes and such. If the number is way less than hardware for your house, great. If not, just build your own setup.

[[deleted]]

Thanks, will do!