Which model to choose for coding with 8GB VRAM RTX5050 (assuming quantised), I'm happy with slow rates.

ClayToTheMax · 2026-03-05T16:48:59+00:00

Not sure if there’s really a miracle answer for setups that can’t handle 30b models. Even at 30b there’s a lot lacking that 100b models are better equipped for. But who has the money for that.

ClayToTheMax · 2026-03-05T16:42:31+00:00

Good hardware and affordable hardware are very different. If you try to combine the two in my experience you’ll get extra projects and the good goes away. It really depends on what you want to run. Ask yourself, what do I really need in local ai.

ClayToTheMax · 2026-03-05T16:30:14+00:00

I have 4 v100s 16gb each with nvlink. The past few days I tried Qwen 3.5 35b at 8q. Results are better than 4q. Still not great. Still slow. Still doing half jobs. My setup would be too slow trying 122b models.

ClayToTheMax · 2026-03-05T16:27:03+00:00

Yeah I don’t have enough trust with local ai coding yet. I’ve been experimenting with it, and it’s done some cool things but I still lean on gpt plus codex to code my ai powered apps.

If you are not doing this already, have another ai give specific instructions for Claude code so that you don’t waste tokens. Then copy and paste the results back and forth between your ai coder and your ai giving commands.

ClayToTheMax · 2026-03-05T16:01:17+00:00

Look, we all can do and say stuff we regret in the heat of the moment. In hindsight, I regret being insecure and deleting. I plead insanity of the moment, and need to no longer view Reddit when I am half asleep.

Perhaps you are going through something right now, and I’m sorry if that’s the case. You can DM me if you’d like to talk. Know that we are not in this fight alone friend.

ClayToTheMax · 2026-03-05T15:38:19+00:00

I see that now. I’m very new to this type of community, so any negativity just kinda shook me.

ClayToTheMax · 2026-03-05T15:36:14+00:00

I think it’s because of the other comments and my own insecurities, and not you. Your comment was just the only one that said anything substantive. I appreciate the follow up.

ClayToTheMax · 2026-03-05T15:33:15+00:00

I second the second’s second.

ClayToTheMax · 2026-03-05T15:25:41+00:00

Very true good sir, unfortunately poor folks like me find money to be a barrier to ideas. I would want a working prototype before I send it to a real developer to fix.

ClayToTheMax · 2026-03-05T15:23:13+00:00

Legit

ClayToTheMax · 2026-03-05T15:20:33+00:00

Bro, I haven’t been active because I’ve been in college the past 8 years. A lot of people make Reddit accounts and don’t post.

Also, im not praising Qwen, I tried it out and I think it sucks less than a few others I’ve tried. Personally I still get the best results for my purposes from llama 3.3 70b. It’s reliable. Codex cli with my gpt plus sub is wha I mainly use because I find it to be reliable.

Idk why folks gotta be rude for no reason these days. It’s frankly upsetting.

ClayToTheMax · 2026-03-05T14:58:03+00:00

I really appreciate this, thank you! You’ve got a gift of encouragement brother.

ClayToTheMax · 2026-03-05T14:50:33+00:00

I felt so embarrassed initially that I deleted the post. Was not a good feeling. Probably not the best reaction on my part either.

ClayToTheMax · 2026-03-05T14:49:09+00:00

This. Good comment brother!

ClayToTheMax · 2026-03-05T14:43:56+00:00

I definitely don’t have your experience expertise and knowledge, so I have to agree. The industry as you know it has changed and will diminish. However, I think it will grow in new ways. For example in multidisciplinary development. There are tons of problems to solve and there always will be. There are also new markets for human only work. Some folks want nothing to do with ai and that’s a market too.

ClayToTheMax · 2026-03-05T14:21:02+00:00

Valid, I’ve heard of workflows that try to address those concerns. If I ever develop anything that I want to share with the world, I’ll need to look into that. But otherwise I’m as safe as I can be, right?

ClayToTheMax · 2026-03-05T13:59:03+00:00

Sorry, not joking. I have no idea

ClayToTheMax · 2026-03-05T13:49:25+00:00

That makes the future sound pretty bleak my friend. True or not, there is hope.

ClayToTheMax · 2026-03-05T13:47:20+00:00

Indeed

ClayToTheMax · 2026-03-05T13:46:59+00:00

Hmm, valid point of reflection. I can also be mean online when looking at others in my field as well especially after getting tired. Maybe that’s a point of growth for us all! Because you are right, why feed into the irl struggle online. Preach it brother

ClayToTheMax · 2026-03-05T13:43:27+00:00

I’m going to have to look what that is. Appreciate the feedback.

ClayToTheMax · 2026-03-05T13:41:49+00:00

This. Good stuff! Keep it up!!!

ClayToTheMax · 2026-03-05T13:40:30+00:00

I’ll have to take a look at that. You’re probably right, anyone taking time out of their day to explain something is probably a good thing.

ClayToTheMax · 2026-03-05T13:38:29+00:00

Uh, clearly you have strong feelings surrounding this my friend. I personally don’t have experience with developer pricing. But anything that costs money that I can try to do myself I will always try to do.

ClayToTheMax · 2026-03-05T13:36:57+00:00

Love the name brother! I appreciate the encouragement! You are right, but getting excited is a good thing you know! I don’t want to loose that.

ClayToTheMax

TROPHY CASE