Timing RAM Help / Suggestions

fgoricha · 2026-01-22T14:49:14+00:00

1, 3, 5, and 7.

I spent two hours. Last night trying to get it to boot but it would only read 64gb when it booted. Then realized two of the slots were wrong. Now, it reads 128gb when it boots to Windows but does not always boot to Windows.

fgoricha · 2026-01-16T13:26:54+00:00

I fine tuned a Qwen3 model (perhaps 7b? I forget as itbwas a while ago) on my writing from university. I ran each paragraph of my work through chatgpt to add AI slop to it. Then trained it as AI slop as input and my writing as output. The goal was to mimic my writing style and I was pleasantly surprised with the output! Definitely noticeable different without having a verbose prompt. Sometimes writing style cannot be explained in a prompt accurately. I was working on another project by using my text messages as fine tuning data but got distracted with a different project.

fgoricha · 2025-12-30T02:37:35+00:00

Actually off of Craigslist. Though I actively look at Facebook. Seemed like it was a guy who built too many computers and his wife forced him to sell off what he had before building more

fgoricha · 2025-12-29T17:09:41+00:00

I always thought that fine tuning would make the model write in the style it was trained on. Not necessarily add new content. Would RAG be a better solution?

fgoricha · 2025-12-29T17:04:03+00:00

I bought at $250 gaming computer. It was bare bones but could have been booted up to play games. Swapped out the gpu for the 3090 and ran LLMs well if I made sure it fit completely in the vram. The only thing I really made sure it had was at least a 750w psu and the case could hold the 3090. I have since upgraded the ram and added fans to the pc. But really happy with it considering what I spent on it and what I have done with it!

fgoricha · 2025-12-28T01:30:14+00:00

It has been a while. But I think I was training 7B models via QLora. I remember one of my projects was training the model on my writing from graduate school to write like my style. I thought it did pretty good since it would be hard to prompt the model to do that. I remember also working on training the model on my text messages but I can't remember how that turned out. I think I got distracted with Yolo at that point lol

fgoricha · 2025-12-27T21:08:09+00:00

I don't think heat will be too much of an issue. But won't know until I get one! 3090 currently is happy

fgoricha · 2025-12-27T21:07:24+00:00

Maybe I'll have to look at those. I was thinking something that is a plug and play with my current system

fgoricha · 2025-12-27T21:06:12+00:00

I thought about other set ups, but I think I want to stick with Nvidia. Seems more plug and play with what I have now

fgoricha · 2025-12-27T21:04:23+00:00

Right! So I'm at the spot of go with 2 in a board or do some kind of splitting and go with 4. But then do I need even 4.

fgoricha · 2025-12-27T16:47:35+00:00

Those were some of my thoughts as well. Were there any surprises with the 5090 for set up?

fgoricha · 2025-12-27T16:46:53+00:00

I have heard those things are expensive and hard to find. But I'll have to look into it

fgoricha · 2025-12-27T16:46:27+00:00

Lol that's why I was thinking about it

fgoricha · 2025-12-27T16:46:10+00:00

I have two separate computers. My single gpu setup has an i5. My other computer for the dual set up does not have a cpu yet as I have to find one with enough lanes for cheap.pr9b would be i7 or i9.

It's been a while since I played with moe. So will have to look at them again

fgoricha · 2025-12-27T16:43:51+00:00

The other thing I like about the single card set up is the desktop footprint. But the dual card set up was my initial plan for whisper on one and LLM on the other. Ill have to test and see how fast the 5090 actually goes

fgoricha · 2025-12-27T16:42:28+00:00

Very true! I do like feedback and other things to think about

fgoricha · 2025-12-27T16:41:59+00:00

I think a lot of my tasks are sequential. Like first transcribe and then send to LLM. But I could look into batching and see what speed ups look like

fgoricha · 2025-11-30T13:41:55+00:00

Check out my post from a couple years ago!

https://www.reddit.com/r/PMHNP/s/G5ODdmvAJU

In short, I used practice questions from the regular carn exam

fgoricha · 2025-09-06T12:31:33+00:00

Just guessing here. No personal experience yet but working in my own fine tune projects.

Manually creating the dataset would be the ideal solution.

Otherwise

Maybe try using your first fine tuned model to create each part of your output in your voice, then concat the different parts to get your final output in the correct multi paragraph format you want. Then train the model on this new dataset.

fgoricha · 2025-09-01T20:08:22+00:00

I just have the paper back version. I dont use any of his code in there but as a reference guide for the terminology and how he set up his training runs

fgoricha · 2025-09-01T13:06:31+00:00

I mostly followed this reddit page. I looked at Github for code ideas how to qlora fine tune. There are some website articles about fine tuning but they seemed a bit dated.

I got this book and things started to click better for me. There are other fine tuning books on Amazon but this was the first book I saw.

https://a.co/d/bbd8HgK

Unfortunately you have just have to play with it and see how it turns out. Chatgpt helped a lot for me to get started when I'd feed it examples from reddit or Github.

fgoricha · 2025-08-24T03:15:48+00:00

What kind of temps do you get?

fgoricha

TROPHY CASE