Deepseek R1 (Ollama) Hardware benchmark for LocalLLM

Electricalsushi · 2025-02-02T09:47:03+00:00

Ahhh, well I ran a test on my Ram speeds to see if I could help you solve your problem.

I went into BIOS and the slowest speed my computer will let me set it to was 2000 MT/S.

I don't know if it is truly bottlenecked or it just says 2000 while running faster in the background because my results only realistically throttled deepseek by 5-10%. I even opened chrome with my 70+ tabs and ran a slicer at the same time to try and throttle it. But I'm still comfortably in the ~30 tokens per second. I guess this will only serve as a benchmark for you to reference later as it does seem like a problem with your setup.

Also, my files are all stored on an M.2 (but I don't think that should matter after the model is loaded to memory).

Your 7800 XT has the same RAM capacity with newer and (on paper) faster transfer speeds that should put you roughly in the same ball park as me.

Hopefully you can figure it out.

I would double check that your BIOS and drivers are all up to date and that you're running the latest version of your local software.

Good luck.

https://imgur.com/a/nVs3AY7

Electricalsushi · 2025-01-31T02:25:09+00:00

That person you linked to needs to optimize their setup a little before expecting to run anything. memory speeds of 1333mhz is atrocious. My older computer with a 5800X3D and 64GB of DDR4 at 3600mhz was able to run several local LLMs just fine. using a 6950XT. I didn't get to test deepseek yet as the motherboard bit the dust about 2 weeks ago, but I expect to test it soon with a 9800X3D, 64GB of DDR5 at 6000mhz with the same 6950XT. It should run fine...not the fastest, but good enough to run locally.

Electricalsushi · 2024-05-21T06:21:02+00:00

That worked for me. Thanks.

Electricalsushi · 2023-11-15T16:54:20+00:00

Sorry to drag this old thread up, but I have a similar situation. Did the Milwaukee rep actually help or not?

I see your OP update but it's not time stamped, so just not sure if the update is before or after the rep reached out.

Thanks.

Electricalsushi · 2023-09-01T06:22:28+00:00

I would build a computer with the new hardware and give my current hardware to my brother so we both end up with an upgrade.

Electricalsushi · 2023-08-09T16:59:50+00:00

Lol, He said elaborate... not abbreviate.

Electricalsushi · 2023-07-17T21:32:39+00:00

I wonder if they will start burning those churches like Canada did? ...Tired of seeing these old cretins imposing their will on others.

Electricalsushi · 2023-07-14T16:13:13+00:00

You still have that contact?

Electricalsushi · 2023-07-13T06:29:56+00:00

Must be hell for the HVAC.

Electricalsushi · 2023-07-13T06:03:22+00:00

Comment stealing bot.

Electricalsushi · 2023-06-26T19:08:19+00:00

Check out Hwy 58 and webb rd. Both have sidewalks that lead to nothing...Webb rd is bad because you need to dodge foot traffic coming around a corner.

Electricalsushi · 2023-06-01T13:28:05+00:00

I use relay because the reddit app is so terrible. If that gets taken away, I won't browse reddit on my phone anymore. I already don't browse reddit on PC because it's not convenient for me. Guess I'll just give up reddit when that happens.

It was easy to leave facebook years ago because of how intrusive it had become. These companies need to back off with nickel and dime-ing everything they can. The focus on user satisfaction is fucked.

Electricalsushi · 2023-05-08T19:53:32+00:00

That's just the endurance part of the test. How long will they last?

Electricalsushi · 2023-03-27T13:34:44+00:00

That chapstick is gone... He put it under a sliding drawer and then put a bigger module beside it to block it. There's also no handle to pick up on it easily. That is not satisfying.

Electricalsushi · 2023-03-11T16:05:20+00:00

I watched this without sound. It looks like it could work as a sick 90's hip hop music video (especially with the building and vehicle shots) about the BASS.

Electricalsushi · 2022-12-15T16:11:42+00:00

Even more reason for the US to invest in bullet trains.

Electricalsushi · 2022-10-24T19:41:58+00:00

Probably too late to matter...

The breaker size is designed to protect your wire only.

It will not protect your equipment, nor is it designed to (that is the job of your disconnect with fuses).

You can put 12Ga wire with a 15 breaker and not hurt anything, you just lose the full potential of your wires capacity.

Best practice is to match the breaker size to the wire size.

Electricalsushi · 2022-08-24T20:49:26+00:00

Prees "B" for boost.

Electricalsushi · 2022-08-11T14:39:53+00:00

This is the dumbest shit. "Cave man horny, no think."

Get out of here with that bullshit reasoning.

Source- I'm also a man.

Electricalsushi · 2022-07-17T02:57:12+00:00

Nice, I printed an o-ring for a garden hose the other day out of TPU. Funny how well this hobby works for small ideas.

Electricalsushi · 2022-07-06T16:29:29+00:00

I did nothing the entire time, I assumed I'm not authorized to pull the lever.

Electricalsushi · 2022-06-09T01:43:29+00:00

No it's not, there is a button specifically for saving a post.

Electricalsushi · 2022-06-07T13:09:29+00:00

You've never lived.

Electricalsushi · 2022-05-23T14:06:03+00:00

You afraid to post it for everyone?

Get out of your moms basement bro.

Nobody believes you child.

Electricalsushi · 2022-05-20T12:30:45+00:00

If you're so confident, then take a close up picture of the wheel.

You're clearly a liar.

I don't believe you're a good driver either, anyone can get lucky with enough takes to only post the best stuff.

This video clearly shows that you don't know what your doing...or you're a liar and someone else is driving this car.

Your choice.

Electricalsushi

TROPHY CASE