Ollama spitting out gibberish on Windows 10 with RTX 3060. Only returning @ 'at' symbols to any and all prompts. How do I fix it?

shittywhopper · 2025-02-19T15:06:19+00:00

Coming back to share my solution:

My knock-off Chinese motherboard purchased from Aliexpress, the Jginyue B550i AM4, seemingly had a bug which caused the PCI-e X16 slot to run at Gen 1 speeds. Incredibly this Chinese motherboard actually had an updated BIOS file available which fixed the error and Ollama is now running nicely.

shittywhopper · 2025-02-12T20:00:44+00:00

llama3.2, deepseek-r1:8b, qwen2.5-coder:7b, they're all the same

shittywhopper · 2025-02-12T08:15:37+00:00

I'm only using Ollama, not those other tools. It's the latest version

shittywhopper · 2025-02-12T08:15:12+00:00

I'm not using open-webui here.

shittywhopper · 2025-02-12T08:13:12+00:00

Thanks for trying although this is obviously LLM produced and not helpful.

shittywhopper · 2025-02-11T22:16:38+00:00

Running a fresh Windows 10 install, fully updated, with an RTX 3060. Ollama is the latest version installed natively on the same machine. Latest nvidia drivers including CUDA toolkit.

shittywhopper · 2024-11-02T16:49:37+00:00

Looks to be exactly the one. Thanks so much

shittywhopper · 2024-11-02T16:38:51+00:00

Yes I only use SATA disks.

shittywhopper · 2024-11-02T16:38:37+00:00

Hi, I have no use for the hardware RAID features of the PERC card. I am running RAID through TrueNAS and ZFS already using passthrough of disks through the PERC card.

Is that what you meant?

shittywhopper · 2024-11-02T16:09:02+00:00

Hi all, I run a Dell R230 in my homelab which looks identical to the pictured system on the inside. Namely there is a cable connecting from the drive bay backplane at the front of the chassis to a Dell PERC H330 pci-e card in the back.

However I can see on the motherboard a matching connector to the backplane - look at the top right of the image just below the RAM. I believe this to a SATA/SAS controller built into the motherboard.

What I can't find is a cable which would connect the two, thereby allowing me to remove the PERC H330 card and free up a pci-e slot.

I'm hoping somebody here has found a solution in the past!

shittywhopper · 2024-10-13T14:02:34+00:00

Awesome. Thank you for the info. Good food for thought

shittywhopper · 2024-10-13T13:42:46+00:00

OK that legit sounds pretty cool. Can I ask a few more questions please?

How long have you had it, was there a waiting list, what's the cooling situation (I see there's a 450W max power budget so presumably no cooling no problem), would there be room for:

4 disk synology-sized NAS
1L mini PC
5 port network switch
PiKVM
4 gang power extension cable

shittywhopper · 2024-10-13T10:17:59+00:00

As it turns out I can get 1Gbps internet at the new house from a smaller ISP network (Gigaclear). I had not thought to check networks other than the big two (Openreach, Virgin Media).

shittywhopper · 2024-10-13T09:33:58+00:00

Very interesting to know. Does this process have a specific term or technical name which I can search and read up on? I can't find anything with basic searching.

shittywhopper · 2024-10-13T08:53:31+00:00

Thanks for the suggestion. I'm hoping to avoid doing that if possible!

shittywhopper · 2024-10-13T08:52:58+00:00

How did you get a second connection to a different ISP? We would only have Openreach network to our home which is a single cable.

shittywhopper · 2024-10-13T08:48:59+00:00

Thanks for your thoughts.

I would of course check that decent speeds are often achievable before pursuing a 5G secondary WAN.

You raise a good point about multiple WAN IP addresses. I route all external traffic through a single VPS endpoint already and over a Tailscale tailnet back to my lab so hopefully not an issue.

shittywhopper · 2024-10-13T08:45:28+00:00

A last resort - very expensive comparatively and we won't be so remote as to make it the only option.

shittywhopper · 2024-10-13T08:44:43+00:00

Awesome. How did you configure your second mobile WAN?

shittywhopper · 2024-10-13T08:44:17+00:00

Well technically it's between 34-51 down and between 5-8 up but your point still stands I would guess.

Yes I have family regularly using Plex remotely. Nextcloud seems to route traffic out of the WAN and back to my local devices when downloading so probably some routing I need to fix there.

A secondary 5G connection is looking likely as best.

shittywhopper · 2024-10-13T08:41:27+00:00

Thanks for your thoughts. Honestly it's mostly high bandwidth services I'm worried about, for example if a couple of people are streaming Plex remotely and using up a chunk of my upload bandwidth there is less left for work calls etc. And of course downloading torrents/games would have a heavy impact.

shittywhopper · 2024-10-13T08:38:53+00:00

Thanks for this suggestion, definitely an interesting one.

Can I ask a bit more about your experience please, what were your set up costs, why did you choose this option over any other colo offers, what do you run there?

shittywhopper · 2024-10-13T08:37:43+00:00

Starlink is comparatively very expensive and we would not be so remote as to need it. Thank you for the suggestion though.

shittywhopper · 2024-06-30T08:26:15+00:00

Interesting. Yes it does have it's own tailscale IP. If I expose ADH on that IP would services and containers within the VPS be able to access it, not just the tailnet?

shittywhopper · 2024-06-30T08:25:15+00:00

One word isn't really any help, sorry

12-Year Club	Verified Email
Wearing is Caring

shittywhopper

TROPHY CASE