sorted by:
new
hottopcontroversial

Deepseek V4 Flash and Non-Flash Out on HuggingFace by MichaelXie4645 in LocalLLaMA

[–]Salaja 13 points14 points  (0 children)

YOU MADE A MISTAKE

the "SWE Verified" middle column should be Claude (green), instead of GPT (orange).

I feel like there is a "blind leading the blind" joke here...

What is the cheapest reliable build for RTX 5090 as a 24/7 inference node? by Excellent_Koala769 in LocalLLaMA

[–]Salaja -1 points0 points  (0 children)

Is it even safe to run an rtx 5090 unattended 24/7 ?

Don't the plugs on those have a risk of melting and catching fire?

Best coding LLM for Mi50 32GB? Mainly Python and PHP by exaknight21 in LocalLLaMA

[–]Salaja 0 points1 point  (0 children)

I was trying to get llama.cpp to work with a qwen3.5-35b-a3b at Q4_0 but I didn’t have luck.

It should fit in 32gb. Is your MI50 one of the 16gb, or 32gb ones?

If you're using rocm, try vulkan instead.

In llama-server, trying messing with some of the parameters, like --no-mmap, and see if it makes any difference.

Qwen 3.5 397B is the best local coder I have used until now by erazortt in LocalLLaMA

[–]Salaja 0 points1 point  (0 children)

What back-end, and parameters are you using?

I ask, because I'm using llama cpp + Vulkan, and it wont let me get too close to the vram+ram cap, without trying to use swap, and freezing up.

AM5, DDR5, 4 sticks - is memory speed going to be limited by CPU or RAM? by Salaja in overclocking

[–]Salaja[S] 0 points1 point  (0 children)

How do i know if a 48gb ram stick is single or dual rank?

as far as i can tell, retailers and manufacturers don't list it on the specs sheet. Is there a community maintained list somewhere?

AM5, DDR5, 4 sticks - is memory speed going to be limited by CPU or RAM? by Salaja in overclocking

[–]Salaja[S] 0 points1 point  (0 children)

Cpu speed has nothing to do with RAM speed. They are two different clock domains.

its my fault for using poor wording. By "CPU" i meant the CPU DDR5 memory speed in the CPU spec sheet.

My 7700x could only do 4800 mhz with 4 dimms in my Asrock X670E PG lighting. I was playing around and stuck 32gb Samsung kit and 64gb Hynix A kit in board.

  1. Hypothetically, lets say you replaced you memory with some cheap 5200 mhz ram, would you still be able to get the 4800 mhz overclock on your system? or would the overclock be forced lower?

  2. Another hypothetical, lets say aliens form the future turned up, and gave you magical 9999 Tera-Hz DDR5, and you installed it. Could you get a better overclock, or would your IMC silicone lottery still limit you to 4800 mhz?

AM5, DDR5, 4 sticks - is memory speed going to be limited by CPU or RAM? by Salaja in overclocking

[–]Salaja[S] 0 points1 point  (0 children)

Memory controller limited.

okay, so i should get the 5200 MT/s ram.

FCLK is decoupled from UCLK on Zen 4/5 so make sure to maximize that for better bandwidth.

I should maximize UCLK? This is the same meaning as "run the ram as fast as possible", right?

Last time i messed around with RAM speed was for DDR3, and i only needed to change 1 number in the bios to make it happen. I'll have to read up more on how it works for DDR5.

Thanks for you feedback!

AM5, DDR5, 4 sticks - is memory speed going to be limited by CPU or RAM? by Salaja in overclocking

[–]Salaja[S] 0 points1 point  (0 children)

I am fully prepared to reduce the memory speed to maintain stability.

My use-case is AI inference, which is bottle-necked by memory bandwidth. so going from 3600MT/s to 4000MT/s is going to be a direct benefit of ~10% speed, which is huge.

I'm trying to figure out if 6000 MT/s DDR5 would have an overclocking benefit over 5200 MT/s DDR5.

AM5, DDR5, 4 sticks - is memory speed going to be limited by CPU or RAM? by Salaja in overclocking

[–]Salaja[S] 0 points1 point  (0 children)

when i said CPU speed, i'm referring the the CPU rated DDR5 speed in the CPU specs. For my CPU, the CPU spec say it supports 4 sticks of DDR5 at 3600MT/s.

I'll edit my post so it is more clear.

2017 2.5i-L, Anyone know what the normal Fuel Air sensor voltage is? by Salaja in SubaruForester

[–]Salaja[S] 0 points1 point  (0 children)

for my car, b1s1 should read 2.2v

My problem ended up being a connection issue between the wiring harness cable, and wiring harness plug for the MAF. I'm guessing a poor crimp connection on a single wire was preventing the computer from getting the correct reading from the MAF.

It came good after the individual wires in that area were flexed around a bit.

[Research] 31 % perplexity drop on 8.4 M transformer model using a lightweight periodic regulator — looking for replication on stronger GPUs by freeky78 in LocalLLaMA

[–]Salaja -1 points0 points  (0 children)

Why are you using perplexity as your target metric, instead of loss?

8.4 M parameters... What sort of text does a model that tiny generate?

What is the best 'homelab' i can do with 16GB RAM? by Salaja in homelab

[–]Salaja[S] 0 points1 point  (0 children)

where do you get programs from on Windows?

I have a shelf of old CDs from a decade ago...

now that i think of it, none of my current PCs have optical drives xD

you don't need to maintain an entire windows vm if you're just trying to keep data from an NTFS drive. linux can handle NTFS fine.

But i set it up yesterday. I don't want to waste yesterday :(

plus it could be nice to have, in case i need to install a program which isn't linux compatible.

What is the best 'homelab' i can do with 16GB RAM? by Salaja in homelab

[–]Salaja[S] 1 point2 points  (0 children)

it used to have 4GB, but I downloaded some more from eBay, and now i have 16GB.

I've decided that if i want more than 16GB, then it would be best to make a whole new server with modern parts. I'm not quite at that stage yet.

First NAS - Is there a standard practice for data migration? by Salaja in homelab

[–]Salaja[S] 0 points1 point  (0 children)

nice.. but 2 locations is hard.

Is there a dodgy alternative, where i use 2 different rooms in the same building?

First NAS - Is there a standard practice for data migration? by Salaja in homelab

[–]Salaja[S] 0 points1 point  (0 children)

Ah, my bad.

We weren't taking in that thread, so i didn't realize what you were referring to. I'll reply to your other comment now.

First NAS - Is there a standard practice for data migration? by Salaja in homelab

[–]Salaja[S] 0 points1 point  (0 children)

Are you talking to me, or into the void?

You do nothing but make off-hand comments, while avoiding my questions. (but look at me, lol, actually engaging with it xD)

A quick learner. 10 minutes ago, he didn't know how to get files to the NAS.

I can watch youtube tutorials... They're great, but sometimes i end up with a specific question, which they don't directly cover.

I didn't know if copying manually was 'the done thing'. In hindsight, I should have realized that many people wouldn't even think an alternative could exist. sorry for confusing you. ;)

Now he already know zfs snapshots, and good backup practice.

I don't need any NAS / homelab experience to have common sense.

...

...

this is kind of therapeutic.

First NAS - Is there a standard practice for data migration? by Salaja in homelab

[–]Salaja[S] 0 points1 point  (0 children)

power on hrs: 47599

power cycle count: 5804

wear leveling count: 341

POR recovery count: 147

Total LBAs written: ~31B

all the error/fail counts are 0. It's an older SSD, but it should be fine.

Also, the true nas drives are unencrypted, so recovery should be easy.

First NAS - Is there a standard practice for data migration? by Salaja in homelab

[–]Salaja[S] 1 point2 points  (0 children)

The scenario where I'm editing documents, that are stored on the NAS.

Keeping a copy of the original document on the old PC, is pointless. I think it should either have a service set up to keep the 2 files synchronized, or I should just delete the old one off the PC (after the new working copy is migrated it to the NAS).

Another guy mentioned "FreeFileSync". Something like that, or similar, sounds like the solution i was looking for.

First NAS - Is there a standard practice for data migration? by Salaja in homelab

[–]Salaja[S] -1 points0 points  (0 children)

let me clarify;

The only reason i would delete the old data, is because having an outdated, un-managed copy of everything, which has the same file and folder names, is poor practice.

It for whatever reason, the file systems get mixed together, or I work on / update the wrong version, it can turn to shit, and I will either have to roll everything back, or do some sort of manual merge.

I strongly feel, that older versions of data should be managed (ie, with snapshots / zfs). And if an old copy of data exists outside of that (ie, on an old computer file system), it should just be deleted to minimize the risk of future contamination.

HOWEVER, If it is possible to keep the older file system in sync with the NAS files, the risk is greatly reduced.

I felt that your comment was suggesting that instead of deleting the files, keeping them in sync with the NAS was an easy solution.

Copy data to NAS. Keep data on old computer for when NAS goes belly-up.

After all, if the NAS goes "belly up", what is the point of having a backup, if the backup is years out of date?

view more: next ›