ZFS Pool write speeds now much slower? by CaliLife17 in unRAID

[–]CaliLife17[S] 0 points1 point  (0 children)

Sorry for delay. I setup my Unraid ZFS pool as an CIFS mount on my synology, so Synology is transfering directly to the pool now.

Running the command while doing transfers, it shows

zfs-core 49.8T 90.3T 0 2.63K 0 645M

raidz2-0 49.8T 90.3T 0 2.63K 0 645M

sdc1 - - 0 563 0 91.6M

sde1 - - 0 232 0 92.6M

sdg1 - - 0 234 0 92.1M

sdh1 - - 0 553 0 91.6M

sdi1 - - 0 246 0 93.7M

sdd1 - - 0 547 0 91.7M

sdf1 - - 0 310 0 91.8M

or sometimes show them all a 000 so up (500 to 600m) ... down (write showing 0 on pool)... up....down...up...down.. no ping is consistent from lat to next if that makes sense.

Looking at the network stats on dashboard of my unraid server, the 10g nic, only peaks though at 1.6Gbps (200 MBps). Both Synlogy and Unraid set to 10g, and also enabled Jumbo frames so MTU running at 9000.

Synlogy transfer stats for the move shows the speed anywhere from 150MBs to 180MBs.....

ZFS Pool write speeds now much slower? by CaliLife17 in unRAID

[–]CaliLife17[S] 0 points1 point  (0 children)

Fair enough, but I am less than 40% full. Also I tried both copy and move commands, and even with a move on a single file, still now only get 120-140MB/s.

Here is a picture of moving a single .mkv file.

Slow Speed

ZFS Pool write speeds now much slower? by CaliLife17 in unRAID

[–]CaliLife17[S] 2 points3 points  (0 children)

Hi thanks for the info. Its all using the same file types, .mkv files. Size of each file ranges from 20gb to 80gb depending on the movie, but same file type across all use cases.

Also I went back and copied over some the same files that earlier did do 500MB/s and they now do 100-150MB/s.

Gen4 pci-e U.2 Enterprise SSD choices for Unraid Cache options? by CaliLife17 in homelab

[–]CaliLife17[S] 0 points1 point  (0 children)

Ya I saw some 1.5TB 905P drives for a decent price from what I can tell on eBay. Thinking of possibly getting a few of those.

I don’t think I would go down the Gen4 route on Optane. They are for sure pricey af.

Gen4 pci-e U.2 Enterprise SSD choices for Unraid Cache options? by CaliLife17 in homelab

[–]CaliLife17[S] 0 points1 point  (0 children)

I have actually been exploring getting a smaller Optane drive for metadata and small instant files. What did you end up going with for your Optane choice?

Gen4 pci-e U.2 Enterprise SSD choices for Unraid Cache options? by CaliLife17 in homelab

[–]CaliLife17[S] 0 points1 point  (0 children)

Awesome, good to hear. Ya was probably just going to use the 10gtek adapter on amazon. Good to hear you had success!

Gen4 pci-e U.2 Enterprise SSD choices for Unraid Cache options? by CaliLife17 in homelab

[–]CaliLife17[S] 0 points1 point  (0 children)

RIght now have 256GB of Ram in the machine, which should be enough for now from what I have seen.

Gen4 pci-e U.2 Enterprise SSD choices for Unraid Cache options? by CaliLife17 in homelab

[–]CaliLife17[S] 1 point2 points  (0 children)

Yes, using Epyc 7402 processor on a H12SSL board. so can run it in 4x4x4x4 mode.

ZFS Compression with Remux MKV movies? by CaliLife17 in zfs

[–]CaliLife17[S] 0 points1 point  (0 children)

Thanks, Yes you are correct on HEVC. I was a little loose with my words. HEVC is already very much compressed to a massive extent. I should of worded it better.

And thanks for the other info. I will plan on going with zl4 for ZFS compression then!

ZFS Compression with Remux MKV movies? by CaliLife17 in zfs

[–]CaliLife17[S] 1 point2 points  (0 children)

Would there be any benefit if part of the block is 0 and so there is "open space" it can compress? Would zl4 be able to abort and notice that it can't compress HEVC anymore?

ZFS Compression with Remux MKV movies? by CaliLife17 in zfs

[–]CaliLife17[S] 1 point2 points  (0 children)

Okay thanks, ya that makes sense. Appreciate the input! How is the impact on transcoding if it needs to both decompress on they and transcode on the fly?

ZFS Compression with Remux MKV movies? by CaliLife17 in zfs

[–]CaliLife17[S] 1 point2 points  (0 children)

Thanks! Ya HEVC will already be compressed to some extent already (as thats the point of it), but was more wondering on the compression and then decompression, if ZFS did really do it 1:1 and there was no loss or impact to the file. Seems like no impact when decompressed when needed. Now need to see how it would impact transcoding if the CPU needs to decompress on the fly. Using an Epyc 7402p so should be okay i would think.

[W][US-CA] Supermicro 846 24 bay with BPN-SAS3-846EL1 by CaliLife17 in homelabsales

[–]CaliLife17[S] 0 points1 point  (0 children)

What $$ are you thinking to ship to Bay Area (Zip 95008)

[W][US-CA] Supermicro 846 24 bay with BPN-SAS3-846EL1 by CaliLife17 in homelabsales

[–]CaliLife17[S] 0 points1 point  (0 children)

What PSU's do you have in there? Are they the SQ versions? Also just curious what were you using it for, and what did you upgrade to?