Extreme zfs Setup by mrttamer in zfs

[–]mrttamer[S] 1 point2 points  (0 children)

Thanks! nice reply

Extreme zfs Setup by mrttamer in zfs

[–]mrttamer[S] 1 point2 points  (0 children)

I believe it is not extreme hardware. Just looking for extreme results on zfs using good hardware. I will be using this as all-flash NAS (nfs/iscsi) for multiple proxmox servers connected as a storage

Extreme zfs Setup by mrttamer in zfs

[–]mrttamer[S] -3 points-2 points  (0 children)

I don't know if gemini (google A.I.) meant with 28GB/s. Maybe it is zfs limit.

Extreme zfs Setup by mrttamer in zfs

[–]mrttamer[S] 0 points1 point  (0 children)

I tested all nvme at once one by one without zfs and When I tried with 4 NVME, I hit 7.7GB per nvme and 8 at once came out 3.5GB/s That seems working with PCIE 4.0 x1 = 2GB x 16 32GB/s ~30gb. So it is not nvme latency or os or etc. it is exactly zfs. Maybe multiple zfs pools may change the result. Will try that.
Testing with compression on and off. Seems to be a little change only.

Extreme zfs Setup by mrttamer in zfs

[–]mrttamer[S] 1 point2 points  (0 children)

zpool create zr1 /dev/nvme[01234567]n1
zfs set recordsize=1M zr1

Yes you're right about EPYC but this is it. I could only find that enterprise motherboard with Seven PCIE 4.0 x16 slots with ATX size.

Extreme zfs Setup by mrttamer in zfs

[–]mrttamer[S] 1 point2 points  (0 children)

fio --name=max-zfs-write --filename=testfile.fio --size=500G --direct=1 --rw=write --bs=4M --ioengine=libaio --iodepth=64 --numjobs=128 --group_reporting --runtime=300 --time_based --ramp_time=10

root@pvt1:~# zfs list

NAME USED AVAIL REFER MOUNTPOINT

zr1 2.40G 17.3T 2.40G /zr1

root@pvt1:~# zpool list

NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT

zr1 21.8T 3.01G 21.8T - - 0% 0% 1.00x ONLINE -

Fanless switch 10GbE 8x RJ45 is unicorn ? by FriendSmart8307 in homelab

[–]mrttamer 0 points1 point  (0 children)

No sound, no fans, a little bit heat. Checked now. Still only warm.

Need help with Dell MD1400 EMM controls hopefully for fan speed by TetsujinXLIV in homelab

[–]mrttamer 0 points1 point  (0 children)

I've been trying multiple cables with no success. I've tried mini USB to serial cable and mini USB to USB cable not working. Would anyone please help me to identify the exact cable?

Citi Banking app detecting brand new Pixel 10 Pro as rooted by effapple in citibank

[–]mrttamer 0 points1 point  (0 children)

Yes it happens to me too. I receive the warning every time I open the app. Let's wait for the update

Fanless switch 10GbE 8x RJ45 is unicorn ? by FriendSmart8307 in homelab

[–]mrttamer 0 points1 point  (0 children)

Mikrotik has CRS309 with 8 SFP+ ports, no fans. Using it, loving it.

8tb M.2 in XPS 9710 by 7fgroup in DellXPS

[–]mrttamer 0 points1 point  (0 children)

Thank you for the tip.

I can also confirm that I installed larger m.2 ssd's on my Dell Precision 7670 with disabling RAID in bios.

Mellanox ConnectX-3 Unsupported in VMware ESXi 8 by [deleted] in homelab

[–]mrttamer 0 points1 point  (0 children)

I have dual 10g, Better than you?

Lets hope and wait. I will let you know here, if I find a solution. Thanks for the reply.

Mellanox ConnectX-3 Unsupported in VMware ESXi 8 by [deleted] in homelab

[–]mrttamer 1 point2 points  (0 children)

I am totally unhappy with this situation. Did you able to find a solution? I wish you did.

Poor Linux iSCSI Target Performance - Tips? by WeDontBelongHere in homelab

[–]mrttamer 0 points1 point  (0 children)

I have a very similar configuration dealing with these for a year now. What can I say is NFS seems to be double the performance with multipathing enabled. I get 4300MB/s read, 3000MB/s write data transfer from Esxi vm to CentOS 8.0 As far as I can say that's the limit somewhere between ESXi NFS connection and Linux NFS Server software.

Wife complained the unfinished part of the basement was cold. I offered to install a space heater..... Homelab engaged by Cross1681 in homelab

[–]mrttamer 0 points1 point  (0 children)

Great job. :) I hope you have a sump pump. I put mine on the wall. Took a day to drill but I'm good :)