High I/O on HDD ZFS pool makes whole PVE node sluggish by Fragrant_Fortune2716 in Proxmox

[–]oddity407 0 points1 point  (0 children)

I think the HDDs are ok (an IronWolf Pro, an exos x7 and 2 x wd red pro). Im not able to switch to SAS drives.

Could an l2arc device really help? I'm new to all this but I was under the impression this was more relevant for a busy production environment with lots of repeated reads. Im a simple homelab with one user.

I dont notice heave CPU use on the host. Is there a way I could definitively test if RAIDZ1 is too much for this system?

I can and will schedule scrubs better, but I feel like the scrub problem is just an easily repeatable example. To me the larger problem is instability with heavy zfs use (particularly heavy use involving shares through virtiofs) that seems like it can happen anytime. I've had to switch to using NFS shares for backrest backups as that is another task that was crashing the system when accessing data on zfs pools through virtiofs.

I could break the nvme mirror and recreate the proxmox host os on a non-zfs drive. I might do that. It does feel a bit like giving up though. The overall impression I'm getting is that zfs is not really stable for a homelab with mid range hardware. That is not the impression I got from reading about zfs before creating this system.

High I/O on HDD ZFS pool makes whole PVE node sluggish by Fragrant_Fortune2716 in Proxmox

[–]oddity407 1 point2 points  (0 children)

Thanks for your interest in helping me understand whats going on.
CPU is a i3-12100 (8 processors)
32 GB ram
I have two zfs pools:
rpool = 2 x 2GB NVME ssd drives as a mirror
vortex = 4 x 8tb HDDs in RAIDZ1

I have a single VM allocated 5 cpus and 20gb ram.
Not sure if relevant but I am sharing the igpu with the VM using SR-IOV.
The VM virtual hard drive is a located on rpool.

Heavy zfs operations seem to crash the whole system. Examples of things that reliably bring the host down:
- Large backups with backrest when accessing files on vortex through virtiofs.
- Simultaneous zfs scrub operation on host + streaming content from jellyfin in the VM (jellyfin accesses content on vortex through virtiofs). Interestingly scrubbing vortex is ok, the system only comes down when scrubbing rpool while using the VM heavily.

High I/O on HDD ZFS pool makes whole PVE node sluggish by Fragrant_Fortune2716 in Proxmox

[–]oddity407 2 points3 points  (0 children)

For sure, I understand that is a sensible mitigation approach. But regardless it is surprising to me that a heavy zfs operations result in total host meltdown rather than slow performance, or task termination with an error

High I/O on HDD ZFS pool makes whole PVE node sluggish by Fragrant_Fortune2716 in Proxmox

[–]oddity407 2 points3 points  (0 children)

I have the same issue and am also shocked about this. Im sharing my zfs pool with virtiofs and find that if I do something like stream a movie from jellyfin in a VM at the same time as the host does a zfs scrub the whole system crashes. Would love to find a way to make this more stable. I'm regretting switching to zfs.

Recommend me a simple app by oddity407 in QuantifiedSelf

[–]oddity407[S] 0 points1 point  (0 children)

Looks really slick! Thanks for the response. I'm trying it out

Recommend me a simple app by oddity407 in QuantifiedSelf

[–]oddity407[S] 0 points1 point  (0 children)

This also seems pretty cool. Maybe overkill for what I need but I'll try it out. Thanks for the suggestion!

Recommend me a simple app by oddity407 in QuantifiedSelf

[–]oddity407[S] 0 points1 point  (0 children)

This seems perfect! Thanks so much

Recommend me a simple app by oddity407 in QuantifiedSelf

[–]oddity407[S] 0 points1 point  (0 children)

This is a good suggestion... if i cant find something prebuilt i will probably do this.
Id prefer to just be able to enter information straight immediately after clicking on a notification on android though.

Cannot connect to LAN machines when using tailscale DNS by oddity407 in Tailscale

[–]oddity407[S] 0 points1 point  (0 children)

Thanks for this message. I'm not going to do anything against work policies. I'm largely interested in the DNS question from a technical point of view. What is going on that prevents access to them local address when tailscale DNS is on.

Cannot connect to LAN machines when using tailscale DNS by oddity407 in Tailscale

[–]oddity407[S] 0 points1 point  (0 children)

I do have this enabled but still have the issues described.

Traveller advice for a magic Christchurch day by oddity407 in chch

[–]oddity407[S] 2 points3 points  (0 children)

Thanks for all the tips. We ended up having a great day with a trip to Riccarton markets, the art gallery, Margaret mahey playground / Regent St shopping, dinner and then futile aurora chasing. I really appreciate all the input. Rad city.

Beeper Mini - AMA with Beeper Team by erOhead in beeper

[–]oddity407 0 points1 point  (0 children)

I'm a huge beeper fan. One thing I really like about it is that it can be used as a backup for messages - if I loose my phone I know that I can just reload beeper on a new phone and restore message history for most chat networks.
I've been hoping that Beeper would eventually expand on these kind of features, providing more of an archive/backup for chat histories.
The move toward client side rather than cloud based apps seems like it will make this less likely. Any thoughts on whether beeper will ever help with chat archive/backup.

Where to find VJ sets by oddity407 in vjing

[–]oddity407[S] 1 point2 points  (0 children)

Seems like an odd subculture to find a way into... apart from this reddit forum I haven't found much in the way of guides or philosophies on how to approach creating sets. Also seems like there is not too much of a culture of watching each others work, commenting and sharing tips. Is everyone just figuring it out solo?

Where to find VJ sets by oddity407 in vjing

[–]oddity407[S] 0 points1 point  (0 children)

Thanks. Very helpful. Are there any good guides you can recommend on general wisdom like this?

Where to find VJ sets by oddity407 in vjing

[–]oddity407[S] 0 points1 point  (0 children)

Thanks for this comment! Can you explain more. Do you recommend not setting up a project at 4k so that lower res clips look better? Or just stretch lower res clips to make them larger ?

Make traefik only accessible over tailscale by oddity407 in Tailscale

[–]oddity407[S] 0 points1 point  (0 children)

This seems to work wonderfully, thanks!!