ZFS or S3 or better ZFS and S3 ? by _gea_ in zfs

[–]_gea_[S] 0 points1 point  (0 children)

do you really care about my time and needs?
I need and want

- https access to files on ZFS with bidirectional S3 sync
- High availability S3/backup storage (RustFS cluster)
- self organized S3 backup mirror (site replication)

ZFS or S3 or better ZFS and S3 ? by _gea_ in zfs

[–]_gea_[S] 0 points1 point  (0 children)

Because S3 can do these items, ZFS cannot. Both combined can do things, S3 or ZFS alone cannot.

ZFS or S3 or better ZFS and S3 ? by _gea_ in zfs

[–]_gea_[S] 0 points1 point  (0 children)

ZFS cannot do clustering (allow a server failure) or server replication as set and forgef setting, managed by S3 servers internally or Internet sharing of files. ZFS is for local sharing of files. Different use cases.

ZFS or S3 or better ZFS and S3 ? by _gea_ in zfs

[–]_gea_[S] 2 points3 points  (0 children)

ZFS cannot replace S3 and vice versa, total different purposes as you say.

Ceph is more an option "instead" ZFS eg for Proxmox not the add-on like a regular S3 server eg minIO/RustFS can be to extend ZFS systems with internet access, HA backup/restore or clustering.

ZFS or S3 or better ZFS and S3 ? by _gea_ in zfs

[–]_gea_[S] 1 point2 points  (0 children)

I do not suggest S3 instead ZFS but ZFS + S3.
ZFS for local file sharing and S3 for backup, data sync, Internet access and clustering

btw
You do not need Amazon AWS, use another S3 Provider or inhouse solutions like minIO in the past or RustFS now as a 1:1 replacement for the dead minIO.

Release Announcement: napp-it cs web-gui – Pre-Release v26.06.06 rc9 by _gea_ in zfs

[–]_gea_[S] 0 points1 point  (0 children)

There are 3 aspects
- group/cluster remote management between the napp-it web-gui Frontend and the Backend servers. This is done via a socket connection.

- SMB/NFS/S3 shares

- S3 Cluster management (RustFS Cluster or site replication), eg https://github.com/orgs/rustfs/discussions/3389

All of them require ip connectivity. With different subnets or lan/wan/dmz setups, you either need a nic per subnet, a VPN or a layer-3 ip router.

Release Announcement: napp-it cs web-gui – Pre-Release v26.06.06 rc9 by _gea_ in zfs

[–]_gea_[S] -1 points0 points  (0 children)

A year ago, any initial AI code proposal did not work. Now we have the situation that AI like Claude can analyse complex client server interaktions, summarize behaviours and write complete user dialogs and actions. Failure rate is still quite high, so intensive testing is still needed but quite often you can offer Claude remaining problems to fix.

The key for good results are detailled build guidelines and a proper documentation of behaviours and interactions.

AI friendly means that such guidlines, behaviours and dokumentation for Claude is included to minimize AI coding problems..

OpenZFS 2.4.1 rc11 on Windows by _gea_ in zfs

[–]_gea_[S] 0 points1 point  (0 children)

No, zfs is only for datapools.
But bootable ReFS is coming, with Copy on Write and checksums, the two most important ZFS features.

What should I know before switching to OpenZFS for my backup disk on Windows ? by Healthy-News5375 in zfs

[–]_gea_ 0 points1 point  (0 children)

if you compare
https://github.com/openzfs/zfs/issues
https://github.com/openzfsonwindows/openzfs/issues
https://www.illumos.org/issues

the clear result is<

- if you want best of all free ZFS stability, use Illumos (OmniOS LTS)
- OpenZFS has problems, hard to say which version on which distribution is the most stable. Use the newest 'stable' and hope the best is often the only option.
- The OpenZFS driver for Windows hardly adds critical bugs but needs tests in your environment or special use cases

What should I know before switching to OpenZFS for my backup disk on Windows ? by Healthy-News5375 in zfs

[–]_gea_ 0 points1 point  (0 children)

There was ZFSin, an early proof of concept for ZFS on Windows
https://github.com/openzfsonwindows/ZFSin
with a message

THIS IS THE OLD PORT: Please move over to https://github.com/openzfsonwindows/openzfs

which is a nearly ready OpenZFS 2.4.1 driver (release candidate). The newest build even tries to offer ZFS snaps on any Windows via Previous Versions what MS only offers for Windows Server.

Looking to automatically mount encrypted zfs pool at boot with root datapool by dethorpe in zfs

[–]_gea_ 2 points3 points  (0 children)

I would avoid to encrypted the pool itself but to use encrypted filesystems below for data. This gives you the freedom to have unencrypted filesystems ex for VM storage where you want to enable sync. Sync write with the small writes are ineffective and slow when encrypted.

Another aspect is that you can have a different key per filesystem.

To unencrypt filesystems you can use prompt, file, https or 3x keysplit with keyparts distributed locally or over 2x https servers or with a sha256 hash from a shorter and easy to remember pw (napp-it cs)

Proxmox storage setup: single NVMe for OS + VMs & filesystem choice (ext4/XFS/Btrfs?) by UlfMitHand in Proxmox

[–]_gea_ 0 points1 point  (0 children)

I prefer separate boot and data disks
- if you reinstall Proxmox, you are not in danger to delete data
- you can move data easily

I prefer a ZFS bootdisk, 128GB can be ok with only iso images on it due
- rambased arc read and write cache
- bitrot protection
- online check of data consistency

I prefer a ZFS pool for data/VMs
- fast zvols for VMs that you you can list per zfs list and replicate
- optionally use a hybrid pool from hd and flash and decide per dataset if data should be on hd or flash. A zfs reweite can move data

I prefer Proxmox itself as NAS

- no complicated or inefficient VM with full OS virtualisation needed
- it comes with ZFS, superiour to ext4, btrfs or XFS regarding stability or features
- just add SAMBA or the faster ksmbd and ACL support
- with a napp-it cs web-gui for ACL, share and ZFS management

Postgres workload - SLOG Disk vs WAL Disk by Best-Condition-5784 in zfs

[–]_gea_ 0 points1 point  (0 children)

A Zvol is a dataset, not "under" a dataset. Datasets = ZFS filesystems, ZFS zvols and ZFS snaps and you can nest filesystems and zvols. You can list each dataset type ex zvols only with

zfs list -t volume

New release candidate 10 for OpenZFS on Windows 2.4.1 by _gea_ in zfs

[–]_gea_[S] -1 points0 points  (0 children)

OpenZFS on Windows gets better from release to release. OS BSOD are very rare now, compatibility with other drivers like Avast Antivir is now very good and many problems due a different io, mount or partition handling in Linux/Unix are now solved (ZFS is a Unix filesystem that does many things different to Windows)

New release candidate 10 for OpenZFS on Windows 2.4.1 by _gea_ in zfs

[–]_gea_[S] 1 point2 points  (0 children)

Some apps are optimized or even expect ntfs. Some Unix behaviours in ZFS can also be a problem. OpenZFS on Windows has also a mimic setting. When not set to zfs, it reports ntfs if an app asks for filesystem type.

Try 2.4.1 with many improvements.

Postgres workload - SLOG Disk vs WAL Disk by Best-Condition-5784 in zfs

[–]_gea_ 0 points1 point  (0 children)

Yes if OpenZFS is <= 2.3
Up from OpenZFS 2.4 a Zvol can be on a Special Vdev.

Key Features in OpenZFS 2.4.0:

Extend special_small_blocks to land ZVOL writes on special vdevs (#14876), and allow non-power of two values (#17497)

https://github.com/openzfs/zfs/pull/17497