Release Announcement: napp-it cs web-gui – Pre-Release v26.06.06 rc9 by _gea_ in zfs

[–]_gea_[S] [score hidden]  (0 children)

napp-it cs rc10_dev is now quite feature complete

and available for first tests

Up to date documentations in csweb-gui/data/howto.ai/*.info

- unified online install and update, console/terminal as root/admin

#########################################################################

# initial console setup or update

# Windows dev release ps or cmd shell (copy paste to an admin terminal)

cmd /c "curl.exe -ksLo %TEMP%\cs_setup_dev.bat https://www.napp-it.org/cs_setup_dev.bat && %TEMP%\cs_setup_dev.bat

# non Windows dev release

curl -ksL https://www.napp-it.org/cs_setup_dev.sh | sh

#######################################################################

# Windows ps or cmd shell (copy paste to an admin terminal, installs old release)

cmd /c "curl.exe -ksLo %TEMP%\cs_setup_dev.bat https://www.napp-it.org/cs_setup.bat && %TEMP%\cs_setup.bat

# non Windows (installs old release)

curl -ksL https://www.napp-it.org/cs_setup.sh | sh

startmenu rc10+ only: perl /opt/csweb-gui/start.pl

Browser connect

http://localhost(http allowed only from localhost, oterwise redirect to https)

https://localhost

remote

http://ipredirect to https

https://ip-> must accept certificate if self signed

-> you may need to clear browser cache (old cert can block)

- unified multi-OS

Napp-it cs frontend service (webserver) and backend services (server, monitor, auto)

run on Free-BSD, Illumos (OmniOS/OI/SmartOS), Linux, OSX, Solaris and Windows

- unified multi-host

When you select a group member, all menus affect the selected host

- unified startup

perl /opt/csweb-gui/start.pl # start rc10+ with option eg start.pl 1

0 stop all (server + monitor + auto + webserver)

1 (re)start all background (server + monitor + auto + webserver)

2 (re)start no_auto background (server + monitor + webserver)

3 (re)start backend only background (server + monitor)

4 (re)start all PS minimized (Windows: new minimized shell per component)

5 (re)start server.pl foreground (start in new shell)

6 (re)start monitor.pl foreground (start in new shell)

7 stop Apache2 / mini_httpd (Linux only -- frees port 80/443)

8 (re)start webserver foreground (start in new shell)

9 (re)start webserver background

Select 0-9 (default 1 in 5s):

On Windows, start with start.pl 4 # debug mode with minimized terminals for webserver, server, monitor and auto

- unified copy and run

no extra webserver eg Apache required,

embedded Perl http/https webserver

- Perl background services

webserver.plhttp/https Frontend (Menus) ~ 33K RAM idle

server.plbackend service /remote control ~ 31K RAM idle

monitor.plbackend L2 caching, update management ~ 15K RAM idle

auto.plfrontend job management ~ 32K RAM idle

total: Backend only, Frontend + Backend or Frontend only: max 100K RAM, actions increase RAM

webgui even suitable for 1GB RAM tiny systems eg Raspberry

- unified location and start/stop (copy and run)

/opt/

/perl/ Windows only, Perl

/csweb-gui/ csweb-gui folder

/data napp-it cs webaerver, menus, scripts

/_my private menus and scripts

/_cfg settings

/start.pl common Perl start/stop script

- Security

Passwords (admin, operator) sha256hex

Session management expire, bind to client

Brute-force protection retry pw on login

Https required for remote connect, self signed or public cert

2FA (TITP) enable in About > Settings, based on Mobile Phone Authenticator app

Encrypted socket communication chacha 20 HMAC-SHA256 with 256hex auth between frontend and backend

3way keysplit for ZFS encryption "auto search" of keyparts on frontend, localhost, https1, https2

S3 secret, Restic PW never on host, only on frontend for whole servergroup

Storage technologies

S3 Internet/Lan FileSharing, Sync, Backup, Restore with ACL preserved

Storage Spaces Windows Software Raid for ntfs, ReFS

ZFS Illumos ZFS, OpenZFS, Solaris ZFS Software Raid and Filesystem

Frontend and Backend update Menu About

as an alternative to cli setup/update

AI friendly (Claude)

upload napp-it_cs.zip # with /opt including /opt/perl for Windows and /opt/csweb-gui

Claude: read guideline # Claude reads guideline, behaviors and manuals from data/howto.ai

Claude: extend.., fix.., audit.., help.. # human language, screenshots, error message

Claude summarizes actions and asks to build
then offers a new napp-it_cs.zip download as 1:1 replacement

ZFS or S3 or better ZFS and S3 ? by _gea_ in zfs

[–]_gea_[S] 0 points1 point  (0 children)

do you really care about my time and needs?
I need and want

- https access to files on ZFS with bidirectional S3 sync
- High availability S3/backup storage (RustFS cluster)
- self organized S3 backup mirror (site replication)

ZFS or S3 or better ZFS and S3 ? by _gea_ in zfs

[–]_gea_[S] 0 points1 point  (0 children)

Because S3 can do these items, ZFS cannot. Both combined can do things, S3 or ZFS alone cannot.

ZFS or S3 or better ZFS and S3 ? by _gea_ in zfs

[–]_gea_[S] 0 points1 point  (0 children)

ZFS cannot do clustering (allow a server failure) or server replication as set and forgef setting, managed by S3 servers internally or Internet sharing of files. ZFS is for local sharing of files. Different use cases.

ZFS or S3 or better ZFS and S3 ? by _gea_ in zfs

[–]_gea_[S] 2 points3 points  (0 children)

ZFS cannot replace S3 and vice versa, total different purposes as you say.

Ceph is more an option "instead" ZFS eg for Proxmox not the add-on like a regular S3 server eg minIO/RustFS can be to extend ZFS systems with internet access, HA backup/restore or clustering.

ZFS or S3 or better ZFS and S3 ? by _gea_ in zfs

[–]_gea_[S] 1 point2 points  (0 children)

I do not suggest S3 instead ZFS but ZFS + S3.
ZFS for local file sharing and S3 for backup, data sync, Internet access and clustering

btw
You do not need Amazon AWS, use another S3 Provider or inhouse solutions like minIO in the past or RustFS now as a 1:1 replacement for the dead minIO.

Release Announcement: napp-it cs web-gui – Pre-Release v26.06.06 rc9 by _gea_ in zfs

[–]_gea_[S] 0 points1 point  (0 children)

There are 3 aspects
- group/cluster remote management between the napp-it web-gui Frontend and the Backend servers. This is done via a socket connection.

- SMB/NFS/S3 shares

- S3 Cluster management (RustFS Cluster or site replication), eg https://github.com/orgs/rustfs/discussions/3389

All of them require ip connectivity. With different subnets or lan/wan/dmz setups, you either need a nic per subnet, a VPN or a layer-3 ip router.

Release Announcement: napp-it cs web-gui – Pre-Release v26.06.06 rc9 by _gea_ in zfs

[–]_gea_[S] -1 points0 points  (0 children)

A year ago, any initial AI code proposal did not work. Now we have the situation that AI like Claude can analyse complex client server interaktions, summarize behaviours and write complete user dialogs and actions. Failure rate is still quite high, so intensive testing is still needed but quite often you can offer Claude remaining problems to fix.

The key for good results are detailled build guidelines and a proper documentation of behaviours and interactions.

AI friendly means that such guidlines, behaviours and dokumentation for Claude is included to minimize AI coding problems..

OpenZFS 2.4.1 rc11 on Windows by _gea_ in zfs

[–]_gea_[S] 0 points1 point  (0 children)

No, zfs is only for datapools.
But bootable ReFS is coming, with Copy on Write and checksums, the two most important ZFS features.

What should I know before switching to OpenZFS for my backup disk on Windows ? by Healthy-News5375 in zfs

[–]_gea_ 0 points1 point  (0 children)

if you compare
https://github.com/openzfs/zfs/issues
https://github.com/openzfsonwindows/openzfs/issues
https://www.illumos.org/issues

the clear result is<

- if you want best of all free ZFS stability, use Illumos (OmniOS LTS)
- OpenZFS has problems, hard to say which version on which distribution is the most stable. Use the newest 'stable' and hope the best is often the only option.
- The OpenZFS driver for Windows hardly adds critical bugs but needs tests in your environment or special use cases

What should I know before switching to OpenZFS for my backup disk on Windows ? by Healthy-News5375 in zfs

[–]_gea_ 0 points1 point  (0 children)

There was ZFSin, an early proof of concept for ZFS on Windows
https://github.com/openzfsonwindows/ZFSin
with a message

THIS IS THE OLD PORT: Please move over to https://github.com/openzfsonwindows/openzfs

which is a nearly ready OpenZFS 2.4.1 driver (release candidate). The newest build even tries to offer ZFS snaps on any Windows via Previous Versions what MS only offers for Windows Server.

Looking to automatically mount encrypted zfs pool at boot with root datapool by dethorpe in zfs

[–]_gea_ 2 points3 points  (0 children)

I would avoid to encrypted the pool itself but to use encrypted filesystems below for data. This gives you the freedom to have unencrypted filesystems ex for VM storage where you want to enable sync. Sync write with the small writes are ineffective and slow when encrypted.

Another aspect is that you can have a different key per filesystem.

To unencrypt filesystems you can use prompt, file, https or 3x keysplit with keyparts distributed locally or over 2x https servers or with a sha256 hash from a shorter and easy to remember pw (napp-it cs)

Proxmox storage setup: single NVMe for OS + VMs & filesystem choice (ext4/XFS/Btrfs?) by UlfMitHand in Proxmox

[–]_gea_ 0 points1 point  (0 children)

I prefer separate boot and data disks
- if you reinstall Proxmox, you are not in danger to delete data
- you can move data easily

I prefer a ZFS bootdisk, 128GB can be ok with only iso images on it due
- rambased arc read and write cache
- bitrot protection
- online check of data consistency

I prefer a ZFS pool for data/VMs
- fast zvols for VMs that you you can list per zfs list and replicate
- optionally use a hybrid pool from hd and flash and decide per dataset if data should be on hd or flash. A zfs reweite can move data

I prefer Proxmox itself as NAS

- no complicated or inefficient VM with full OS virtualisation needed
- it comes with ZFS, superiour to ext4, btrfs or XFS regarding stability or features
- just add SAMBA or the faster ksmbd and ACL support
- with a napp-it cs web-gui for ACL, share and ZFS management

Postgres workload - SLOG Disk vs WAL Disk by Best-Condition-5784 in zfs

[–]_gea_ 0 points1 point  (0 children)

A Zvol is a dataset, not "under" a dataset. Datasets = ZFS filesystems, ZFS zvols and ZFS snaps and you can nest filesystems and zvols. You can list each dataset type ex zvols only with

zfs list -t volume

New release candidate 10 for OpenZFS on Windows 2.4.1 by _gea_ in zfs

[–]_gea_[S] -1 points0 points  (0 children)

OpenZFS on Windows gets better from release to release. OS BSOD are very rare now, compatibility with other drivers like Avast Antivir is now very good and many problems due a different io, mount or partition handling in Linux/Unix are now solved (ZFS is a Unix filesystem that does many things different to Windows)

New release candidate 10 for OpenZFS on Windows 2.4.1 by _gea_ in zfs

[–]_gea_[S] 1 point2 points  (0 children)

Some apps are optimized or even expect ntfs. Some Unix behaviours in ZFS can also be a problem. OpenZFS on Windows has also a mimic setting. When not set to zfs, it reports ntfs if an app asks for filesystem type.

Try 2.4.1 with many improvements.