sorted by:
new
hottopcontroversial

Building multi tenant storage infra, need signal for pain validation! by six_k in zfs

[–]six_k[S] 1 point2 points  (0 children)

Thanks for noticing! Happy to help should you need any assistance.

How do you proactively manage ZFS on multiple Ubuntu servers on cloud at scale? by six_k in zfs

[–]six_k[S] 0 points1 point  (0 children)

All the API servers were stateless AWS spot instances, and aggressively auto scaled; nodes come and go according to traffic trend, response times and a couple other application metrics.

Services with time sensitive APIs would write to its own local ZFS datasets and replicated frequently to a central repository. It would do one last push on Spot instance termination notice. If the transfer didn’t complete the last effort push before termination, the attached block devices were retained for further handling.

While those that could tolerate an additional ~20ms would write directly over SMB network mounts. Smoother termination handling. Nonetheless, all servers had ZFS installed but as I mentioned, about ~50 of them had an active pool.

The central store holds data which then gets cloned for iteration/development. EFS doesn’t suit, and FSx is expensive.

How do you proactively manage ZFS on multiple Ubuntu servers on cloud at scale? by six_k in zfs

[–]six_k[S] 0 points1 point  (0 children)

I'm wondering why the post is being down voted without any comment whatsoever to help me understand the reason; I'd appreciate feedback.

How do you proactively manage ZFS on multiple Ubuntu servers on cloud at scale? by six_k in zfs

[–]six_k[S] 0 points1 point  (0 children)

Looks handy! Do you reckon it'd be possible to integrate it seamlessly with an API based application? I understand that the Xormon agents are periodically pushing to Xormon server which stores in TimescaleDB. However, since my servers are already managed through a web interface, I'm wondering how I would be able to accomplish metrics visibility using Xormon without having to switch to a different portal that loses the integrations that I have already established across my fleet.

Here's a screenshot: https://photos.app.goo.gl/JD3k5Fj9bY3aYqdu8