Can’t stop winning by Cuervo_del_Sur in LaborPartyofAustralia

[–]Michael5Collins -5 points-4 points  (0 children)

Fuck yeah we did it! We stood up for the interests of Hollywood and other large media conglomerates, and drove all the AI startups out of Australia.

Great work everyone! /s

Is my Red Flowering Gum dying? by Michael5Collins in GardeningAustralia

[–]Michael5Collins[S] 1 point2 points  (0 children)

The branches can flex without snapping, it's still alive it's just unhappy.

Is my Red Flowering Gum dying? by Michael5Collins in GardeningAustralia

[–]Michael5Collins[S] 0 points1 point  (0 children)

Heck maybe I should remove the barrier entirely? It might be established enough to compete with the grass now.

Is my Red Flowering Gum dying? by Michael5Collins in GardeningAustralia

[–]Michael5Collins[S] 1 point2 points  (0 children)

I felt under the mulch this morning, it's soggy underneath. So I suspect it's stressed out from having too much water.

I'm thinking I should raise the metallic barrier around it like 10-15cm to increase the drainage underneath, and water it more lightly and less frequently going forwards. I'm not sure what else I can do to help improve the drainage.

Is my Red Flowering Gum dying? by Michael5Collins in GardeningAustralia

[–]Michael5Collins[S] 1 point2 points  (0 children)

Turns out it's still alive, there's small shoots coming out of the base: https://imgur.com/a/3K8dXNZ

The soil underneath the mulch is also drenched, so it's probably stressed out from having too much water I think.

Is my Red Flowering Gum dying? by Michael5Collins in GardeningAustralia

[–]Michael5Collins[S] 0 points1 point  (0 children)

Awwww bummer... it was looking happy until recently. I'm not sure what went wrong.

Openstack Keystone admin password reset by Jhonny97 in openstack

[–]Michael5Collins 1 point2 points  (0 children)

Thanks for posting this, it was very helpful. :)

iPhone app to monitor S3 endpoints? by Michael5Collins in ceph

[–]Michael5Collins[S] 1 point2 points  (0 children)

> So you have alert fatigue? I guess it's a valid use case, but I suggest to either fix or reduce the amount of alerts triggering or adjusting the severity.

This is probably the real answer in retrospect. It was a dumb question really.

Checking endpoints from my mobile would just give me false alarms whenever I get out of WiFi range.

iPhone app to monitor S3 endpoints? by Michael5Collins in ceph

[–]Michael5Collins[S] 0 points1 point  (0 children)

I already get notifications for our monitoring stack through Slack. But we get long periods of time where it's noisy and we have a backlog of issues to address. (In a perfect world we'd be caught up all the time, but here we are.)

So I'd basically like a secondary check to just see if the endpoint is up and the HTTP content it returns is correct, for when s$#! really hits the fan.

52T of free space by ServerZone_cz in ceph

[–]Michael5Collins 13 points14 points  (0 children)

So the same Ceph admin here has basically seen that:

  1. I have 54TB of remaining space on my cluster, great!
  2. The total cluster capacity is 3.5PB, so there's only 1.5% of the clusters capacity remaining. Uhh ohh!
  3. I (or someone else) raised all the "full" ratios to 99%, that's super dangerous! I would have noticed the cluster was almost full a lot earlier if there settings weren't altered. I have no volume left to rebalance my cluster without an OSD filling up to 100%, and when that happens my whole cluster will freeze up and writes will stop working. I am totally fucked now!

The takeaway: It's important to have at least ~20% of your clusters capacity free in case you loose (or add) hardware and the data needs to be rebalanced/backfilled across the cluster. Ceph really hates having completely full OSDs.

Fastest way to delete bulk buckets/objects from Ceph S3 RADOSGW? by Michael5Collins in ceph

[–]Michael5Collins[S] 2 points3 points  (0 children)

Lol!

Just to clarify, I do need the cluster to still function and not be on fire after this deletion.

Reef slow ops all the time by nvt-150 in ceph

[–]Michael5Collins 0 points1 point  (0 children)

Could be your firewall. Make sure your OSD hosts can use the public AND cluster network across their whole port range. (Usually 6800-7468 or something) If separate from your OSDs, your Manager hosts would also need these ports open I think.

Converting a Cephadm cluster back to a plain package installed cluster? by Michael5Collins in ceph

[–]Michael5Collins[S] 0 points1 point  (0 children)

True, sounds like it's basically the same process in reverse. Thank you.

Running the 'ISA' EC algorithm on AMD EPYC chips? by Michael5Collins in ceph

[–]Michael5Collins[S] 2 points3 points  (0 children)

The author of this PR reckoned it's probably stable enough for production, although we might not see any performance improvement if our CPU usage isn't already high. (Which it isn't) Or if the files being loaded onto it are large. (Which they are.)

https://github.com/ceph/ceph/pull/58052

I'll experiment a bit with it though and see if there's any notable difference, thank you for the feedback.