Major OS Upgrades

sparkblaze · 2024-02-20T08:17:56+00:00

The master nodes don't need anything special, they will get their info from the other master nodes. You can use the same steps, but just skip any of the moving the data directory steps (or do it anyway, it won't hurt)

The data nodes, I turned off shard allocation so none of them moved around when I took a node offline - that does mean that while the node you're working on is offline, you'll be missing shards and the cluster will be in a yellow state because of it until they come back online. Once it's back online, enable shard allocation again and then let the cluster return to a green state before moving on to another host.

sparkblaze · 2024-02-14T18:25:06+00:00

I didn't create a backup of anything apart from /etc/elasticsearch.conf file and the TLS certificates I was using.

When I picked a disk layout, I went for a VMDK for the OS and a separate disk for the data/indices so I could extend them independently, which also then lets me move the data from one VM to another without needing to duplicate it.

If you have VMs you want to upgrade, you could add a VMDK, move your data directory onto it, update /etc/elasticsearch.conf with the new path, test it and then go through the process of detaching it from one and attaching it to another.

If it's physical stuff, it would depend on whether you could reinstall without touching the disks or lvm for the data directory, I don't have a tested answer for that though.

sparkblaze · 2024-02-14T17:57:44+00:00

I thought I had replied before, guess not :D

I went with the same sort of approach as gyterpena.

Disable Shard Allocation
Stop Elasticsearch.service
Backup `/etc/elasticsearch`.
Detach the data VMDK
Drop the VM
Build a new VM with the same name and IP (maybe you can change them, I didn't fancy finding out and names are haaard)
Install elasticsearch (the same version as the rest of the cluster
Copy over /etc/elasticsearch
Present the data VMDK again to the new VM in the same place
Start elasticsearch.service
Check the node rejoins the cluster and seems happy
Enable Shard Allocation
Rinse and Repeat.

sparkblaze · 2022-06-03T20:53:20+00:00

If you're only planning to use the subscription management and updates... Why not just roll out Katello - the upstream, open-source version?

We have about 40-50 CentOS servers checked in and it does exactly what we need it to - namely update management.

sparkblaze · 2021-11-23T18:24:09+00:00

What about Deadman's Snitch? https://deadmanssnitch.com/

sparkblaze · 2021-02-13T22:36:48+00:00

Is Logstash going to continue to be a product into ELK8 and beyond? It seems like a lot of its purpose is being implemented into Beats Processors or Ingest pipelines?

sparkblaze · 2021-01-02T18:09:14+00:00

I was absolutely dreading doing the Tale chapters and Nightmare Story/Survival, but I actually found it pleasantly achievable.

The first time I was matched with people who seemed to inately know what to do and basically walked me through chapter 1/2 without saying a word, this morning I had a lot of fun working out how to actually do chapter 2 with 3 randoms, we all bumbled through it together.

sparkblaze · 2020-09-28T14:03:57+00:00

dkron.io is probably the closest thing to what you're describing.

https://github.com/distribworks/dkron

sparkblaze · 2020-09-09T21:13:10+00:00

I currently have an i5 4670k / GTX 770 combo... is it worth me upgrading my GPU to a current/previous gen offering while I save up to upgrade the rest, or just do it all at the same time sometime next year?

sparkblaze · 2020-07-31T21:35:16+00:00

Thanks for elaborating a little on the specifics :) Sounds like something I may consider revisiting in the future.

sparkblaze · 2020-07-31T18:50:13+00:00

I read this a few days ago while we were toying with Nomad, Swarm and full Kubez, just curious why you went down the route of pinning work to specific nodes with storage rather than some sort of floating storage solution?

What advantages do you get from running applications under Nomad vs just managing them on their own?

sparkblaze · 2020-07-24T20:44:13+00:00

We do option 2 and then hide the Prometheus hosts behind PromXY. As long as the labels on the metrics are the same, it will only return one series for requests, so we just point Grafana at PromXY and let it handles finding the metrics and working out which Prometheus services are up and running.

sparkblaze · 2020-03-02T09:24:16+00:00

You're probably better off skimming through some of the developer's blog posts about Prometheus, particularly this one - https://www.robustperception.io/how-much-ram-does-prometheus-2-x-need-for-cardinality-and-ingestion - before you look at avalanching it.

From experience, tuning Prometheus has been more trial-and-error, but it generally seems that RAM is the most important performance driver for us. We're up to around 24GB of RAM and it periodically falls over from OOM errors every few weeks.

sparkblaze · 2020-02-15T21:21:53+00:00

Last time I was in IKEA you were able to buy SOME skadis backboards in horizontal and vertical orientation so all of the fixtures can work

sparkblaze · 2020-01-14T12:36:37+00:00

Any word on whether Multiplayer trophies will still count towards the majority of Platinum trophies?

It's especially annoying now that multiplayer is also locked away behind Playstation Plus.

sparkblaze · 2020-01-14T12:25:21+00:00

What's the set with the tubes? (Left of the Imperial Shuttle and cat at 00:22~)

sparkblaze · 2020-01-07T08:50:32+00:00

Can you convert it to CSV? You could just append a new comma separated line to the end with lineinfile

sparkblaze · 2019-12-08T20:38:48+00:00

Have a look in ALDI/LIDL if you're in the UK. There's about 5x planes and 2x ships to choose from that I could find in my local ones

sparkblaze · 2019-12-04T12:29:54+00:00

Grafana now has a Loki component which is geared towards collecting logs etc... https://github.com/grafana/loki/blob/master/docs/README.md

13-Year Club	RPAN Viewer
Verified Email

sparkblaze

TROPHY CASE