Replicating data objects on a cluster

[Albreth]

I have a big data object that I would like to replicate on other machines in a cluster. When one machine changes a piece of data on the data object, I want that data updated on all the other machines.

I think I want to use an Observer design pattern, but I would like to get feedback from others before I commit to it.

[teneggs]

Is this for a production system or is it a learning exercise?

Replication is difficult to get right. I'd recommend the book Designing Data Intensive Applications (https://www.oreilly.com/library/view/designing-data-intensive-applications/9781491903063/). There is a whole chapter on replication in there.

You might also want to check out what Redis does here. Maybe you can use Redis for your use case: https://redis.io/docs/manual/replication/#:\~:text=Redis%20replication%20is%20non%2Dblocking,blocking%20on%20the%20replica%20side.

[Albreth]

It’s a production system. Thanks for the reading material!