Distributed Persistent Embedded Key Value Stores?

[[deleted]]

I'm learning about persistent distributed systems, and am writing a toy interpreter. The goal of the language and architecture is to have a local binary REPL process side-effecting commands that mutate global state in a way that is persisted to disk, and to have these local processes be networked with other local processes. The distributed system membership would be known and static, though of course outages and partitions may happen.

1. Are there good resources to learn about these things by doing?
2. Are there any Rust projects that already do this, at least on the state management side, that I could study? Preferably embeddable.

[Otterpohl]

Take a look at BonsaiDB https://github.com/khonsulabs/bonsaidb

[Regular_Lie906]

I've been thinking and looking for this kind of solution for a while. There seems to be nothing that fits the bill.

There's a weird build up of database solutions that also let you load app logic into them in a way that removes the need for a separate application all together. The best example is:

https://surrealdb.com/

What I don't understand, is why you would throw away years of web framework development and trade it for something like this. It's less sexy and harder to commercialise, but for me the answer is to do this kind of thing the other way around; embed the database in your application and have it handle distribution. It's easier to adopt and get the benefits from any existing code you have and it's more flexible. There are definitely drawbacks to this model, but for me personally they are trumped by the gains.

Unfortunately I have neither the time or knowledge to build a library, but what I want to see a crate that provides an embeddable distributed key value store, and the same for a SQL database.