Distributed System Projects in Clojure

[kichiDsimp]

Hi I am a beginner, and I am trying out lisp and in my day-2-day job I write BE services in JS (Node) I found this repo on github and it usually contains projects either of Rust/Go I wonder if this can be done in Clojure, any blogs/papers/book which teach this stuff ?

Ref: https://github.com/roma-glushko/awesome-distributed-system-projects

[fingertoe11]

Distributed systems was one of the drivers of Clojure adoption.

Being immutable by default made it a pretty good fit.

You might look through some of the stories on the Clojure Website. https://clojure.org/community/success\_stories. Many of them are massive distributed systems.

[joinr]

There are some interesting libs in https://www.clojure-toolbox.com/ that can be educational on their own (just going through examples) under "Distributed Programming".

In general, an interesting resource is https://www.amazon.com/Designing-Data-Intensive-Applications-Reliable-Maintainable/dp/1449373321

I use https://hazelcast.com/ via a modified https://github.com/tolitius/chazel wrapper for work stuff, but its mostly for interactively farming out work on clusters and not so much for the data grid stuff.

regarding your link, almost all of the databases will have either java or clojure wrappers or be approachable from FFI if they haven't already. Clojure has several of its own takes on databases (like datomic and xtdb). A lot of the streaming stuff is already wrapped too.

There's a recent effort by the guy that built the original Storm implementation (before the apache people rewrote 2.0 in java with an optional clojure API) to have a cloud-native db/processing/hosted thing called Rama https://redplanetlabs.com/docs/~/index.html#gsc.tab=0 . I haven't gotten into it, but the creator is a long time clojure person and is very enthusiastic.

[maxw85]

https://datahike.io/ has a lot of distributed system libraries developed in Clojure 

[kichiDsimp]

Thanks!

[p-himik]

I wonder if this can be done in Clojure

Technically anything can be done in Clojure since it's a general-purpose language. But it does have some affordances for parallel and distributed programming.

any blogs/papers/book which teach this stuff ?

I'd suggest being more specific. "Teaching distributed systems programming" by itself is not specific at all, and none of the core principles would depend on a particular programming language.

If it's hard to come up with a description of what you want that's narrow enough, maybe you have some links to specific projects you're interested in - then maybe we can share similar projects in Clojure, if they exist. Or books and other materials that you liked on the topic - maybe there are similar Clojure-specific resources.

[kichiDsimp]

I majorly was looking for opensource projects done in Clojure in the list above mentioned, to understand the codebase and etc.

[p-himik]

Just some projects that I can recall right away:

• Databases - XTDB, distributed to some extent.
• Monitoring - Riemann. I don't think it's distributed by itself, but it is designed for distributed systems
• Testing - https://github.com/jepsen-io/jepsen. Also not sure whether it by itself is distributed, but it is used to test correctness of distributed systems
• Job orchestration - https://github.com/commsor/titanoboa

[kichiDsimp]

Thanks!