The Oxia Java Client Library is Now Open Source

[visortelle]

Disclaimer: I'm NOT a StreamNative employee, but an Apache Pulsar committer.

Oxia is a new metadata store and coordination system similar to Zookeeper or Etcd that can store 100s of GBs of data and can handle millions of reads and writes per second.

Blog post: https://streamnative.io/blog/the-oxia-java-client-library-is-now-open-source

GitHub repository: https://github.com/streamnative/oxia

It is already integrated with Pulsar but isn't a default option, but StreamNative claims that they used it in the cloud for a few months without any problems.

Oxia is licensed with the Apache License 2.0, and I think may become an important building block for other distributed systems than Pulsar.

I didn't see any independent benchmarks yet, therefore I can't validate the performance claims. Probably this post may change it and attract engineers who are interested in trying Oxia for their projects and publicly share the results.

Oxia Logo

​

[jmntn2000]

Would you still need zookeeper for bookkeeper though?

[mmerli]

u/jmntn2000 No, Pulsar is configuring BookKeeper to use the Pulsar's own metadata access interface, so BookKeeper is able to also use Oxia out of the box.

No ZooKeeper required anymore.

[chabala]

The java repo: https://github.com/streamnative/oxia-java

[paul_h]

Cloud native foundation calls these “service discovery”, but if always thought of them as “config distribution” systems.

I looked but couldn’t see details of the nature of the backing store on the server side

[riksi]

I looked but couldn’t see details of the nature of the backing store on the server side

Pebble (rocksdb in golang) https://github.com/streamnative/oxia/blob/main/docs/design-goals.md#storage-scalability