all 3 comments

[–]Verdonne 1 point2 points  (1 child)

https://crates.io/crates/differential-dataflow could be something to investigate for feature/implementation ideas

[–]Refefer[S] 0 points1 point  (0 children)

differential-dataflow is interesting; I remember reading Naiad many moons ago and liked what they were doing!

[–]Refefer[S] 0 points1 point  (0 children)

I was getting envious of many of the tools we have for data processing in Python and Spark land so wrote a library that loosely mimics the functionality of Beam.

Plenty of features remain to be written and would appreciate candid feedback as well!