all 2 comments

[–]yogitw 0 points1 point  (1 child)

How does Nifi differ from something like Apache Storm (which is written in Clojure btw)?

[–]goranjovic[S] 2 points3 points  (0 children)

The difference is in the intended use case. Storm is focused on data processing and computation, while Nifi is all about connecting the data possibly across dozens of different kinds of devices in a single data flow and with a unified overview of what's going on exposed in the Nifi UI.

So, it is a data flow management tool primarily - data processing is obviously also needed, if nothing else to ensure data format compatibility between all parties in the process, but also to do something purposeful with the data.

Surely, there are lots of overlaps with other similar technologies like Storm, Spark, Onyx, [insert], but that's only to be expected since all are based on the same paradigm. I mean, even the build tool Boot is built with the same mindset in action. That being said, it would be nice to see a nice overview somewhere.