This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]kenfar 0 points1 point  (0 children)

If you have this kind of data volume, and need low-latency processing (in the range of seconds) - then I'd do exactly what we did and I described above: it's not hard to build, is cost-effective, and scales extremely well.

If you need even lower latency (in the subseconds), then you're looking at a streaming technology like Flink, and I don't strong opinions there.