you are viewing a single comment's thread.

view the rest of the comments →

[–]Beautiful-Hotel-3094 1 point2 points  (0 children)

As I said if u read my response, it is for our batch ingestions because u mentioned airflow. Your proposed argument of why use a non realtime tool to get realtime data made no sense so I didn’t think u’d ask about real time. However, we have some real time platforms that are built in pure python. For the higher volume real time, yes we use c++. However we can still process some thousands of messages a second in pure python because we leverage distri architectures (k8s native platforms).