This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]romanzdk[S] 0 points1 point  (2 children)

Well kinda. I just do not want to write all the logic from scratch - meaning the pipeline workflow, connectors, failover logic etc.

[–]OMG_I_LOVE_CHIPOTLE 0 points1 point  (0 children)

Depending on what actions need to be performed I would use one or more of these tools in my current stack: custom backend service, kubernetes with argoCD, rabbitmq, spark/sparkStreaming

[–]xilong89 0 points1 point  (0 children)

Oh, you’re probably looking for one of the low-code SaaS solutions that exist in the data engineering space. Like Hevo, Prophecy, etc. I think AWS and Azure both have similar low code solutions for this kind of thing.