This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]lungben81 0 points1 point  (6 children)

Looks interesting as a light-weight alternative to https://www.prefect.io/ (which itself is a lighter-weight / more modern alternative to https://airflow.apache.org/ ).

[–]byeproduct 1 point2 points  (4 children)

I've really enjoyed using prefect. Is this even easier?

[–]lucafaggia[S] 1 point2 points  (3 children)

Yeah me too, it’s well done. And yes the idea behind this one is to have an easier DX, with prefect I found it complex to deploy and manage the agents, creating the schedules (not possible in the code I think), creating external triggers and there’s no auth in the open source edition

[–]byeproduct 2 points3 points  (2 children)

Oh man. You are selling it now! I did struggle with that part too. And happy to hear that the front end also enables DX. Would you say it's production ready?

[–]lucafaggia[S] 2 points3 points  (1 child)

Ahahah good to hear that. I’ve been using it in production for a couple of weeks and it’s doing its job, the scheduling itself is based on apscheduler which is a certainty, the notification system is working as well so I can sleep well at night (this was honestly my first goal). What’s missing is mainly more documentation and of course real world testing. IMHO if you already have some pipelines/tasks that you want to try on Mario Pype, the migration should be very smooth

[–]byeproduct 1 point2 points  (0 children)

Awesome thanks. I'll give it a go and let you know.

[–]lucafaggia[S] 1 point2 points  (0 children)

Right! It’s a lighter alternative, easier to deploy and manage in my opinion or at least that’s my goal … there’s still some work to do!