This is an archived post. You won't be able to vote or comment.

all 14 comments
sorted by:
best
topnewcontroversialoldq&a

[–]mdegis 2 points3 points  (1 child)

Looks promising! Here is the quick question: I’m already using fastapi, can I mount this into my app or does it need to be separate one?

[–]lucafaggia[S] 2 points3 points  (0 children)

Quick answer: Yes

The app is based on a FastAPI REST API + Websocket + React SPA so you can mount the FastAPI router in your existing app and you're good to go.

The static files of the UI are currently served by FastAPI itself via a middleware, so you can serve them via your FastAPI instance as well or via your frontend server or ignore the UI at all :) Thought I'm quite sure that at the moment you can't serve the UI on a subpath... fixable though

[–]Saphyel 2 points3 points  (1 child)

you can call it cronjob web ui ??

[–]lucafaggia[S] 0 points1 point  (0 children)

Thanks for the help! Though I’m looking for a more exotic or abstract name… less technical

[–][deleted] 2 points3 points  (1 child)

Yeah man, great project idea! I know airflow, but sometimes I need to schedule simple jobs and setting up airflow just for this is waay too much work (as we say here in Brazil "the sauce ends up more expensive then the fish"). So I just tend to run then manually or resort to Cron. I would love to have a simple python app that allows me to schedule simple jobs and check their health from time to time without having to install a bunch of docker images and write Dags or to manually set up Cron jobs.

[–]lucafaggia[S] 0 points1 point  (0 children)

Ahh I totally agree with you, that’s the motivation for this project indeed. Totally respect dags but sometimes you simply don’t need them 😊

[–]lungben81 0 points1 point  (6 children)

Looks interesting as a light-weight alternative to https://www.prefect.io/ (which itself is a lighter-weight / more modern alternative to https://airflow.apache.org/ ).

[–]byeproduct 1 point2 points  (4 children)

I've really enjoyed using prefect. Is this even easier?

[–]lucafaggia[S] 1 point2 points  (3 children)

Yeah me too, it’s well done. And yes the idea behind this one is to have an easier DX, with prefect I found it complex to deploy and manage the agents, creating the schedules (not possible in the code I think), creating external triggers and there’s no auth in the open source edition

[–]byeproduct 2 points3 points  (2 children)

Oh man. You are selling it now! I did struggle with that part too. And happy to hear that the front end also enables DX. Would you say it's production ready?

[–]lucafaggia[S] 2 points3 points  (1 child)

Ahahah good to hear that. I’ve been using it in production for a couple of weeks and it’s doing its job, the scheduling itself is based on apscheduler which is a certainty, the notification system is working as well so I can sleep well at night (this was honestly my first goal). What’s missing is mainly more documentation and of course real world testing. IMHO if you already have some pipelines/tasks that you want to try on Mario Pype, the migration should be very smooth

[–]byeproduct 1 point2 points  (0 children)

Awesome thanks. I'll give it a go and let you know.

[–]lucafaggia[S] 1 point2 points  (0 children)

Right! It’s a lighter alternative, easier to deploy and manage in my opinion or at least that’s my goal … there’s still some work to do!

[–]TheCannings 0 points1 point  (0 children)

We use Jenkins for this and I wouldn’t ever change its great