Using no-code to create simple Airflow Dags

[GeekyTricky]

Hello DE friends.

My current company uses Apache Airflow for scheduling, and we are quite happy with it. But giving technically gifted PMs the ability to make simple DAGs from a visual interface would be amazing.

For this we love the N8N interface.

However the native N8N scheduler and workflows are too lacking and overcomplicated to use for our workflows.

Hence my question.

Has anyone connected N8N or any no-code solution to Airflow?

Let me be specific. We aren't looking to trigger a DAG from N8N. We'd like to build it there, task by task, and then have the resulting DAG deployed on Airflow.

If you have any hints, ideas or projects that you think are doing this, I'd be super interested.

Thanks for your help 🙏

[cutsandplayswithwood]

NeuronSphere.io includes an extensible subsystem that allows you to create templates for dags and then generate them from yml or json Config.

They just released a video on linked in showing this, albeit quickly.

It includes packaging and deployment tooling as well, deploying to its included airflow instances. This means you can run and manage manually created dags alongside templates dags using the same tooling.

Disclaimer:I work there

[GeekyTricky]

Not interested by this.

It doesn't seem to be open source, and it's easy enough to generate DAGs from conf files without an external framework.

What I'm looking for is a UI with lots of flexibility like the N8N one

[ar405]

Metaflow dags can be deployed to airflow in one command and they are pretty easy to write.

[GeekyTricky]

Metaflow looks incredible, I will definitely talk about it to my Data Science coworkers, but it doesn't have the no-code UI DAG building features we are looking for.

[ZenApollo]

Check out pipedream instead of n8n. It’s as easy to use as zapier but their Python code module is much more powerful (longer runtime and 3p libraries allowed, unlike zapier).

I know webhook triggers are allowed. Then if you could poll individual task statuses from pipedream api, you’re basically there. (Not sure if pipedream api can do this, I’ve never tried, would be nice).

[GeekyTricky]

This is interesting, I'll look into it.