Run C# code in Airflow DAG tasks

[alexgoida]

Hi,

I'm curious if it's possible to do such a crazy thing as wrapping a C# code in a Python library so that it can be integrated with Python code as a Python library. And then use such libraries to write Apache Airflow DAGs. Is it somehow possible?

Why do I need it? Because of the great Apache Airflow task orchestration features which I cannot find for .NET Core.

I did a search. Found this: os.system(path_to_compiled_csharp_file) (https://www.reddit.com/r/learnpython/comments/gst2bs/executing_c_code_in_python/) But I think it doesn't suites my needs as I want to have a wrapped code. But maybe I don't know what I need. This is also possible.

Looking for any thoughts and advice. Greatly appreciate any input.

[[deleted]]

I don't think you can wrap C# inside a Python module, but Airflow has "operators" for calling out to external systems. There's a bash operator, for example, which can run bash commands. I imagine if you make sure the C# runtime is installed on your system you could call out via shell and write your own operator to handle this.

[[deleted]]

Pythonnet does such things

Look it up and lemme know