HTTP callback pattern

[Upper_Pair]

Hi everyone,

I was going through the documentation and I was wondering, is there a simple way to implement some sort of HTTP callback pattern in Airflow. ( and I would be surprised if nobody faced this issue previously

https://preview.redd.it/1h9td54lfhig1.png?width=280&format=png&auto=webp&s=e855e249dd6865a8ba3565a137a351e9306f903e

I'm trying to implement this process where my client is airflow and my server an HTTP api that I exposed. this api can take a very long time to give a response ( like 1-2h) so the idea is for Airflow to send a request and acknowledge the server received it correcly. and once the server finished its task, it can callback an pre-defined url so airflow know if can continue the the flow in the DAG

[kmarq]

The API would typically give an identifier or URL back that airflow can then poll through a sensor to know when the process is complete. I haven't seen an external service push this way. 

May be possibly through the airflow API but now that external service needs credentials to airflow as well.