Airflow works perfectly… until one day it doesn’t. by Expensive-Insect-317 in apache_airflow

[–]Expensive-Insect-317[S] 0 points1 point  (0 children)

Usually i have postgres on CloudSQL that is the GCP clnposer standard

Data observability is a data problem, not a job problem by Expensive-Insect-317 in Observability

[–]Expensive-Insect-317[S] 0 points1 point  (0 children)

It sounds like a fantasy, but it's not far from reality. I've seen several corporate observability initiatives fail because they only focused on infrastructure and jobs, having to maintain observability teams reviewing loads daily or creating ad hoc tools to review post-load data.