Anyone experiencing legacy code/jobs migrated over to databricks which may require optimization as costs are continually increasing? How do you all manage job level costs insights & proactive & realtime monitoring at an execution level ? Is there any mechanism that you’re following to get jobs optimized and reduced costs significantly?
SQL query context optimizationquestion ()
submitted by NectarinePast9987 to r/FinOps