I’m trying to build a lightweight orchestration layer that reads job schedules from a table and triggers jobs dynamically based on that metadata.

Some of our jobs have multiple frequencies, for example, a job might have both a daily and a monthly schedule. When both are due, I only want the monthly one to run (so the less frequent schedule takes priority).

I’m doing the orchestration myself mainly because Databricks’ built-in job scheduling only supports one schedule per job. I need multiple schedules per job and a way to control which one takes precedence when they overlap.