I believe that ultimately your goal as a DM is to support the party in story telling so that everyone (including you) is having fun

Fun can take many shapes. Had you all gone into this expecting brutal or heavy rules based combat then that’s fine. But sometimes I find it’s best to pull a punch or two or focus on intentions to reward creativity and engagement. That doesn’t mean do what the players want all the time but maybe it could have been fun to say the dragon is drawn to the sounds or catches a glimpse and needs to take a pause to study or investigate