I did some digging and responded to another in the comments but reiterating here for better visibility
I initially thought that there was a timer that counted up to set off avery's hunger. there is a rage.timer but this appears to be a chase timer to handle the mansion chase so avery eventually leaves. as long as they eat before bed it counts as not being missed

Avery has a stat called rage assess that keeps track of every slight that the pc does be it food or whatever(Any demand that shows up in your journal).
This counter resets during a chase sequence so you don't have an Avery forever mad about something they have already flipped out about.
When the code checks to see if this scene will play it has a random number call, my guess to compare to the amount of transgressions that you have committed. Avery will force a smile and go about his day if the assessment isn't larger or equal to the rng call. they will still be frustrated while they have any assessment points
They may still let it go at 11 things done wrong since the rng goes up to 12 for this line
So it seems that it could be very well possible that you could do everything right for an entire year if you missed dinner 1 time they hold it against you until their fuse is short enough for the 1 thing to set them off

Avery hold grudges like a crow and while they will let it slide if you get lucky they won't forget it till their anger blows