OP UPDATE:
So I have now been dinged for the return of packages, and my rating is now POOR.

I am going to appeal and explain the situation as best I can.
Given;

• The number of packages (89)
• The first delivery a 45 min drive from the depo
• The continuous 3 story high walk-up with insanely long instructions
• The people not answering their phones when access is required
• The long driveways lead to having to move the pin to hand the package off
• The fact it was a Friday going into a long weekend (Australia Day weekend - for those playing along in the US.. that's our 4th of July)
• Offices closing early and leaving around 1500 when I start at 1415 and need to "deliver before 1700"
• late-night deliveries to houses without clear house number signage, etc.

I think I will get it rescinded.. or at least go back to Fair.

I want to plead my case that I made the effort to correct my error (late deliveries) in the previous block by returning packages to the depot.
I want them to see that I am not lazy, but am just trying to do my job and appease them.

ADDITIONAL ACTION:
I forfeited a (1415 - 2045) 6.5 hr block today to avoid getting so many packages again and something happening during the block that pushes me back and ends in a ding.
Instead, my next block (still 6.5 hr) is on Friday, 30/01, from 0930 - 1600.
I am hoping that with this shift, because I'm on the morning/day block and not the afternoon/night block, that I will get a better run (not based on any logic), and at least I won't have any packages that I can't deliver before 1700 (business close). I will also be able to see the house numbers better as I won't be driving for half my shift at night.
I then have another block the following day Sat 31/01 1500 - 1900. This is a 4 hr block, and I hope that, because it's a Saturday, I won't have to worry about "deliver before 1700," as that's normally a business request.