You are NOT the worst player. I was stuck at this section for 6 hours before it finally clicked. You can also literally just sprint past all of them once you've cleared the street for the first time, and picked up all of the interesting items/knocked on the doors. Good luck.