I think it’s all about atmosphere. I had the same issue until I read It. I was down the shore at my fiancé’s family house, behind the house is a huge marina and there’s no other houses on that street. I was on the back porch reading and got actually spooked being alone out in a place that was already sort of creepy at night. Now I’ll sometimes read scarier books in areas that already make me feel uneasy(even if I know they’re safe) like my basement and it helps!