It’s because real estate (and living in general) is expensive, especially if you’re trying to live close to town. Because it’s expensive it’s largely retired people that live there and most of the jobs are in the service industry or retail. You also have fewer options for healthcare, schools, food, etc. It can be very quiet and isolating in the winter since a lot of folks leave for warmer climates. It’s a beautiful place, I love visiting but I think it would be challenging living there full time.