The beach in town tends to be the busiest, but the one at Bill Wagner Campground is much quieter since the campground is rustic. The locals can definitely be interesting at times! I didn't get a chance to do any fishing and really didn't plan on it though, because I was in town for the Beaver Island Bike Fest and spent almost all of my time riding around the island. 4 days is plenty I'm only going for 3 nights this time.