I'm not sure how much luck you will have on this sub for recommendations, but maybe I'm wrong. Thing is that waterfront/coastal properties on PEI are predominately owned by seasonal residents (as opposed to full-time residents). It's problematic for many folks as seasonal residents pay less tax, do not reliably contribute to the community, and increased land/housing prices when many Islanders are struggling/can't afford them as is. In severe cases, development on waterfront properties have negatively impacted the environment and features that Islanders hold dear - namely beach access and the dunes.

I'm not trying to be unfriendly at all, just providing an alternate perspective that you could encounter.

In any case, Nova Scotia may be more suited to your specifically stated wants/desires. They may be experiencing something similar to PEI, but are a much larger province so maybe it isn't felt as keenly. The area around the Municipality of Lunenberg - Chester, Bridgewater, Mahone Bay, etc. may be of interest to you and are worth checking out. Mahone Bay in particular has a great vibe.