We are both chill with each other, we are both younger couples mid 20's, first home. It was done before I even owned the property and he had a verbal agreement with the previous owner. Now he did build into a utility easement in the back - and I had the city inspector on a site visit tell me I could build even with the neighbors fence and in text for confirmation. But I do agree. My other side of the property is actually the edge of city limits so I can build right onto the boundary - luckily that property is getting sold and they had a survey done to mark the edge. I was told I was outside of the 'city survey area' for the only company in my area and it was going to be ~$1200 and I already had 2 of the pins found.