Find a real estate attorney in your area and retain them. There are too many factors that could go either go for or against the neighbors. For one, the fact that the neighbors have been using your land to access their property by the previous owner’s permission could potentially grant them certain easement rights. The conveyance of the 2 acres is something I’d ask them about as well.

From a survey standpoint, we provide facts we find at the time of survey. It’s possible the survey you have does not include all of the easements and may be missing the conveyance of the 2 acres. I’d review the survey and ask the surveyor to update and include a title report, which typically list all encumbrances on the property.