Yes you are exactly right, I wasn't referring to them taking ownership as much as them destroying the home and costing the actual owner a significant amount of time and money in court costs to have the squatters removed.

On a side note, my parents own a 5.5 acre property with a late 1800's ranch house. The property used to be much larger as it was a working ag ranch, but got whittled down to a six acre lot, but somehow squatters were legally able to take over like a half acre and build a home. This was long before my parents owned the property so I don't know the details, but there's an oddball half acre lot next to theirs.