I worry about this type of stuff all the time. I just started buying my own home. It just happens to be on a hill with about 7 other houses, all but mine and one other is abandoned. I see anyone out there fucking around, I am on them like flies on shit.
It also helps that I know most anyone who is 'supposed' to be nosing around.
As much as I would like to see these houses burned to the ground and burried, it would suck cause I live so close. like a few feet
