It sounds like your neighbors are trying to intimidate or bully you. If there was some sort of “easement” across your property it would have been mentioned in the purchase ...