In NY it's 500 feet minimum, unless you have your neighbor's permission. Just make sure your shots can not cross a roadway, I recomend a good backstop set up in the most remote direction on your property, and talking with the neighbors and local LEOs first. Local laws may be different, so check FIRST. This should seriously lessen any future problems.
Is it better to do the right thing for the wrong reason, or to do the wrong thing for the right reason? If you do the wrong thing for the right reason, is it still the wrong thing?
Si vis pacem para bellum.
There are two ways of doing something. Right and again.