This truly isn't so horrible in some places. Build slightly outside a town of 3000 in the midwest and see where you get. So long as you aren't taking away farmland, you'll usually get your permission.