A quarter of the new builds would be affordable homes but people living nearby are worried about the extra traffic