Party leader has stressed benefits of immigration, but some fear policy could hurt Labour in Tory seats