A median of 45% say fewer or no immigrants should be allowed to move to their country, even as people in many countries worry about people leaving to find jobs elsewhere.