The Remain and Leave camps agreed on little during the 2016 referendum, but they did agree on two fundamental points.