He’s made a hard Brexit much more likely. Remainers have to work together, says Guardian columnist Polly Toynbee