There has been a surge in support for the anti-Brexit Lib Dems in outspoken Brexiteer Jacob Rees-Mogg's seat.