Voters often change their view of politics during their long days off. That's made the optics of Scott Morrison's early break even more tricky.