In a frank interview, the Prime Minister, who refused to do head to head debates complains there wasn't enough 'coming together for debates' in the campaign