The Speaker can never again be allowed to 'bend the rules as they wish' like John Bercow, a Cabinet minister has told MailOnline.