The Tory peer says the "real punch-up" over Brexit will begin if Boris Johnson gets his deal through Parliament.