The Shadow Chancellor Sajid Javid told the BBC that "we have to accept we won't be able to leave on 31 October."