Conservative grandees called on to account for their role in the Brexit campaign, after group drops its appeal against electoral misspending fine