Countries outside of the EU want Britain and Brussels to "get on with" Brexit in order to begin striking free trade deals with the UK, the Trade Secretary has said.