The duke says his association with convicted sex offender Jeffrey Epstein has “become a major disruption to my family's work”.