Operation Minaret set up in 1960s to monitor anti-Vietnam critics, branded 'disreputable if not outright illegal' by NSA itself