Even if SGX was a proper secure element rather than a TEE, they should only be used as an additional layer of security rather than the basis for a protocol and a single point of failure. Features like hardware keystores don't work well as execution modes on a general purpose CPU.