Former home affairs minister Malusi Gigaba will not be let off the hook despite tendering his resignation from President Cyril Ramaphosa's Cabinet.