A Tory MP told Theresa May party activists want her to quit - but not many Conservative colleagues turned up in the Commons to see it.