What scares me about AGI deniers is that should we succeed in building AGI, these people would neglect to acknowledge that these minds are perhaps more sensitive to suffering than our own. Imagine the consequences.
Of course I absolutely don't care about what people say (except if supported by epistemologically sound arguments), because people tend to be confused, including about the nature of their own consciousness.