Fair enough. The difference is only that his primary teaching (what to do about the problem of suffering) was marketed as being applicable without having to believe in anything or perform any rituals.
Whether (early) Buddhism can be considered a religion in the usual sense of the term is a whole separate debate that has been going on ever since the West discovered it, and is ultimately one of semantics. I don't think it's a very important one, either.