Yeah that's def a worry!
Even in a decentralized system some set of people have to make the decisions; in this case it's the COMP holders, and the COMP distribution is somewhat bulky with the top few. It's sort of the central tradeoff: simplicity/speed vs decentralization