When their plan becomes clear, they will have no supporters. Nobody willingly accepts slavery. So it doesn't actually matter who is left. Might as well eliminate the ones who are easily eliminated. Think of an ant farm. Do you actually think of any of the ants as your supporters? There are just some that are more docile than others.

This isn't a flippant response. They really don't consider any of us to be significantly different than bugs.