Ehhh, that might be true, but it also still sounds iffy. "Everyone is equally unethical, but this particular group won out and got to display their lack of ethics because of [characteristic]"
When you take that to its logical conclusion, you end up believing that, if, say, black people were in power, they'd stack the deck in favor of black people, and women would stack the deck in favor of women, for example. Is that prejudice, or is that just human nature? It's a bleak outlook, regardless.
Or maybe it's an argument for forced diversity, where you need people with conflicting interests to constantly make compromises, lest their inherent tribalism take over...