It's because it's not actually about any other characteristic than being a woman. One saying I've heard is that "women have to work twice as hard as a man and for half the benefit."
I've heard added on for Black women, though I imagine it applies to many groups too to some degree, "A black woman has to work ten times as hard for a tenth the benefit."