It already does affect women. The hell? You boys don't live in a vacuum. You have to share the world with all sorts of other people. What happens to any one group affects, eithrt positively or negatively, everyone else.
That's what living in a society means.