You're just plain wrong. I've seen men yelled at for asking politely in "acceptable" social situations.
You can pretend it's not happening, but that doesn't change the fact that it occurs regularly.
The problem isn't that No isn't being respected, it's that women are getting offended at even being asked.
Men are more and more frequently getting in trouble for even just asking, which means they need to stop entirely or risk getting in trouble.
Either women take responsibility for asking the men out, or accept that they're not going to get asked out except by assholes who ignore the risks and are statistically upsetting a lot of women before they succeed.