There are a lot of people with a considerable amount of energy to contribute to activist/radical community that have difficulty with those kinds of situations (for example, victims of sexual assault). I certainly agree that we should all aspire to be strong as hell, but not everyone is there yet, and if we're building a movement thats going to take care of its own, we can't allow our people to be exploited, assaulted, harassed, etc, and then blame them for not saying no.
Some people take it way too far and it becomes a hindrance to everyday social interaction. This is annoying, and I'm not trying to defend it.
If you feel like you're strong enough to stand up for yourself, help those who don't. Also: white males don't always have a balanced perspective on issues of consent, privilege, class, etc, so imagine how, for example, a queer person of color would perceive the issue of consent in a society that is inherently antagonistic towards them.
All I'm saying is, if we're going to talk about solidarity with the oppressed and such, we've gotta walk the walk in everyday life. How you interact with people on an individual basis is more important than how ready you are for insurrection, or how much you hate the cops, cause without the social element, we're not too different from the other kind of libertarians.
p.s. sorry for being so wordy all the time. i get worked up.