The world we live in...now that's a fucked up place. I actually have a theory of why sexual violence is so frequent, it involves the movies (and you're talking to someone who is normally vehemently against the idea that movies are responsible for social problems). I read a book recently, called "Against Our Will," published by an ardent feminist in the 1970s. It's somewhat dated, but it nevertheless demonstrates to a fairly convincing degree how rape and responses to it permeates any given society. Further, the stigmatization of sexual violence can express itself in, what you say, the idea that a survivor of sexual assault is somehow different. It's not the same as blaming the victim, certainly, but a person who has experienced sexual violence is somehow marked.
I have not experienced sexual assault, yet my reaction to news of it is as if someone had given me a swift kick in the gut. That and rage, anger that someone is capable of such an unspeakable and repugnant act. What does that say about the world? I don't know, but I don't like the answer. The way I see it, the prevalence of sexual violence either suggests that at least most people are inherently cruel and sadistic, or, at least most people are so immune to the general shittiness of the world that their only response is one of shock and regret.