I think men are just wary of being seen as creeps. At a recent job search lecture at my uni we were told to never have a picture on your CV, with this as example of how it goes wrong: "Let's say you're a beautiful woman and you send a company your CV with pic on it. Now, the reviewer of your CV is male and if he asks you in for an interview the other employees at the company might suggest he did it because of the way you look. The reviewer will avoid this awkward situation by throwing your CV in the trash. Do not have a picture on your CV."
Basically, the expectations of a modern man's sexuality are pretty fucked up and contradictory and most prefer to avoid the entire thing in public.
Especially so with something as big and public as backing or working with a sex toy company. No matter what way you go with it, somebody's going to try to jump down your throat. Often several different groups, for contradictory reasons. Is it any wonder that most men, and anybody whose job involves making sure your company isn't the target of a negative media frenzy, doesn't want to touch this stuff with a 10-foot pole?
Since a lot of people wont touch sex (or tobacco, oil, military, etc.) investments, you can get these at a discount compared to other companies with similar numbers but in a more mainstream category.
You know, it just hit me that having an all-female company would be really advantageous in this way. The grass is always greener etc. but from this side of the fence it looks like it makes you bulletproof to this kind of things.
Basically, the expectations of a modern man's sexuality are pretty fucked up and contradictory and most prefer to avoid the entire thing in public.