A disservice to men and other genders too, I think. Creating categories to slot readers/writers into may make life easier for agents, publishers, marketers, retailers etc. but they are subconsciously (or consciously?) steering and limiting readers' wider experiences.
There's a dire need for changing attitudes and redefining how we perceive people and their tastes. Even in the supposedly free world of self-publishing, categories have to be adhered to, to attract the right readers with the right mindset, which has possibly been shaped by the overarching attitudes to what is male or female or other fiction.
Just my personal observation. I'm not sure I know what the answer is.