I think one deterrent in "science fiction" is the "science" part, or at least the fear of it. People are put off by the thought of having to make allowance for the laws of physics. "Fantasy", on the other hand, implies a freedom to make up the rules yourself.
The irony is that the science is...