The problem comes when people, who know the character as physically intimidating, see a small man in that role. I wouldn't exactly call Cruise physically intimidating, in appearance. It's kind of a core part of the character, for readers.
EDIT - For context I'm a whole 2" taller than Cruise...