Simply put, the damage route is inefficient and when you are limited to (generally) one spell per turn, would you rather take out 1/10th of a few enemies' health or make your fighter Gargantuan, so he can keep them off you while you root them in place or sicken them or deal 5d4 strength damage...