You'd have the same problem if no one chose to play a wizard. I don't see it being all that big of a deal.
The difference, of course, is choice. If the party chooses to not have the utility, they have nobody to blame but themselves if they need it and don't have it.
If you, as the GM, eliminate utility as a choice, and then put them in a situation where it is called for, they blame you
