I mean the easiest "why wouldn't theys" are danger, difficulty, time, resources required, etc.
The 6-second cast time for spells is not a universal component of magic in myth or literature. Safe magic is not either, nor predictable magic. It also is not universally as powerful as D&D magic can...