Yeah, it's a shame. It's always a funny idea the first time, though. Although I actually did it with one of the whales. "I want to summon a baleen whale. Oh, darn this isn't an acquatic environment. Fine, an elephant." While everyone else goes, "Huh?"
Sure, it was house ruled afterwards, but it was fun nonetheless.