It is under the control of the DM. That doesn't mean your DM isn't inconsistent, or entirely batshit insane though. If a good DM had approved the concept once, he should've stuck with what he approved. Sounds like your DM sucked. I would've gotten up and left right then and made a well-heard...