Yes! The DM is being unfair, He doesn't like it now that it make him have to think on a different way to almost kill you. If he did have a good reason he would have told you before he said yeah. I mean I understand Why he does it but still its unfair.