Yes, it only happened once, but the player was very frustrated about it because while everyone else did adjust their tactics, he was pretty much out of the fight for the rest of the encounter, that's all. Evidently it will be different for every group, I'm just giving a suggestion based on my own group's experience so OP can benefit from multiple points of view. For what it's worth, I think the encounter is very interesting and two of my players were OK with it. The other two weren't happy, is all I'm saying. You know your group best.
