If Fog Cloud is not an option, closing your eyes/not meeting their gaze would help with the Chilling Gaze. The downside is that you will have disadvantage to hit and they will have advantage to hit. Their AC isn't too high, and their damage output isn't amazing, so you could still out damage...