I'd also look at a Listen check.
We don't use warlocks, but general casting requires a clear use of the voice, no whispers, so it is possible to hear the caster. A successful check may give a bonus. I'm aware that moving 1/2 your speed increases the chance of being spotted by 5, so a +2 for arm...