That's what Laser Sharks are for.
In all seriousness, I'd be inclined to rule that during your turn, you don't have to make a skill check when hit (from an OA, frex). Off your turn, though, you don't have a climb speed anymore, making it dangerous to hang around on the wall if you can be attacked.