It depends on whether the PCs had a reason to suspect that something was up. My group was attacked by a dozen goblin assassins at night once, but we knew there were assassins about so we kept watch - even though we were spending the night in a palace. I don't think we took any damage at all. :)...