Thanks, I thought I remembered reading something like this, but couldn't find it in the 3.5 FAQ.
Beyond that, as I thought, the RAW are against me, but I'm not quite willing to concede the common sense point. Maybe I'll just ban Invisibility, or give all monsters Improved Uncanny Dodge...