Yup, that's right. Since you could use a short sword anyway, it's not a huge leap to allow unarmed strikes to be finessed as well. I think it's pretty flavorful actually--Rogue/Monk sneaks up, "JUDO CHOP!" knocks out the baddie, sneaks away.
Again, this would be best done as DM-by-DM houserule...