Personally, I'd allow the monk to pass through the unarmed damage. Because, really, making monks' lives a little easier isn't hurting anyone.
However, I understand why they don't want it to work that way by the rules. Using your unarmed damage when you're armed is just sort of weird, from a...