Agreed. I would rule "no" as well.
Then, when the player argues that the rules as they are printed allows for it, is there anything other than "I'm the DM, and I say no" to point to for my reasonable ruling?
If yes, what is it?
If no, why aren't the printed rules supporting a reasonable take...