It's not very good, no, but if you're planning to have that hand free anyway....
Technically, the only requirement is that you have nothing in that hand.
The maneuver descriptions do, however, specify what you are doing with that hand, so no unarmed offhand attacks if you follow the description to the letter.
In hindsight, maybe not such a good suggestion....