[/I]In addition to Grapple specifically stating that it replaces your attack, you have to have a weapon in your main hand to use TWF.
In the 5e weapons table Unarmed Strike does not have the 'light' quality and is also unrelated to grappling.You might be right on the first part, though I would argue the second. An unarmed strike is a light melee weapon.