You don’t add your ability modifier to the damage of the bonus attack, unless that modifier is negative.
But, you still add your modifier to hit.
TWF, no feat:
Attack: d20+[ability mod] to hit, weapon+[ability mod] to damage.
Bonus: d20+[ability mod] to hit, weapon [- ability mod if negative]...