One idea I thought of was basically giving a d6 of Sneak Attack with the feat (which would stack with the Rogue feature), but that would make the feat a lot more complex.
TBH though, I am pretty sure an extra d4 Damage on dagger attacks is really going to break the system when you compare it to...