Some editions of D&D provided an AoO against unarmed characters attacking a weapon wielding opponent. IMO, the use of a dagger isn't much different in many situations.
Weapon speeds make perfect sense for sledge hammers, crossbows, spells, etc), but there needs to be an additional...