this I agree,
only a sudden deaf person will be unable to control their voice good enough for spell casting.
and if extra training is required for deaf person to cast magic, this might be represented with a feat choice.
Silent spell from 3.5e and improved silent spell(to reduce spell level...