Well, you had this spellcasting restriction in pre-3e as well; a "minimum Intelligence to cast spells of level x" is traditional,
Also, don't forget the ability restrictions for character classes, e.g. the required Charisma of 17 for a Paladin.
Ummh, but, disregarding the sub-classes for this...