I've adapted a house rule in my campaign in the same spirit, after seeing far too many character decked out in number-boosting items. Instead of removing them entirely, I changed all the stat boosting items, and items that boost saves or AC, into rings. So there's rings of charisma and rings...