Not allowing ASIs seriously hinders characters that rely on Dex for AC like Light Armor, Mage Armor, Natural Armor classes. I know it's not a total game breaker, but I think you'd see a lot more feats used to squeeze into Medium armor and Shield.
There are still a lot of feats that are good on...