Consider taking the choice out of the feat (or limiting the choice of feat), but keeping the feat. Make subtypes of humans that each gain a particular feat based not upon their genetics or culture, but on their history and training.
For example, an Academic Human might get to choose Observant, Linguist, Skilled or Skill Expert. A Military Human may get to choose from Weapon Master, Shield Master, Polearm Master, Mounted Combatant, Crusher, Slasher, etc... Avoid the few feats that are problematic.
In one campaign that I played in the DM had a deck of feats. When someone elected to take a feat rather than an ASI, they drew cards from the deck and selected the card they wished to keep for their feat. If the feat was passed upon, it got a checkmark. If you drew two cards with feats with checkmarks, you could take two cards with checkmarks and get 2 feats for the price of 1. Also, because the card was kept, only one PC could have a feat at any given time. The number of cards you could draw depended upon a scoring system that reflected your PC's theoretical balance score - it was convolute, and I disagreed with the assessments it created.