I'm on similar page.I no longer use racial ability score boosts. Instead I have racial ability minimums.
For example, for a High Elf, the Dexterity must be 12 or higher and the Intelligence 11 or higher. On average, these High Elf abilities are higher than Human, and never below average.
I am happy with how this is working out, both for flavor and mechanics. It also allows the High Elf to be just as good as any other race in any class. A High Elf Paladin with very high Strength and Charisma? Great!
I wouldnt worry about weak abilities, but if you want, the opposite might possible. Say, the maximum score for a High Elf at level 1, might be 16 Constitution. Then allow the player to improve Constitution normally, upto 20, while leveling.
Na racial ability boosts.
Point buy set at 16 max.
8 - 0pts
10 - 2pts
12 - 4pts
14 - 6pts
16 - 10pts
Human: free point buy
Elf: Dex; min 14, Con; max 14
high elf: int; min 12
wood elf: wis; min 12
Drow; cha; min 12
Dwarf: Con; min 14, Str; min 12, Cha max 14, Dex; max 14
H.Orc: Str; min 14, Con; min 12, int max 14, cha max 14
H.Elf: Dex; min 12
Gnome; Int; min 12, Con; min 12, Str; max 14
Halfling: Dex; min 12, Cha min 12, Str: max 14