Saving throws aren't at disadvantage when Frightened. Concentration is a saving throw, not an ability check.
Personally, I don't have a problem with it. It's just something that affects melee characters more, like how silence only really hinders spellcasters and not fighters. Just different...