Well yes. But it's a nerf because it's not equitable. If everyone was in the same boat it wouldn't matter.
And it's probably not really the point buy that matters so much. It's more the way ability scores progress. Point buy is all relative, but the fact that you only effectively get to...