It is a big deal, but it's only one pillar. An important pillar, certainly, since being dead means you can't do the other two. But the general assumption of the game is winning most battles, since that's the way the attrition model works. So being able to impact multiple pillars is more valuable on average.
I get that but were talking about delaying Paladin here (simply to get Cha to hit, reduce MAD and open up elven accuracy).
Youre delaying SO much there. Cha to saves, extra attack, spellcasting, improved divine smite etc for 1-3 levels.