Which edition of the game are you playing?
In AD&D 2e, characters often varied widely in level due to the different class progressions, multi-classing, xp bonuses / penalties, etc., so in that game I'd say it doesn't really matter which way you go.
In 3e, being behind not only the level curve...