In my Campaigns I tend to allow it, provided that the Party does not have a pure single class fighter! And that, only in case of Specialization and not anything higher like Mastery for example.
Normally, my Parties range between 2-4 PCs max, so I think it makes sense to allow it, in order to...