Quartz
Hero
The danger here is that you end up in an unwinnable situation, where no amount of resting will help. If you can only get a long rest in a sanctuary, and it's a month of travel between sanctuaries, then you might end up two weeks out with someone at very few HP and no way to restore them at all. Once you're out of Hit Dice, the only healing that you can get out of a short rest comes from a Cleric of Life, and not all parties have one of those.
That can make for a good adventure once in a while, and if things get problematic, the DM can slip in a hidden glade or similar - or something like the village of Ringland in Greyhawk.