Yes, single high level spell slots are a thing about 5e. Losing complete access to those spells is probably a very steep penalty, although also having a permanent 8th or 9th level spell is quite the boon.
I'm not too fond of hp penalty either, because it can still be sidestepped with temporary...