As you can only benefit from one long rest per day, it truly doesn't matter for game balance purposes whether it's 1, 4, 8 or 16 hours. A rest is only gonna happen when the DM allows it to, so denying a racial benefit that is purely for RP, for no practical purpose is simply arbitrary.
That...