If you have that much leisure time, then whether you fill it with reams of D&D, or other pursuits, matters only if it leads to burn-out.
If you *don't* have that much leisure time, and you're way over-budget on D&D, it's time to scale back...but then that would apply to anything!
So the...