D&D 5E (2014) Spellcasting Bonus: can't we just lose it?

[DEFCON 1]

That is the obvious solution, but when I raised this solution in a different conversation, there was a big objection that DMs like to roll dice too.

They get to roll whole heaps of damage dice.

 

[Grazzt]

...there was a big objection that DMs like to roll dice too.

We do. Usually in situations such as:

Player: [insert character's name] listens at the door.

DM: (drops a large handful of dice behind the screen for effect). You don't hear anything.