Just like with any romantic relationship or life partnership, resentment builds up because of communication issues or needs not being adressed.
You're allowed to talk to your players outside the game on a meta-level. I am sure they understand that you are someone who wants to have fun as well...