Just like in real life, we enjoy silliness/humor in our games. I wouldn't want to play in an uber-serious game where I felt afraid to break a smile, and I don't want my players to fee that way either.
Having said that, we also don't get so ridiculously silly that it ruins the game, either.