The rules.
Yep, those things that give a game structure, provide us with a generally equitable environment, and deliver a framework for shared communication.
As a GM, you have the latitude to break the rules. Do it too much, and you might alienate your players. Do it too little, and you...