Why not? If you're really not having fun because, say, the module is silly and you explore and the map can't make physical sense without exploration and you find a starving groups of NPC next to the room full of food and water without any trap etc. you can certainly be miffed.
Once, we vetoed the GM who started a sci-fi adventure where we were space traders by "you're going back to planet X with an empty cargo bay after delivering supplies in planet Y". We used to speech-tool to say we all found that silly and there was surely something we could take back, especially as professional trader we'd have studied the markets before doing the trip. It had no importance for the game, it was just a throwaway sentence, but it broke immersion hard and was experienced as a suppression of player agency. If there had been an X-card, we might have used it.