I don't think GM fiat reduces player agency if the GM is fair.
If by saying "Idea #324 is not possible given the current state of affairs in the setting" I don't see that as limiting the players very much as the whole point is to adventure in a particular setting.
I do believe in the absolute...