Whizbang makes a great point. You're absolutely right, Dandu, that a castle can easily be overcome by wizards, but in most kingdoms, barring those like Greyhawk, Waterdeep and Silverymoon, the "archmage" of the kingdom will likely be less than 10th level.
That means that situations like this...