IMO the players have no right to complain if it's a fact about your campaign world that their current character should not have known - though I would go easy on them the first time, allowing for retro-gaming with the understanding that they should check facts with the DM in the future. IMC it's allowable to assume that your character shouldn't have to roleplay every bit of information that they've picked up about the world, perhaps the Baron is well-known enough that people know the number and ages of his children. IMC it's permissable for players to use that information, assuming it fits the criteria and I give permission for it (usually after the fact). If the current set of characters encounters a fact that's inconsistent with what their prior characters new, invoke the "alternate universes" explanation:
DM: "My campaign consists of a number of related but alternate universes, where the consequences of different historical outcomes are explored. You are now in universe #2132A, which bears a close resemblance to my previous campaign world but differs in some subtle ways. The Baron in this universe has no daughter, so let's go back and, with that knowledge, what does your character really say?".
OR
DM: "Hey guys/gals, I'm not going to keep track of 15 years of campaign material - I reserve the right to change my campaign details. For example - I'd like to rework the town of Woebegone without having to call every player in my campaign from 1986 and get their permission. Anytime you start new characters in my campaign. All bets are off, ask before you bet your life on some fact."
I suppose the response depends on how close of friends you are with the players.
Of course my advice here is a last resort measure, I more often follow the advice given in the other posts on this thread - I just like to keep this one in my back pocket in case.