This is absolutely a real thing, and must be taken into account.
But it is not an excuse to dismiss all objection to change, when sometimes that change really does conflict with the established theme/mood/aesthetic.
As with most things, it's a balancing act, and everyone has their different...