Yeah, this is what gets me too.I have a harder time with human behavior. When people do things that don’t match their character’s precedent in the sort or really defy most human tendencies I have a hard time…
I remember back in the day reading Harry Potter and the Goblet of Fire and wondering how any sane person was okay with what was going on. First the fact that there even was a tournament, which was notorious for killing young children. Maybe it's more gentle now? No, there's an event where you have to steal an egg from a literal dragon.
Even if I'm going to suspend my disbelief about them holding the tournament, I can't handle that they let Harry play even though he's not old enough, he didn't enter the competition, and it's obviously part of Voldomort's plot. And other than the little bit about killing Harry, the plot totally worked. Hey Dumbledore, you don't want the dark lord to return. How about you don't walk into his obvious trap?
I can handle wizards, dragons, FTL, sound traveling in a vacuum. But supposedly smart people do stupid stuff, characters acting way out of character for plot reasons, those are what break it for me.