As a GM, I deal with this two ways.
First, I don't have scenes that aren't important. If there's no conflict to be introduced, explored, or resolved, I cut to the next scene. Now this isn't to say that I'll keep a PC from talking to someone, but I'll make sure to figure out a way to involve...