I have no issues with how things are going. Obviously when one player moves away from the others and gets his own mini-adventure it can be a bit boring for the other players to watch and not participate, but that is over now since we're all together at the temple. Plus, there's very little a DM can do (besides heavy railroading) to prevent such a thing.