Do like they did in Lord of the Flies. Give the players a conch shell, or any suitable token (a horn, a wand, etc.). If they want to speak to an NPC or otherwise take a turn, they take the conch. When someone else wants to take a turn, they pass the conch.
This helps keep everyone from...