Have multiple towers, One Melee Tower, One Spell Tower and one Critical Moment Tower...
Pull from the First when you want it to count as a melee swing, same with the second for spells. Start the Third tower down 2 pulls per player (or 3) and use it for puzzles and the like and even the BBEG fights?