That was my initial objection, almost exactly. It holds up if you think that Time Stop's effect is to give you 2-5 "mini-rounds" in which to do stuff, but all of which happens on your current turn.
But, on the other side, you could model Time Stop this way: "For the next 2-5 rounds, only you...