Do you use some sort of dry or wet erase piece with the minis? If so, you could alphanumerically number the grid. Then when you need to move you could ask one of the players to place "the ogre at G9, could you move him to H15 for me? Thanks." like a Chess or Battleship board.
For drawing on the...