This seems like such a colossally bad idea to me as to be possibly, actually, impossible.
Maybe the Kinect makes things different, but the Xbox Controller seems to me an *incredibly* poor tool for doing...well, *any* of the things a GM or players would want to be able to do. Draw on the map...