Thanks to everybody for your input. This seems like an issue that will require a healthy dose of DM discretion, which is fine.
I'd like to extend the original question. What if you're adjacent to another creature that is ALSO adjacent to the cube and attempt a "swap places" maneuver against...