I have done the exact same thing and doing the following things might help.
1-Everyone just play online. This however lowers the fun for everyone,NOT that is still isn't fun, just not as much fun.
2-Admit that yes there will be a difference and make sure you are as inclusive as you can be...