To add to your point, let's say I'm on the floor and a goblin jumps onto the table. He can probably hit me better than when he was on the floor, but now I can also hit him a lot easier, being on lower elevation...
I try to just stick with "The DM's Best Friend" instead of adding house rules...