So, on my drive to work this morning, I think I figured it out...
Creatures on the ethereal plane exist on both the prime and the ethereal. On the ethereal plane, the creatures and objects are wholly there and completely visible. On the prime, the creatures and objects are there, but invisible...