Or because it allows a Wizard to have a Tower Shield float around him for a min. +5 Shield bonus without spell failure?
Personally, I would remove the penalties simply because they would make no sense on a floating shield. For example, how does it restrict your hand gestures to cause a spell...