Well, obviously if you sling a shield on your back, you are just carrying it, not holding it, so you wouldn't get the bonus.
However, if Fighter Bob asks you to hold his +3 shield for him you can say, "Sure!" and sling the shield on your back and you WOULD get the bonus, because you are holding...