I agree. If any sort of Background skill/feat is introduced, it should probably not apply to combat-related rolls (Attacks, Defenses, Saves, etc.).
That said, I was looking to implement something similar in my game as well. But it would only give a +2 bonus and players could have more than one...