That's not wrong. Its just the same as taking a -5, 0, or +5, instead of a 0, +5, or +10. I simply prefer a default of 0 being no skill and the base at which they start. Then your good or your and expert. I get the idea of being truly bad at something but at the same time a bad swordsman might...