Its not the easiest thing. I play D&D now for over 10 years and one of the most athmosperic killers is to create a rule while gaming.
We did exactly what you described. But then started the discussions: what abiltiy to use for drawing? Dex, because you need a steady hand? No, its Wis, you have...