You know, that makes for interesting character development... As npc's go, it is completely up to you. As for PCs, cosmetic permanents might be okay, but I feel that it could be tricky if it were a permanent penalty. (However, I am completely cool with injuries that take longer than a long rest to recover from, though that might be brutal for this campaign...)