There are 2 comments I'd like to make on this.
First of all, this is the kind of thing I was warning about. If your players feel that this adds something to the game, and they like this, then great, keep it up. However, this is something that could very easily become tedious and frustrating...