I'm the same way. I currently have 6 people on ignore; I had one other person until a couple of days ago, but he's on probation now.5 (or so) are on my ignore list.
I take people off now and again just to see if they have become tolerable to me. If not, back they go!