You can't use different colors and have it work, because if you're rolling with Advantage or Disadvantage, then your Primary could be the one that is dropped out, and then... which one is your next primary? You'd have to create an established order. (I mean, yeah, it works when there's only two...