That'd be my concern, Jan. Based on the min-maxability, it seems the smart play would be to have each character super-specialize. A party composed of Gregor Clegane, Littlefinger, and Melisandre. Characters that bury the needle on their particular "thing".
Hm. Actually, that sounds pretty fun...