Sorry, I misunderstood. I thought you meant the die type d4, d6, d8 to reflect the relative "toughness" of say a fighter compared to a wizard, so yes 12 for Barbarian, 4 for Wizard, etc.
Multi-class is always tricky. Personally, I would "average" the dice unless they only took one level of...