I'm in the 'both/either' camp.
For D&D, I prefer numbers for weapon damage, energy damage on a weapon, etc., but pips for sneak attacks or nukes. IOW, if it's a few dice, numbers to match the rest of the dice set; if it's a lot of dice (which includes d6 systems), time to pull out the box-o'-d6.