Close. It's the number of dice, not the type of dice, that affects your chance of getting the average.
For example, if you roll a d20, you have an equal chance of rolling each possible result between 1 and 20. Each has a 1 in 20 (or 5%) chance.
Now take the attached picture. It is a table...