ichabod
Legned
die_kluge said:Yes, that's the failing; the second list is purely subjective. But, I figured that given enough responses, if everyone truly thought that all the classes were balanced, then the average scores for all the classes would come out to be 6.0 (the average of 1 to 11). In theory, a 6.0 for a class (which the Paladin got) is a perfectly balanced class. Anything above that is powerful, and anything below that is weak.
Given that, statistically speaking, cleric, fighter, wizard are all too powerful, and monk, ranger, and bard are all too weak. And, apparently, Bard is as weak as a cleric is strong (both are ~4 off from midpoint).
As a statistician in training, I'm going to have to weigh in here. The problem isn't really that the second list is purely subjective, people's opinions are measured all the time. You just have to be clear that you are measuring opinions, not facts. You did this at the begining, but seem to be losing sight of it. The main problem is that you haven't shown that either of these surveys is from a representative sample of the overall population of 3E players, or even 3E online players, or even members of these message boards. This casts serious doubts about any conclusions.
The other big problem is the way you phrased the question about power. You did it as a ranking instead of a rating. To show how this is a problem, take two people, A and B. A thinks there are some slight variations in power, but all the classes are pretty balanced. B thinks some classes are uberpowerful, while others are a waste of paper. A and B could still give the exact same answers to a ranking question, because you have imposed a metric upon them that is not necessarily reflected in their opinions. However, if you give a rating question, where each class gets a power rating from 1 to 10. The the difference between A and B's answers would become apparent (A having a lot of 4s, 5s, and 6s; B having a lot of 10s and 1s).
I don't mean to be overly negative, it's just that I don't get to take the Sample Surveys class until next semester, so I don't know enough to suggest useful alternatives.