Reply to thread

Message

<blockquote data-quote="Chaosmancer" data-source="post: 9101946" data-attributes="member: 6801228">Okay. In which official document did WoTC outline what percentage value they assign to Strongly Disapprove, Disapprove, Approve, and Strongly Approve? Where did they specify that they look at each as a line item instead of as a cohesive whole? Do you have information on how rating the class itself compares to the average rating of the class abilities and how that discreprancy is resolved? Are they averaged? Is any of this information weighted? Do they do a comparison of how something like Weapon Mastery is received across multiple classes, and consider it in that context, or do they look at it solely on an individual class basis? Do they consider any comparative analysis between classes?Do you know ANY of this? Or is it enough that they say &quot;the ranger got above a 70% approval rate&quot; and you can just assume that means they are flattening the data into &quot;therefore 70% of people said yes and 30% said no&quot;Right, you just assume 70% was a randomly chosen number, because any percentage would have the same meaning. They could not have POSSIBLY used logic to determine why a 70% approval rating was a good cut-off. Additionally, you, obviosuly a professional game designer with a decade of experience and long history of using surveys to poll the public and compare that data against your internal playtesting team, can see no reason to believe that the data of supermajority approval of a product can reliably translate into a well-designed product. Or maybe, you are asking the wrong question. Maybe WoTC, in wanting to make a well-designed and popular game... is more concerned with appeal of their product than whether any possible idea they have warrants further experimentation. Because, fundamentally, EVERY idea warrants further experimentation. They've never released an idea that didn't warrant it, because any idea that bad never even got to us.</blockquote>

[QUOTE="Chaosmancer, post: 9101946, member: 6801228"] Okay. In which official document did WoTC outline what percentage value they assign to Strongly Disapprove, Disapprove, Approve, and Strongly Approve? Where did they specify that they look at each as a line item instead of as a cohesive whole? Do you have information on how rating the class itself compares to the average rating of the class abilities and how that discreprancy is resolved? Are they averaged? Is any of this information weighted? Do they do a comparison of how something like Weapon Mastery is received across multiple classes, and consider it in that context, or do they look at it solely on an individual class basis? Do they consider any comparative analysis between classes? Do you know ANY of this? Or is it enough that they say "the ranger got above a 70% approval rate" and you can just assume that means they are flattening the data into "therefore 70% of people said yes and 30% said no" Right, you just assume 70% was a randomly chosen number, because any percentage would have the same meaning. They could not have POSSIBLY used logic to determine why a 70% approval rating was a good cut-off. Additionally, you, obviosuly a professional game designer with a decade of experience and long history of using surveys to poll the public and compare that data against your internal playtesting team, can see no reason to believe that the data of supermajority approval of a product can reliably translate into a well-designed product. Or maybe, you are asking the wrong question. Maybe WoTC, in wanting to make a well-designed and popular game... is more concerned with appeal of their product than whether any possible idea they have warrants further experimentation. Because, fundamentally, EVERY idea warrants further experimentation. They've never released an idea that didn't warrant it, because any idea that bad never even got to us. [/QUOTE]

Verification