Menu
News
All News
Dungeons & Dragons
Level Up: Advanced 5th Edition
Pathfinder
Starfinder
Warhammer
2d20 System
Year Zero Engine
Industry News
Reviews
Dragon Reflections
White Dwarf Reflections
Columns
Weekly Digests
Weekly News Digest
Freebies, Sales & Bundles
RPG Print News
RPG Crowdfunding News
Game Content
ENterplanetary DimENsions
Mythological Figures
Opinion
Worlds of Design
Peregrine's Nest
RPG Evolution
Other Columns
From the Freelancing Frontline
Monster ENcyclopedia
WotC/TSR Alumni Look Back
4 Hours w/RSD (Ryan Dancey)
The Road to 3E (Jonathan Tweet)
Greenwood's Realms (Ed Greenwood)
Drawmij's TSR (Jim Ward)
Community
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions, OSR, & D&D Variants
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Resources
Wiki
Pages
Latest activity
Media
New media
New comments
Search media
Downloads
Latest reviews
Search resources
EN Publishing
Store
EN5ider
Adventures in ZEITGEIST
Awfully Cheerful Engine
What's OLD is NEW
Judge Dredd & The Worlds Of 2000AD
War of the Burning Sky
Level Up: Advanced 5E
Events & Releases
Upcoming Events
Private Events
Featured Events
Socials!
EN Publishing
Twitter
BlueSky
Facebook
Instagram
EN World
BlueSky
YouTube
Facebook
Twitter
Twitch
Podcast
Features
Top 5 RPGs Compiled Charts 2004-Present
Adventure Game Industry Market Research Summary (RPGs) V1.0
Ryan Dancey: Acquiring TSR
Q&A With Gary Gygax
D&D Rules FAQs
TSR, WotC, & Paizo: A Comparative History
D&D Pronunciation Guide
Million Dollar TTRPG Kickstarters
Tabletop RPG Podcast Hall of Fame
Eric Noah's Unofficial D&D 3rd Edition News
D&D in the Mainstream
D&D & RPG History
About Morrus
Log in
Register
What's new
Search
Search
Search titles only
By:
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions, OSR, & D&D Variants
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Menu
Log in
Register
Install the app
Install
Upgrade your account to a Community Supporter account and remove most of the site ads.
Community
General Tabletop Discussion
*Dungeons & Dragons
Street date for D&D Next Starter Game is July 15
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="lkj" data-source="post: 6300066" data-attributes="member: 18646"><p>Forgive me, Morrus, as I suspect you won't disagree with what I'm going to say. But I'm a nerd. And perhaps to help clarify the conversation for others:</p><p></p><p>Sample sizes aren't in and of themselves statistically significant. The question is whether the sample size is large enough to give a statistically meaningful result, which is I'm sure what you mean. So I suspect what you are saying is that EnWorld has a large enough active forum membership to theoretically provide a large enough sample size to do meaningful tests of the population as a whole. I'm sure that's true.</p><p></p><p>But, as you pointed out, whether results from a messageboard are meaningful for the inferences WotC would presumably want (i.e., their consumer base as a whole) is a much more difficult question. </p><p></p><p>1) Active participants on a messageboard my not be a representative sample. I would hypothesize that this is likely the case-- though only a proper study involving a wider consumer base could verify this. But if it isn't representative, then others here might well be right that responses here aren't meaningful for WotC in determining their strategy (and I know you made this point in your first post).</p><p></p><p>2) Even if the active population as a whole is large enough for a meaningful sample, the participants in a given thread might not be. If it truly is 50 posters, then the chances of that sample being a good one drop considerably, especially given the added self-selection. </p><p></p><p>3) For survey results (though I'm not an expert on these), I suspect the way the survey is conducted is critically important for the reliability of the results. The back and forth of a messageboard threads, I suspect, is not an environment to get reliable results. </p><p></p><p>But it strikes me that the argument is conflating two points-- 1) Can we get a good representation of how consumers will react from the messageboard; and 2) Is it important that information is making its way to this part of the community without proper PR massaging. </p><p></p><p>The only relationship between those questions is whether the messageboard community is representative of the community as a whole in two respects:</p><p></p><p>1) Is the wider consumer base also consuming this information?</p><p>2) If so, are they reacting the same way if they do?</p><p></p><p>Neither question is answerable without data. But as to #1-- It's a hypothesis, and I don't have any data to back it. But I very much doubt most potential D&D buyers are paying much attention to the occasional leak on B&N or from thalmin. If I'm right, then the argument that WotC has no incentive to actively control it is sound. Heck, they might have a disincentive, since it might compromise their overall strategy. Sure, it'd be nice if they had control over every piece of info that comes out. Maybe they should. But maybe it doesn't matter at this scale. </p><p></p><p>Anyway, my apologies for the wall of text. They are the sad musings of an obsessive data nerd.</p><p></p><p>AD</p><p></p><p>p.s. hours later, I read this and can't believe I wrote this whole thing in a thread about release dates. Yikes. I leave it only because I haven't the heart to delete my longest post ever.</p></blockquote><p></p>
[QUOTE="lkj, post: 6300066, member: 18646"] Forgive me, Morrus, as I suspect you won't disagree with what I'm going to say. But I'm a nerd. And perhaps to help clarify the conversation for others: Sample sizes aren't in and of themselves statistically significant. The question is whether the sample size is large enough to give a statistically meaningful result, which is I'm sure what you mean. So I suspect what you are saying is that EnWorld has a large enough active forum membership to theoretically provide a large enough sample size to do meaningful tests of the population as a whole. I'm sure that's true. But, as you pointed out, whether results from a messageboard are meaningful for the inferences WotC would presumably want (i.e., their consumer base as a whole) is a much more difficult question. 1) Active participants on a messageboard my not be a representative sample. I would hypothesize that this is likely the case-- though only a proper study involving a wider consumer base could verify this. But if it isn't representative, then others here might well be right that responses here aren't meaningful for WotC in determining their strategy (and I know you made this point in your first post). 2) Even if the active population as a whole is large enough for a meaningful sample, the participants in a given thread might not be. If it truly is 50 posters, then the chances of that sample being a good one drop considerably, especially given the added self-selection. 3) For survey results (though I'm not an expert on these), I suspect the way the survey is conducted is critically important for the reliability of the results. The back and forth of a messageboard threads, I suspect, is not an environment to get reliable results. But it strikes me that the argument is conflating two points-- 1) Can we get a good representation of how consumers will react from the messageboard; and 2) Is it important that information is making its way to this part of the community without proper PR massaging. The only relationship between those questions is whether the messageboard community is representative of the community as a whole in two respects: 1) Is the wider consumer base also consuming this information? 2) If so, are they reacting the same way if they do? Neither question is answerable without data. But as to #1-- It's a hypothesis, and I don't have any data to back it. But I very much doubt most potential D&D buyers are paying much attention to the occasional leak on B&N or from thalmin. If I'm right, then the argument that WotC has no incentive to actively control it is sound. Heck, they might have a disincentive, since it might compromise their overall strategy. Sure, it'd be nice if they had control over every piece of info that comes out. Maybe they should. But maybe it doesn't matter at this scale. Anyway, my apologies for the wall of text. They are the sad musings of an obsessive data nerd. AD p.s. hours later, I read this and can't believe I wrote this whole thing in a thread about release dates. Yikes. I leave it only because I haven't the heart to delete my longest post ever. [/QUOTE]
Insert quotes…
Verification
Post reply
Community
General Tabletop Discussion
*Dungeons & Dragons
Street date for D&D Next Starter Game is July 15
Top