Menu
News
All News
Dungeons & Dragons
Level Up: Advanced 5th Edition
Pathfinder
Starfinder
Warhammer
2d20 System
Year Zero Engine
Industry News
Reviews
Dragon Reflections
Columns
Weekly Digests
Weekly News Digest
Freebies, Sales & Bundles
RPG Print News
RPG Crowdfunding News
Game Content
ENterplanetary DimENsions
Mythological Figures
Opinion
Worlds of Design
Peregrine's Next
RPG Evolution
Other Columns
From the Freelancing Frontline
Monster ENcyclopedia
WotC/TSR Alumni Look Back
4 Hours w/RSD (Ryan Dancey)
The Road to 3E (Jonathan Tweet)
Greenwood's Realms (Ed Greenwood)
Drawmij's TSR (Jim Ward)
Community
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Resources
Wiki
Pages
Latest activity
Media
New media
New comments
Search media
Downloads
Latest reviews
Search resources
EN Publishing
Store
EN5ider
Adventures in ZEITGEIST
Awfully Cheerful Engine
What's OLD is NEW
Judge Dredd & The Worlds Of 2000AD
War of the Burning Sky
Level Up: Advanced 5E
Events & Releases
Upcoming Events
Private Events
Featured Events
Socials!
Twitch
YouTube
Facebook (EN Publishing)
Facebook (EN World)
Twitter
Instagram
TikTok
Podcast
Features
Top 5 RPGs Compiled Charts 2004-Present
Adventure Game Industry Market Research Summary (RPGs) V1.0
Ryan Dancey: Acquiring TSR
Q&A With Gary Gygax
D&D Rules FAQs
TSR, WotC, & Paizo: A Comparative History
D&D Pronunciation Guide
Million Dollar TTRPG Kickstarters
Tabletop RPG Podcast Hall of Fame
Eric Noah's Unofficial D&D 3rd Edition News
D&D in the Mainstream
D&D & RPG History
About Morrus
Log in
Register
What's new
Search
Search
Search titles only
By:
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Menu
Log in
Register
Install the app
Install
Community
General Tabletop Discussion
*Dungeons & Dragons
The WotC Playtest Surveys Have A Flaw
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="Ruin Explorer" data-source="post: 9109588" data-attributes="member: 18"><p>ROFL that's the one of most ridiculous things I've ever read.</p><p></p><p>No-one would respect an election that only 0.4 of the population voted on. Nor should they.</p><p></p><p>Absolute gibberish. The self-selection bias is likely huge, given the nature of the survey and that it even drives away people here.</p><p></p><p>Also self-selection is accounted for? Unsourced, unsupported rubbish. I work with people who do surveys for a living as well, and self-selection bias is absolutely an issue in our industry (law), so your unsourced, unsupported claim that it's a "solved problem" (a rather extreme claim) seems completely nonsensical.</p><p></p><p>And gamers? We know the self-selection with gamers means haters are much more likely to finish surveys than people who love something. But the exact percentage varies, so you can't just say "Solved!". Especially not when you're touting a 70% threshold for approval, rather than saying you use a complicated weighted formula. Or are we to presume they're lying re: the 70%?</p><p></p><p>Unless you have secret insider information, you have absolutely no basis to make that claim. It's just straightforwardly a lie presented as a fact. We cannot be certain who is answering these surveys, only that it's very few people (even compared to the users of D&D Beyond, which was 13 million last time WotC released figures, shortly after they bought it), and that surveys are extremely onerous and completely lack direction and focus.</p><p></p><p>I mean, unless all you mean by "ordinary DNDBeyond users" is "not people who post on ENworld, in which case it's a pointless and obvious truism. But it seems like you mean more than that.</p><p></p><p>At this point it looks very like you're just making up a bunch of "facts" that are convenient for you. You no provide no links, no sources, just claims.</p></blockquote><p></p>
[QUOTE="Ruin Explorer, post: 9109588, member: 18"] ROFL that's the one of most ridiculous things I've ever read. No-one would respect an election that only 0.4 of the population voted on. Nor should they. Absolute gibberish. The self-selection bias is likely huge, given the nature of the survey and that it even drives away people here. Also self-selection is accounted for? Unsourced, unsupported rubbish. I work with people who do surveys for a living as well, and self-selection bias is absolutely an issue in our industry (law), so your unsourced, unsupported claim that it's a "solved problem" (a rather extreme claim) seems completely nonsensical. And gamers? We know the self-selection with gamers means haters are much more likely to finish surveys than people who love something. But the exact percentage varies, so you can't just say "Solved!". Especially not when you're touting a 70% threshold for approval, rather than saying you use a complicated weighted formula. Or are we to presume they're lying re: the 70%? Unless you have secret insider information, you have absolutely no basis to make that claim. It's just straightforwardly a lie presented as a fact. We cannot be certain who is answering these surveys, only that it's very few people (even compared to the users of D&D Beyond, which was 13 million last time WotC released figures, shortly after they bought it), and that surveys are extremely onerous and completely lack direction and focus. I mean, unless all you mean by "ordinary DNDBeyond users" is "not people who post on ENworld, in which case it's a pointless and obvious truism. But it seems like you mean more than that. At this point it looks very like you're just making up a bunch of "facts" that are convenient for you. You no provide no links, no sources, just claims. [/QUOTE]
Insert quotes…
Verification
Post reply
Community
General Tabletop Discussion
*Dungeons & Dragons
The WotC Playtest Surveys Have A Flaw
Top