Menu
News
All News
Dungeons & Dragons
Level Up: Advanced 5th Edition
Pathfinder
Starfinder
Warhammer
2d20 System
Year Zero Engine
Industry News
Reviews
Dragon Reflections
Columns
Weekly Digests
Weekly News Digest
Freebies, Sales & Bundles
RPG Print News
RPG Crowdfunding News
Game Content
ENterplanetary DimENsions
Mythological Figures
Opinion
Worlds of Design
Peregrine's Next
RPG Evolution
Other Columns
From the Freelancing Frontline
Monster ENcyclopedia
WotC/TSR Alumni Look Back
4 Hours w/RSD (Ryan Dancey)
The Road to 3E (Jonathan Tweet)
Greenwood's Realms (Ed Greenwood)
Drawmij's TSR (Jim Ward)
Community
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Resources
Wiki
Pages
Latest activity
Media
New media
New comments
Search media
Downloads
Latest reviews
Search resources
EN Publishing
Store
EN5ider
Adventures in ZEITGEIST
Awfully Cheerful Engine
What's OLD is NEW
Judge Dredd & The Worlds Of 2000AD
War of the Burning Sky
Level Up: Advanced 5E
Events & Releases
Upcoming Events
Private Events
Featured Events
Socials!
Twitch
YouTube
Facebook (EN Publishing)
Facebook (EN World)
Twitter
Instagram
TikTok
Podcast
Features
Top 5 RPGs Compiled Charts 2004-Present
Adventure Game Industry Market Research Summary (RPGs) V1.0
Ryan Dancey: Acquiring TSR
Q&A With Gary Gygax
D&D Rules FAQs
TSR, WotC, & Paizo: A Comparative History
D&D Pronunciation Guide
Million Dollar TTRPG Kickstarters
Tabletop RPG Podcast Hall of Fame
Eric Noah's Unofficial D&D 3rd Edition News
D&D in the Mainstream
D&D & RPG History
About Morrus
Log in
Register
What's new
Search
Search
Search titles only
By:
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Menu
Log in
Register
Install the app
Install
The
VOIDRUNNER'S CODEX
is coming! Explore new worlds, fight oppressive empires, fend off fearsome aliens, and wield deadly psionics with this comprehensive boxed set expansion for 5E and A5E!
Community
General Tabletop Discussion
*Dungeons & Dragons
"The Future of D&D" (New Core Books in 2024!)
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="Cadence" data-source="post: 8410523" data-attributes="member: 6701124"><p>That depends on how similar the two groups beyond that circumstance. If you did a standard experimental thing and randomly picked who was going to be in the smaller group, then the smaller group would be very useful for telling you about how the bigger one would react to that circumstance. Outside an experiment, there are a bunch of things you could do to help match folks to see what the effect was, and get good results assuming you didn't miss anything big in doing so. If there is self-selection bias to get in to the smaller group and the reason for selecting is related to the outcome, then your extrapolation could be really bad. Are those who choose to spend $$$ getting the full access more likely to play a lot and be bored of the bog-standard races/classes, have more practice in min/maxing, and be more likely to play in non-standard settings? If so, then the choices they make could differ a lot from what you'd get by giving the other players full access. </p><p></p><p></p><p></p><p>There's a lot of space between indicative and being definitive. And there are plenty of surveys where the sample sizes are large enough to make the margins of errors much smaller than the observed differences.</p><p></p><p></p><p></p><p>Which you quoted me saying similarly in the case of races. For the ones that only differ by a few percentage points I'm not sure why the rankings couldn't change quite a bit. From the 2019 numbers the difference from combined humans to combined elves is 11.6%. The difference for Dragonborn being number 4 or being number 11 is only 4.1%.</p><p></p><p></p><p></p><p>I'm just arguing that from a statistical/data methodology point of view that some of the things you've said about how to read data don't seem generally sound. But you be you.</p></blockquote><p></p>
[QUOTE="Cadence, post: 8410523, member: 6701124"] That depends on how similar the two groups beyond that circumstance. If you did a standard experimental thing and randomly picked who was going to be in the smaller group, then the smaller group would be very useful for telling you about how the bigger one would react to that circumstance. Outside an experiment, there are a bunch of things you could do to help match folks to see what the effect was, and get good results assuming you didn't miss anything big in doing so. If there is self-selection bias to get in to the smaller group and the reason for selecting is related to the outcome, then your extrapolation could be really bad. Are those who choose to spend $$$ getting the full access more likely to play a lot and be bored of the bog-standard races/classes, have more practice in min/maxing, and be more likely to play in non-standard settings? If so, then the choices they make could differ a lot from what you'd get by giving the other players full access. There's a lot of space between indicative and being definitive. And there are plenty of surveys where the sample sizes are large enough to make the margins of errors much smaller than the observed differences. Which you quoted me saying similarly in the case of races. For the ones that only differ by a few percentage points I'm not sure why the rankings couldn't change quite a bit. From the 2019 numbers the difference from combined humans to combined elves is 11.6%. The difference for Dragonborn being number 4 or being number 11 is only 4.1%. I'm just arguing that from a statistical/data methodology point of view that some of the things you've said about how to read data don't seem generally sound. But you be you. [/QUOTE]
Insert quotes…
Verification
Post reply
Community
General Tabletop Discussion
*Dungeons & Dragons
"The Future of D&D" (New Core Books in 2024!)
Top