Menu
News
All News
Dungeons & Dragons
Level Up: Advanced 5th Edition
Pathfinder
Starfinder
Warhammer
2d20 System
Year Zero Engine
Industry News
Reviews
Dragon Reflections
White Dwarf Reflections
Columns
Weekly Digests
Weekly News Digest
Freebies, Sales & Bundles
RPG Print News
RPG Crowdfunding News
Game Content
ENterplanetary DimENsions
Mythological Figures
Opinion
Worlds of Design
Peregrine's Nest
RPG Evolution
Other Columns
From the Freelancing Frontline
Monster ENcyclopedia
WotC/TSR Alumni Look Back
4 Hours w/RSD (Ryan Dancey)
The Road to 3E (Jonathan Tweet)
Greenwood's Realms (Ed Greenwood)
Drawmij's TSR (Jim Ward)
Community
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions, OSR, & D&D Variants
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Resources
Wiki
Pages
Latest activity
Media
New media
New comments
Search media
Downloads
Latest reviews
Search resources
EN Publishing
Store
EN5ider
Adventures in ZEITGEIST
Awfully Cheerful Engine
What's OLD is NEW
Judge Dredd & The Worlds Of 2000AD
War of the Burning Sky
Level Up: Advanced 5E
Events & Releases
Upcoming Events
Private Events
Featured Events
Socials!
EN Publishing
Twitter
BlueSky
Facebook
Instagram
EN World
BlueSky
YouTube
Facebook
Twitter
Twitch
Podcast
Features
Top 5 RPGs Compiled Charts 2004-Present
Adventure Game Industry Market Research Summary (RPGs) V1.0
Ryan Dancey: Acquiring TSR
Q&A With Gary Gygax
D&D Rules FAQs
TSR, WotC, & Paizo: A Comparative History
D&D Pronunciation Guide
Million Dollar TTRPG Kickstarters
Tabletop RPG Podcast Hall of Fame
Eric Noah's Unofficial D&D 3rd Edition News
D&D in the Mainstream
D&D & RPG History
About Morrus
Log in
Register
What's new
Search
Search
Search titles only
By:
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions, OSR, & D&D Variants
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Menu
Log in
Register
Install the app
Install
Upgrade your account to a Community Supporter account and remove most of the site ads.
Community
General Tabletop Discussion
*TTRPGs General
Statistically Proving Bad Luck (Help Appreciated)
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="dok" data-source="post: 1018905" data-attributes="member: 12780"><p><strong>The illusions of probability</strong></p><p></p><p>I have some bad news for you, friend. Actually, bad news both ways...</p><p></p><p>The first piece of bad news is that you can conduct statistical analysis on a sample of practically any size. In fact, once your sample size exceeds 30, it becomes pretty routine to anyone who knows the numbers. </p><p></p><p>By the way, you'll need more than just the mean, median & mode. If you really want someone to help you, you'll need to post not only those numbers, but also the total number of trials, and the standard deviation & variance of the set. It'd also help to have the upper & lower quartiles. (I'll come back to this last line later)</p><p></p><p></p><p>In terms of "controls", for this situation, I'd say simply record every d20 roll you make, regardless of the situaiton or which d20 you use. Since you're in a d20 system game, high is good & low is bad, so there's no fancy record keeping. Just have a notepad with 20 boxes, and put a hash in the appropriate box after each die roll. </p><p></p><p>Here's where the second piece of bad news comes in: </p><p>All the statistical analysis will tell you is whether or not the results you've experienced lie within the "probable" range of possible outcomes. And I'm fairly confident that it will.</p><p></p><p>This is the biggest mis-conception people have about statistics. Statistics apply over <strong>huge</strong> sets. There's an old saw about a health worker coming into a resteraunt kitchen & telling them they can't serve a four-egg omlet because according to the USDA, one in four eggs contains salmonella bacteria. You chuckle, but let me give you another example:</p><p></p><p>The 'double-20-confirm-kill' rules variant says if you roll a '20', and roll a second '20' on your confirmation roll, and roll a confirmed hit on a third roll, you kill your foe instantly. Most people, when considering this rule, think "The odds of even rolling for an instant kill is 1:400, so this seems like an OK rule." Here's where probability & statistics part ways. The odds of any single attack threatening an instant kill are 1:400. However, a random sample of 400 die rolls only has around a 50% chance of containing one or more instant kill threats. </p><p></p><p>You're suffering from what statistics teachers like to call "Gambler's fallacy". It's the notion that any kind of short term results must mirror the population distribution. Normally, the example is "I've lost six hands in a row. I'm overdue to have a winning hand!" In this case, you've reversed the assumption: because your data set has a low mode (and an average median and we don't know the mean), that the "population" of your dice rolls overall must be similar. ("I'm unlucky")</p><p></p><p></p><p>Remember how I mentioned the upper & lower quartiles being needed along with the median? That's to identify possible outliers, or unusual elements of the data set. Odds are, (forgive the phrase, please) that the range of 1.5 * (3rd quartile - 1st quartile) is larger than 1-20. Which means that every die roll is relevant; in other words, rolling higher than a '15' is not a fluke for you.</p><p></p><p>Here's my prediction. Post the statistical data: Sample size, mean, variance, & standard deviation. Then either you or someone else figure out what the interval is for the population mean with a margin of error of +0.15%, (That's +/- 3 SD for any statistics buffs out there) and what the confidence level is. I'll bet money that the true population mean of 10.5 lies inside that range.</p></blockquote><p></p>
[QUOTE="dok, post: 1018905, member: 12780"] [b]The illusions of probability[/b] I have some bad news for you, friend. Actually, bad news both ways... The first piece of bad news is that you can conduct statistical analysis on a sample of practically any size. In fact, once your sample size exceeds 30, it becomes pretty routine to anyone who knows the numbers. By the way, you'll need more than just the mean, median & mode. If you really want someone to help you, you'll need to post not only those numbers, but also the total number of trials, and the standard deviation & variance of the set. It'd also help to have the upper & lower quartiles. (I'll come back to this last line later) In terms of "controls", for this situation, I'd say simply record every d20 roll you make, regardless of the situaiton or which d20 you use. Since you're in a d20 system game, high is good & low is bad, so there's no fancy record keeping. Just have a notepad with 20 boxes, and put a hash in the appropriate box after each die roll. Here's where the second piece of bad news comes in: All the statistical analysis will tell you is whether or not the results you've experienced lie within the "probable" range of possible outcomes. And I'm fairly confident that it will. This is the biggest mis-conception people have about statistics. Statistics apply over [b]huge[/b] sets. There's an old saw about a health worker coming into a resteraunt kitchen & telling them they can't serve a four-egg omlet because according to the USDA, one in four eggs contains salmonella bacteria. You chuckle, but let me give you another example: The 'double-20-confirm-kill' rules variant says if you roll a '20', and roll a second '20' on your confirmation roll, and roll a confirmed hit on a third roll, you kill your foe instantly. Most people, when considering this rule, think "The odds of even rolling for an instant kill is 1:400, so this seems like an OK rule." Here's where probability & statistics part ways. The odds of any single attack threatening an instant kill are 1:400. However, a random sample of 400 die rolls only has around a 50% chance of containing one or more instant kill threats. You're suffering from what statistics teachers like to call "Gambler's fallacy". It's the notion that any kind of short term results must mirror the population distribution. Normally, the example is "I've lost six hands in a row. I'm overdue to have a winning hand!" In this case, you've reversed the assumption: because your data set has a low mode (and an average median and we don't know the mean), that the "population" of your dice rolls overall must be similar. ("I'm unlucky") Remember how I mentioned the upper & lower quartiles being needed along with the median? That's to identify possible outliers, or unusual elements of the data set. Odds are, (forgive the phrase, please) that the range of 1.5 * (3rd quartile - 1st quartile) is larger than 1-20. Which means that every die roll is relevant; in other words, rolling higher than a '15' is not a fluke for you. Here's my prediction. Post the statistical data: Sample size, mean, variance, & standard deviation. Then either you or someone else figure out what the interval is for the population mean with a margin of error of +0.15%, (That's +/- 3 SD for any statistics buffs out there) and what the confidence level is. I'll bet money that the true population mean of 10.5 lies inside that range. [/QUOTE]
Insert quotes…
Verification
Post reply
Community
General Tabletop Discussion
*TTRPGs General
Statistically Proving Bad Luck (Help Appreciated)
Top