Menu
News
All News
Dungeons & Dragons
Level Up: Advanced 5th Edition
Pathfinder
Starfinder
Warhammer
2d20 System
Year Zero Engine
Industry News
Reviews
Dragon Reflections
White Dwarf Reflections
Columns
Weekly Digests
Weekly News Digest
Freebies, Sales & Bundles
RPG Print News
RPG Crowdfunding News
Game Content
ENterplanetary DimENsions
Mythological Figures
Opinion
Worlds of Design
Peregrine's Nest
RPG Evolution
Other Columns
From the Freelancing Frontline
Monster ENcyclopedia
WotC/TSR Alumni Look Back
4 Hours w/RSD (Ryan Dancey)
The Road to 3E (Jonathan Tweet)
Greenwood's Realms (Ed Greenwood)
Drawmij's TSR (Jim Ward)
Community
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Resources
Wiki
Pages
Latest activity
Media
New media
New comments
Search media
Downloads
Latest reviews
Search resources
EN Publishing
Store
EN5ider
Adventures in ZEITGEIST
Awfully Cheerful Engine
What's OLD is NEW
Judge Dredd & The Worlds Of 2000AD
War of the Burning Sky
Level Up: Advanced 5E
Events & Releases
Upcoming Events
Private Events
Featured Events
Socials!
EN Publishing
Twitter
BlueSky
Facebook
Instagram
EN World
BlueSky
YouTube
Facebook
Twitter
Twitch
Podcast
Features
Top 5 RPGs Compiled Charts 2004-Present
Adventure Game Industry Market Research Summary (RPGs) V1.0
Ryan Dancey: Acquiring TSR
Q&A With Gary Gygax
D&D Rules FAQs
TSR, WotC, & Paizo: A Comparative History
D&D Pronunciation Guide
Million Dollar TTRPG Kickstarters
Tabletop RPG Podcast Hall of Fame
Eric Noah's Unofficial D&D 3rd Edition News
D&D in the Mainstream
D&D & RPG History
About Morrus
Log in
Register
What's new
Search
Search
Search titles only
By:
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Menu
Log in
Register
Install the app
Install
Community
Meta - Forums About Forums
Meta
ENnies voting methodology
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="anonystu" data-source="post: 998810" data-attributes="member: 10897"><p>Monte posted in a rave this morning about the ENnies:</p><p></p><p>People point out that the drawback is that you can vote 10 for your favorite product and 1 for all the rest, skewing the vote. I don't think that will actually be too much of a problem -- and it's something the moderators can watch for, in any case. The potential problem that I see is that the system favors products with fewer votes. For instance, a product that gets 99 votes of 7 and one vote of 8 receives an average rating of 7.01, which beats out a product that gets 5,000 votes of 7, generating an average of a straight 7. (Again, this assumes my understanding of the process is correct.) But that's only a potential scenario.</p><p></p><p>I posted in return on that message board:</p><p></p><p>Monte makes a very good point that the system may not account for different numbers of votes, but this is easily rectified by using a bayesian estimate, the system that you've most likely run into as the system that the IMDB uses to determine what the top-user-rated movies of all time are:</p><p></p><p>Check out this, for a not too technical explanation:</p><p></p><p><a href="http://www.wowwebdesigns.com/formula.php" target="_blank">www.wowwebdesigns.com/formula.php</a></p><p></p><p>The technique is quite simple to explain: entries with low amount of votes are pulled towards the mean, because you should be less confident that those are representative of true preference, instead of just random sampling.</p><p></p><p>It's a quite easy solution to that issue: I'll email Morrus about it, but hey, you can talk to him too! I don't think this is a change that should happen this year: switching voting schemes mid-vote is as shady as it comes, but it's a good thing going forward.</p><p></p><p></p><p>So are the ENnies using a bayesian estimate formula to determine the winners? What do people think of switching to this method if it's not being used?</p></blockquote><p></p>
[QUOTE="anonystu, post: 998810, member: 10897"] Monte posted in a rave this morning about the ENnies: People point out that the drawback is that you can vote 10 for your favorite product and 1 for all the rest, skewing the vote. I don't think that will actually be too much of a problem -- and it's something the moderators can watch for, in any case. The potential problem that I see is that the system favors products with fewer votes. For instance, a product that gets 99 votes of 7 and one vote of 8 receives an average rating of 7.01, which beats out a product that gets 5,000 votes of 7, generating an average of a straight 7. (Again, this assumes my understanding of the process is correct.) But that's only a potential scenario. I posted in return on that message board: Monte makes a very good point that the system may not account for different numbers of votes, but this is easily rectified by using a bayesian estimate, the system that you've most likely run into as the system that the IMDB uses to determine what the top-user-rated movies of all time are: Check out this, for a not too technical explanation: [url]www.wowwebdesigns.com/formula.php[/url] The technique is quite simple to explain: entries with low amount of votes are pulled towards the mean, because you should be less confident that those are representative of true preference, instead of just random sampling. It's a quite easy solution to that issue: I'll email Morrus about it, but hey, you can talk to him too! I don't think this is a change that should happen this year: switching voting schemes mid-vote is as shady as it comes, but it's a good thing going forward. So are the ENnies using a bayesian estimate formula to determine the winners? What do people think of switching to this method if it's not being used? [/QUOTE]
Insert quotes…
Verification
Post reply
Community
Meta - Forums About Forums
Meta
ENnies voting methodology
Top