Menu
News
All News
Dungeons & Dragons
Level Up: Advanced 5th Edition
Pathfinder
Starfinder
Warhammer
2d20 System
Year Zero Engine
Industry News
Reviews
Dragon Reflections
White Dwarf Reflections
Columns
Weekly Digests
Weekly News Digest
Freebies, Sales & Bundles
RPG Print News
RPG Crowdfunding News
Game Content
ENterplanetary DimENsions
Mythological Figures
Opinion
Worlds of Design
Peregrine's Nest
RPG Evolution
Other Columns
From the Freelancing Frontline
Monster ENcyclopedia
WotC/TSR Alumni Look Back
4 Hours w/RSD (Ryan Dancey)
The Road to 3E (Jonathan Tweet)
Greenwood's Realms (Ed Greenwood)
Drawmij's TSR (Jim Ward)
Community
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Resources
Wiki
Pages
Latest activity
Media
New media
New comments
Search media
Downloads
Latest reviews
Search resources
EN Publishing
Store
EN5ider
Adventures in ZEITGEIST
Awfully Cheerful Engine
What's OLD is NEW
Judge Dredd & The Worlds Of 2000AD
War of the Burning Sky
Level Up: Advanced 5E
Events & Releases
Upcoming Events
Private Events
Featured Events
Socials!
EN Publishing
Twitter
BlueSky
Facebook
Instagram
EN World
BlueSky
YouTube
Facebook
Twitter
Twitch
Podcast
Features
Top 5 RPGs Compiled Charts 2004-Present
Adventure Game Industry Market Research Summary (RPGs) V1.0
Ryan Dancey: Acquiring TSR
Q&A With Gary Gygax
D&D Rules FAQs
TSR, WotC, & Paizo: A Comparative History
D&D Pronunciation Guide
Million Dollar TTRPG Kickstarters
Tabletop RPG Podcast Hall of Fame
Eric Noah's Unofficial D&D 3rd Edition News
D&D in the Mainstream
D&D & RPG History
About Morrus
Log in
Register
What's new
Search
Search
Search titles only
By:
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Menu
Log in
Register
Install the app
Install
Community
General Tabletop Discussion
*TTRPGs General
ENnies discussion thread
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="Umbran" data-source="post: 2060092" data-attributes="member: 177"><p>I gave teh extreme example as illustration of the pioint. The exact situation might not happen, something similar might. Specifically, the system you describe can easily find a winner without consensus of the voting populace. And if you want consensus, your Approval Voting system has no way to find it without having people go back to the ballot box.</p><p></p><p></p><p></p><p>Yes, but that's meaningless unless we know what they're using it for. If the application isn't the same, the endorsement means little. The Hugo and Nebula awards use IRV, for purposes very similar to ours, and those communities are also filled with mathematicians and tech-heads <img src="https://cdn.jsdelivr.net/joypixels/assets/8.0/png/unicode/64/1f642.png" class="smilie smilie--emoji" loading="lazy" width="64" height="64" alt=":)" title="Smile :)" data-smilie="1"data-shortname=":)" /></p><p></p><p>I'm taking a couple of things out of order here, because it's a better way to get at the crux of the matter...</p><p></p><p></p><p></p><p>It is statements like this that give truth to the old saw that "there's lies, damned lies, and statistics". In statistics, what is or is not perfectly acceptable actually depends upon the application. Why you want the numbers should influence what methods you use.</p><p> </p><p>For a marketing firm polling to get the public's opinion before designing an ad campaign, the prior assessments are useful tools. However, I feel they are contrary to our goals with an awards program.</p><p></p><p></p><p></p><p>Well, now we run into a problem...</p><p></p><p>Personally, I think the judges already have a lot of input, and we shouldn't have the voters depending upon the judges even more in making their votes.</p><p></p><p>However, given that you already known somehting about the product through the judges, it becomes even more unfair to assume that an unknown is better than a known. After all, the judges chose this product that you detest, didn't they? That means that the other products they choose could likely be equally detestable. Given that the judges made one "bad" choice", you shouldn't assume that all their others are good ones.</p><p></p><p></p><p></p><p>It isn't as if it's that simple.</p><p></p><p>In the end, what we want is a system that allows reasonable abstention. That would be most fair. For that, the numeric ranking system is actually preferrable, if you could depnd upon the voters to not try to finesse the system.</p><p></p><p>Your approval voting only allows two options for dealing with unknowns - either they are as good as the best known, or they are as bad as the worst known. There are no other options. Neither is really fair, and your ranking of unknowns is taken into account at the same time and with equal weight as the ranking of knows. </p><p></p><p>Consider, though, with IRV, that an abstention isn't quite as bad as you think, especially with a null or "no prize" option. IRV has leeway. If you know a given product, and think it is good enough to give a prize, you get to vote for it. The system doesn't get to your abstentions (or even your low-rankings) until after it has tried to count every single preference you had above that. What you chose to do with the unknowns may never be seen at all, if the contest is decided before they are reached. Thus, the opinions about unknowns are left out unless the race is particularly difficult. </p><p></p><p>And, in IRV, the voter does still have the option to rank an unknown over a known, if they really want to do so. But if they rank that bad known last, the unknown can still be fairly low, too, rather than as equal to the best thing out there. IRV allows some of the benefits of numeric ratings, while doing away with most of the weakness to finesse votes, while not forcing voters to vote on unknowns as equivalent to knowns.</p><p></p><p>Of course, this is more difficult to implement. In order to get the best of both worlds, you sometimes have to do a little more work.</p></blockquote><p></p>
[QUOTE="Umbran, post: 2060092, member: 177"] I gave teh extreme example as illustration of the pioint. The exact situation might not happen, something similar might. Specifically, the system you describe can easily find a winner without consensus of the voting populace. And if you want consensus, your Approval Voting system has no way to find it without having people go back to the ballot box. Yes, but that's meaningless unless we know what they're using it for. If the application isn't the same, the endorsement means little. The Hugo and Nebula awards use IRV, for purposes very similar to ours, and those communities are also filled with mathematicians and tech-heads :) I'm taking a couple of things out of order here, because it's a better way to get at the crux of the matter... It is statements like this that give truth to the old saw that "there's lies, damned lies, and statistics". In statistics, what is or is not perfectly acceptable actually depends upon the application. Why you want the numbers should influence what methods you use. For a marketing firm polling to get the public's opinion before designing an ad campaign, the prior assessments are useful tools. However, I feel they are contrary to our goals with an awards program. Well, now we run into a problem... Personally, I think the judges already have a lot of input, and we shouldn't have the voters depending upon the judges even more in making their votes. However, given that you already known somehting about the product through the judges, it becomes even more unfair to assume that an unknown is better than a known. After all, the judges chose this product that you detest, didn't they? That means that the other products they choose could likely be equally detestable. Given that the judges made one "bad" choice", you shouldn't assume that all their others are good ones. It isn't as if it's that simple. In the end, what we want is a system that allows reasonable abstention. That would be most fair. For that, the numeric ranking system is actually preferrable, if you could depnd upon the voters to not try to finesse the system. Your approval voting only allows two options for dealing with unknowns - either they are as good as the best known, or they are as bad as the worst known. There are no other options. Neither is really fair, and your ranking of unknowns is taken into account at the same time and with equal weight as the ranking of knows. Consider, though, with IRV, that an abstention isn't quite as bad as you think, especially with a null or "no prize" option. IRV has leeway. If you know a given product, and think it is good enough to give a prize, you get to vote for it. The system doesn't get to your abstentions (or even your low-rankings) until after it has tried to count every single preference you had above that. What you chose to do with the unknowns may never be seen at all, if the contest is decided before they are reached. Thus, the opinions about unknowns are left out unless the race is particularly difficult. And, in IRV, the voter does still have the option to rank an unknown over a known, if they really want to do so. But if they rank that bad known last, the unknown can still be fairly low, too, rather than as equal to the best thing out there. IRV allows some of the benefits of numeric ratings, while doing away with most of the weakness to finesse votes, while not forcing voters to vote on unknowns as equivalent to knowns. Of course, this is more difficult to implement. In order to get the best of both worlds, you sometimes have to do a little more work. [/QUOTE]
Insert quotes…
Verification
Post reply
Community
General Tabletop Discussion
*TTRPGs General
ENnies discussion thread
Top