Menu
News
All News
Dungeons & Dragons
Level Up: Advanced 5th Edition
Pathfinder
Starfinder
Warhammer
2d20 System
Year Zero Engine
Industry News
Reviews
Dragon Reflections
White Dwarf Reflections
Columns
Weekly Digests
Weekly News Digest
Freebies, Sales & Bundles
RPG Print News
RPG Crowdfunding News
Game Content
ENterplanetary DimENsions
Mythological Figures
Opinion
Worlds of Design
Peregrine's Nest
RPG Evolution
Other Columns
From the Freelancing Frontline
Monster ENcyclopedia
WotC/TSR Alumni Look Back
4 Hours w/RSD (Ryan Dancey)
The Road to 3E (Jonathan Tweet)
Greenwood's Realms (Ed Greenwood)
Drawmij's TSR (Jim Ward)
Community
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Resources
Wiki
Pages
Latest activity
Media
New media
New comments
Search media
Downloads
Latest reviews
Search resources
EN Publishing
Store
EN5ider
Adventures in ZEITGEIST
Awfully Cheerful Engine
What's OLD is NEW
Judge Dredd & The Worlds Of 2000AD
War of the Burning Sky
Level Up: Advanced 5E
Events & Releases
Upcoming Events
Private Events
Featured Events
Socials!
EN Publishing
Twitter
BlueSky
Facebook
Instagram
EN World
BlueSky
YouTube
Facebook
Twitter
Twitch
Podcast
Features
Top 5 RPGs Compiled Charts 2004-Present
Adventure Game Industry Market Research Summary (RPGs) V1.0
Ryan Dancey: Acquiring TSR
Q&A With Gary Gygax
D&D Rules FAQs
TSR, WotC, & Paizo: A Comparative History
D&D Pronunciation Guide
Million Dollar TTRPG Kickstarters
Tabletop RPG Podcast Hall of Fame
Eric Noah's Unofficial D&D 3rd Edition News
D&D in the Mainstream
D&D & RPG History
About Morrus
Log in
Register
What's new
Search
Search
Search titles only
By:
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Menu
Log in
Register
Install the app
Install
Community
Meta - Forums About Forums
Meta
Redesigning the Reviews Page
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="Psion" data-source="post: 37670" data-attributes="member: 172"><p><strong>Making my case</strong></p><p></p><p></p><p></p><p><em>If you had seen what my eyes have seen...</em></p><p></p><p>Ahem... I really think I need to make my case here. I think that if you don't do something like weight the reviews, the average system suffers.</p><p></p><p>There have been times that people have posted a review and someone has decided that they disagree with the ratings and are sign up just so they can contradict the review they don't like, and they assign it the most extreme score that they can (a 1 or a 5). This compromises the fairness of the system, because the "reactive" score give is not out of an honest assessment of what they think the product is worth, but an attempt to annul the review that they didn't agree with and to bump the average in the direction they want to. I have seen this multiple times.</p><p></p><p>I understand what you are getting at by saying people can write more reviews but not good reviews. However, that is why I suggested using the root of the number of reviews as a baseline. You get little payoff by just writing 2 or 3 extra reviews just to get your point across about one, so as a result it would discourage this sort of reactive behavior... or at least lessen its effects. If more products got more reviews, it might not matter, since it would all average out. But there are really not that many reviews on a lot of products, so I think some artifical compensation is warranted.</p><p></p><p>Okay, on another note... I recommened earlier that you could half the weight of the highest and lowest review. I think Charles' idea of using the root(mean*median) acheives much of the same thing but would be easier to program since you don't have to worry about the sticky issue of how it related to the weighting system I recommended above.</p><p></p><p></p><p></p><p>I think number of reviews is a simpler metric, and will be sufficient to address the syndrome that I am worried about.</p></blockquote><p></p>
[QUOTE="Psion, post: 37670, member: 172"] [b]Making my case[/b] [i]If you had seen what my eyes have seen...[/i] Ahem... I really think I need to make my case here. I think that if you don't do something like weight the reviews, the average system suffers. There have been times that people have posted a review and someone has decided that they disagree with the ratings and are sign up just so they can contradict the review they don't like, and they assign it the most extreme score that they can (a 1 or a 5). This compromises the fairness of the system, because the "reactive" score give is not out of an honest assessment of what they think the product is worth, but an attempt to annul the review that they didn't agree with and to bump the average in the direction they want to. I have seen this multiple times. I understand what you are getting at by saying people can write more reviews but not good reviews. However, that is why I suggested using the root of the number of reviews as a baseline. You get little payoff by just writing 2 or 3 extra reviews just to get your point across about one, so as a result it would discourage this sort of reactive behavior... or at least lessen its effects. If more products got more reviews, it might not matter, since it would all average out. But there are really not that many reviews on a lot of products, so I think some artifical compensation is warranted. Okay, on another note... I recommened earlier that you could half the weight of the highest and lowest review. I think Charles' idea of using the root(mean*median) acheives much of the same thing but would be easier to program since you don't have to worry about the sticky issue of how it related to the weighting system I recommended above. I think number of reviews is a simpler metric, and will be sufficient to address the syndrome that I am worried about. [/QUOTE]
Insert quotes…
Verification
Post reply
Community
Meta - Forums About Forums
Meta
Redesigning the Reviews Page
Top