Are reviewers evil?

Status
Not open for further replies.
This whole topic reminds me of a very similiar situation with Avalanche some months back where reviewers were taken completely out of context. The points and arguments brought up there did nothing to alter how Avalanche conducts its business.

The fact remains that in all likelihood, Jim Ward will not change his beliefs nor will he make any kind of statement admitting that his emotions got the best of him. And unless FFE's books begin to improve in quality, he will continue to see average reviews (or less than average) here and on other review sites.
 

log in or register to remove this ad

WizarDru said:
Playtesting also presents another challenge to reviewers. Even the most cursory of glances at the messageboards here will reveal that different gamers prefer different styles. Joshua Dyal, for example, prefers a radically different game than I do. Even if we use no house-rules and purely core material, we still have differences between games. Is magic plentiful, and are items purchasable in shops? Does your DM favor classed-NPCs over monsters? The list goes on and on.

Agreed -- Or at least the RPGnet forums will agree!

I've read RPGnet review forum comments that criticized a reviewer if he playtested a product. But WizarDru is right. Robin Law's Guide to Good Gamemastering says that 70% of one's roleplaying experience is the group, only 30% the rules. That would also support WD's argument.


Cedric.
aka. Washu! ^O^
 

DocMoriartty said:
Do you realize what you are saying? You are saying he needed examples to support his arguement. So the only way he could get examples is the take quotes out of context.

Doc, I realize what I am saying. Apparently, I didn't say it well enough, though, as you don't seem to quite understand.

Nowhere do I say the only way to get examples was taking quotes out of context. I didn't even say he did it well. All I said that while he did do it, the fact that he did doesn't make it an attack, and there's at least one plausible reason for his approach.

So, I think there's a valid criticism of the essay in saying that he did a poor job of following his own rules. He could have taken quotes that were from pieces that more clearly committed the crime. He could have given a bit larger hunk to show that this was the case. Call him sloppy or lazy, sure. But don't stoop to calling him dishonest or attacking based upon circumstantial evidence. It's unprofessional, unnecessary, and unproductive.
 
Last edited:

Umbran said:


Doc, I realize what I am saying. Apparently, I didn't say it well enough, though, as you don't seem to quite understand.

Nowhere do I say the only way to get examples was taking quotes out of context. I didn't even say he did it well. All I said that while he did do it, the fact that he did doesn't make it an attack, and there's at least one plausible reason for his approach.

So, I think there's a valid criticism of the essay in saying that he did a poor job of following his own rules. He could have taken quotes that were from pieces that more clearly committed the crime. He could have given a bit larger hunk to show that this was the case. Call him sloppy or lazy, sure. But don't stoop to calling him dishonest or attacking based upon circumstantial evidence. It's unprofessional, unnecessary, and unproductive.


He rants for an entire article about horrible reviews that slander his product.

Then the ONLY examples that he gives that we can verify as from real reviews are quotes taken out of context from a good review that didnt even do what he was ranting about,

That is dishonest plain and simple whether or not you give him the benefit of the doubt.
 

Actual professional videogame critics do spend quite a bit of time with the games they are reviewing and most do their job because of the obvious benefit: they love playing videogames and they get to do it for a living. I've met maybe three professional game reviewers in the past six years who were obviously in it for the status or free stuff or other "fringe" benefits.

This is true of the better reviewers. In print, where I think the standards are higher, there are more good reviewers than bad reviewers. Though, one of those calls for the "invulnerable cheat" was from a major magazine of that era. (They apparently subcontracted out to reviewers with specialities in certain genres? This guy was not on-location in any case, even if he was technically part of the staff. And this was a major review, not one of the filler B-titles that are used to puff up a slow month.)

(Also, I've got to point out here though that print magazines have a long lead time, they're written perhaps three months before they hit the stands? (You know better than I do.) Anyway, this means that the reviewers are playing versions of the games that are far from complete, especially as schedules get shorter in the development industry. Theres not as much "love" involved in playing a pre-Alpha build of a game you may not even be that excited about. That's when you have to be "professional" as a reviewer.)

So, I'm going to agree with your first statement, just with the caveats above.

I'd agree with your second statement too. I really am more concerned with the idea that the marketing departments of the major game companies know how to play both individual reviewers and entire entities like magazines and websites than the idea that certain reviewers are corrupt. I agree that openly corrupted major reviewers are very rare.

But there are a lot of influences brought to bear even on the print media that I think people outside the industry are not aware of. Exclusives were a big incentive back when I was in the business, for instance and so were Previews. Like it or not, there was a certain quid-pro-quo involved here. I can't speak to how the magazines viewed this relationship, but I can say how the marketing departments viewed it and I can also give my opinion that certain major magazines appeared to succumb to the pressure and give very few bad reviews to major publishers.

Anyway, this was all a long way of saying that I've seen a bit of the review business and there's more to it than meets the eye. Thats not to say that there arent a lot of professionals out there, and a lot of non-professionals who are purely doing reviews because they love the industry. I stress that fact. And then I stress it again, because its too easy to look at the negative things I am saying and take them as my whole message. ;-)
 

I think it's pretty clear that Jim Ward takes the reviews very personally. On the FFE message boards, I have seem him classify reviews/opionons he disagrees with as "stupid".

I think the reviews for his products, however, are accurate.

FFE has continually produced sub-par material. There are some good ideas, but the execution has been very poor.

What Jim doesn't seem to realize, is that there are very few reviewers who have any sort of grudge against FFE (although his latest comments won't help any). In fact, I would submit that if FFE began producing high quality material, this controversy would disappear. As a gamer, I *want* FFE to produce great products. The talent at FFE (at least based on their work prior to FFE) is phenomenal, and they should be putting out some really fine stuff. The reviews could be helpful to Jim, if he'd get over himself.

To PSION - I don't always agree with your reviews, but I very much appreciate the time you spend for the benefit of EN world readers to do what you do. Your reviews are well thought out, and never malicious. Keep doing what you're doing, and try not to let it get under your skin. Jim Ward takes things very personally, and he has shown publicly that he is unable to take criticism. Take the high road and move on.
 

DocMoriartty said:
He rants for an entire article about horrible reviews that slander his product.

Wow. Did we read the same article? Because I don't see him ranting. Never do I see the term (or even the intimation of) slander. The article I read was, for the most part, impersonal and generic advice on what ought to go into a review, not a diatribe against people who did him wrong.
 
Last edited:

reiella said:
Slight error in thought there.

Many Computer Game reviewers will actually only play a short segment of a game before sending out a review. Usually around 2 hours, with one mainstream internet game reporting agency requiring only 30 minutes. Now if it's a particularly "long game" it may get more, but the 140 hr+ testing practically only happens with Fan Reviews on a cult game classic a few monthes after release.

Same goes for most book reviewers. They'll read the first few pages, some of the middle, and the last chapter. Then they'll read a 2 or 3 reviews from other sources (magazines, web, whatever). They they'll write their "own" review.

That's one big reason why so many reviewers rank products similarly. No one wants to be a dissenting voice; everyone is reading each others' work. Groupthink is very common.

It's all about volume. If you're paid on a per-review basis, you're pretty motivated to crank out reviews as fast as possible.

Also: I dispute the author's claim that a reviewer has to actually playtest a product before offering up a review. Sure, in some cases one needs to really dig into a product. But in other cases you're able to tell at a glance whether something will work or suck. I didn't have to watch Kangaroo Jack to know that it is a cruddy movie. ;)

-z
 
Last edited:

Umbran said:

Nowhere do I say the only way to get examples was taking quotes out of context. I didn't even say he did it well. All I said that while he did do it, the fact that he did doesn't make it an attack, and there's at least one plausible reason for his approach.

So then he did take quotes out of their context and used those quotes in ways that distort the quoted writer's entire review and/or the writer's practices as a reviewer. But, to be fair, you're right. Off the top of my head, I can think of four plausible reasons why Mr. Ward (or anyone else) would do these things:

1. Malice.
2. Ignorance.
3. Carelessness.
4. Dishonesty.

All of those are quite plausible. What they are not is defensible because, regardless of reason or intention, the end result is the distortion of the truth. IOW, the end result is a lie resulting from either an act of commission or of omission.

It is also indefensible to quote a writer and not attribute the quotation to the writer or at least make an honest attempt to provide a source for the quotation.

I for one prefer to follow one of Napoleon's maxims: Never attribute to malice that which can be explained by stupidity.
 


Status
Not open for further replies.
Remove ads

Top