So why don't reviews work? (as a marketing tool)

trancejeremy

Adventurer
Seeing the recent sell off of d20 backstock by a lot of the remaining d20 companies got me thinking, I was greatly amused at how they don't mind selling them for $2 (or so each), but are loathe to send out review copies (which would really only cost them shipping and probably be tax deductible).

A few years ago, after I had something like 100 reviews under my belt, I approached just about every d20 company around (and a few others) asking to be considered for review copies. The only responses I ever got was a rather rude brush off from one company, and another mention that they found it wasn't worth the effort. Something that I think the Green Ronin guy and Monte Cook have echoed. (And I would note, I have been sent quite a few review copies from some companies, most of those were unsolicited by me (exception being Bastion). So don't think I'm knocking them. Just curious)

They're probably right (though it still amuses me to see them dump their back stocks so cheaply, at those prices it seems like even if a review had sold 1-2 copies at full price it would be worth it). But why is that RPG reviews don't have more of an impact on sales?


In videogames, reviews are quite important. At least one certain sites, fans place great importance on them, not buying a game if so and such magazine doesn't give them a high enough score. Apparently it's even worked into contracts, if a game gets a aggregate rating of X on gamerankings or metacritic, they get a bonus. There was just a mini-scandal where a reviewer for Gamespot may or may not have been fired for giving a game which had been heavily advertised on the site, a low score.


Low readership? ENWorld doesn't have stats, but RPG.net does. Usually reviews range from 500 (for a small press game or PDF) to 5000 (for a WOTC/WW product).


Lack of reviewer credibility?
I know John Cooper has always impressed me, especially with his technical knowledge of d20. But for the most part, I don't think most others (including me) stand out much. (Not to say bad, but simply mostly generic). I think Monte Cook has also remarked on the unremarkable quality of review writing.

Just the nature of RPG reviews? I mean, unlike game reviews, a lot of RPG reviews are done just by reading the book, not playing it. But that often simply can't be helped. With sourcbooks you'd have to run a campaign that allowed you to simply drop in new classes/monsters/rules at a moments notice. And adventures can take weeks or months to run.

Lead in time? It takes about 2 weeks at the earliest to write a review of the product, probably a month, then at RPG.net at least, a week or two to get it posted. But if the first month is when most sales come, then obviously it's too late. (On a few occasions, I have been sent manuscripts of products, so I could get the review done around release date),

At the same time, the reverse is almost true of review hits (based on RPG.net). You get a pretty decent initial burst the first week. But after that, maybe 100-200 hits more per month fairly steadily (which make me wonder if it's bots or something, actually)
 
Last edited:

log in or register to remove this ad

I don't know. Personally I generally use reviews for things that have already caught my attention that I am considering buying at the moment.

Usually along the lines of "I've been eyeing this for a while and it is on sale now. Let me see the reviews to further inform my decision on whether to actually get it or not." or even "Hmm, this company has everything on sale, this one looks like it might be interesting, I wonder what others have said about it."

I would say reviews have tipped me towards buying some things and away from buying others but probably also not been a factor a good number of times.
 


Part of it is simply going to be the number and nature of outlets for the reviews.

My primary source of advise on game quality was always word of mouth from people I knew personally. Sure, I might look at a game a stranger mentioned, but that's about the extent of it.

At the "pro" level, I always enjoyed reviews in various sources, but with the demise of so many (print versions of) magazines catering to the RPG hobby, the number of outlets for reviews that I personally read now is down to 1 or 2. I read KotDT and the reviews within, and the occasional review here at EN World.

Not everyone out there likes scouring the internet for product reviews at gaming sites, and the reviews on sites like Amazon are really not worth the time.
 

One issues is there is rarely a direct link to reviews and people buying a book. Even if a review a wrote is directly responsible for a thousand people buying a book unless each of them tells the publisher no one would ever know it.
 

That is why so many publishers (of various kind) include customer feedback cards with their products, which often include a question along the lines of "How did you hear about our product?"
 


trancejeremy said:
Lack of reviewer credibility?
With me this is part of it. I find that reviewers tend to be very biased in the hobby game industry. Sometimes it's a personal hang-up that, to me, means the reviewer was so hung up on his peeves that the book wasn't given a fair shot. One common example is there are a lot of reviews plainly done from a "WotC bites" or "WotC rocks" POV.

I know John Cooper has always impressed me, especially with his technical knowledge of d20.
A perfect example of my point. I don't care that they missed 3 skill points in stat block B. It's not relevant to the play experience, and John's focus on this makes me feel that I really can't see us having significant common ground.

To tell the truth, I scan the reviews for a product when I'm on the fence (or used to, when ENWorld had regular reviews and a better interface). However, I really want a selection of professional reviewers. When it comes to movies I discovered that Roger Ebert taste isn't too far off from mine. The reviewer in the local paper doesn't, but he was consistent enough that most of the time I could tell whether I'd like a movie based on his comments, even if I disagreed with his conclusion. I just haven't seen that consistency with the RPG reviewers (at least not since the era when people like Ken Rolston were doing reviews in The Dragon).
 

I think RPG reviews can work quite well. I've had many people tell me specifically that they bought Game X based on one of my reviews, and some reviews are pushing 10000 impressions.

The big problem is that for every hard working, legitimate reviewer there are three or so who are just trying to scam free copies for no return. There's a fascinating recent thread at StoryGames about this where several publishers talk about the review copies they've given out that resulted in nothing. I know that despite Horror Week's (an RPG.net review event) great success several of the publishers who offered review copies didn't see reviews from at least half of those who accepted. On the other hand, some publishers really enjoyed the event.

Many larger companies may not find it to be time efficient to track who is doing them a service and who is pocketing their books. For a solo publisher who keeps the books in their house a favorable review at RPG.net that gets two thousand hits is a really big deal and well worth the price of a review copy. For a larger company it's a little less clear how beneficial that is. I've noticed a lot of the larger companies have less of an identifiable presence on forums and other places where they would interact with reviewers.

So I think reviews are beneficial and economical, but only when you know the reviewer will produce something useful to you. Unfortunately, a publisher who isn't on top of who the dedicated reviewers are could find themselves sending out four review copies for every review that is released and at that point I doubt it's a good deal.

Crothian said:
One issues is there is rarely a direct link to reviews and people buying a book. Even if a review a wrote is directly responsible for a thousand people buying a book unless each of them tells the publisher no one would ever know it.

Some smaller press publishers have a better idea, since a surge in sales can occur after a review. I recall Brennan Taylor of IPR mentioning that he noticed an increase in sales after certain reviews.
 


Remove ads

Top