Questioning Credibility

Recommended Videos

UndeadAreGo

New member
Nov 7, 2007
9
0
0
This is a recent post from my blog at address removed by moderator.com. There's a little bit of blatant self-promotion here, but I am also looking for honest opinions on the subject.

........

[The names of the site and the game I am about to discuss have intentionally been changed for two reasons. 1) I don't fancy the idea of being sued for libel. 2) One of my friends works for the site in question.]

I recently finished my review of GameX and can only describe it using some variation of the word "dreadful." Curious to see what other critics thought, I paid Metacritic a visit only to find that I didn't have the harshest tongue around, except for one rogue score. At the top of the heap, a full 40/100 points above the average, sat the score from SiteX.

As a devout fan of unreasonably trashy Van Damme flicks I know that some people?s opinions can vary wildly from the norm, so I decided to see what the other side had to say. SiteX had nearly all of the same complaints as everyone else, only relegated to the role of minor issues and condensed into two, last-second paragraphs. Perhaps I'm simply a less forgiving critic.

Then I saw them - two advertisements for GameX sucking up prime real estate along either side of the page. It's only natural that advertisements for a new game will coincide with a review. Still, the combination of such prominent advertising and a massively divergent score is suspicious under any circumstance. As if that wasn't enough to raise an eyebrow, it turns out that the parent company of SiteX and the reviewer are directly involved in creating the strategy guide for GameX.

Now we have a problem.

When you operate a website, it's always beneficial to have nice things to say about your sponsors. When you don?t, you have to smile politely and hope that they have the maturity to deal with it. Holding the contract for the strategy guide is a different story entirely, because you have a vested interest in the game's success. Bashing the game at that point would be like opening a restaurant and telling the customers you have cockroaches in the kitchen.

I'm not ready to lay down the gauntlet and cry "sell-out" just yet. Perhaps the reviewer honestly enjoyed the game, or developed a dysfunctional fondness for GameX to cope with the repetition of writing a guide. In any case, the reverberations of the GameSpot/Gerstmann scandal are still being felt throughout the industry. The difference this time is that no one got fired, the advertisers are happy, and most people don't care about GameX in the first place.

Does it even matter then?

It does to me. As a critic, I strive to uphold the trust of my readers, but instances like this bring the credibility of everyone under suspicion. I review on a freelance basis, and the publisher of GameX hinted that my opinion would determine the outlook of receiving future products from them. My score will stand because I have my integrity to uphold, but that doesn't mean that others haven't given in.

As a gamer, I read reviews just like everyone else. I expect and like to think that I'm getting an honest opinion, but my conversation with the publisher of GameX and my skepticism of SiteX's review call the honesty of every paid reviewer into question. I know that most critics are reliable, but I also know that some have collapsed under pressure. How am I supposed to tell which is which?

We can't expect the guilty to incriminate themselves, so self-policing certainly isn't the way to instill faith. Pulling advertisements isn't the answer either, unless you feel like paying membership dues. The best way to encourage honesty is for you, the reader, to take an active role in your site of choice. If you see something peculiar, call "shenanigans." No reviewer should be so pompous as to think his/her opinion to be unquestionable, and it will send the message that you care about the integrity of the site.
 

stompy

New member
Jan 21, 2008
2,951
0
0
Does no one remember GameSpot and the debacle they faced over the whole Kan and Lynch thing? If someone is blatantly biased on a game, the gaming community will lash out. Funny, we gamers have some of the worst in-fighting around, what with our fanboys, console wars and PC elitists, but when someone insults gaming as a whole, or tarnishes our reputation, we'll fight back.

Yes, you've also got a point about not using a site if it's fishy. If you think the site's crooked, then don't use it. If enough people adopt the attitude, then they (the reviewer) will die out, sending a harsh message to others.

Nice article by the way.
 

poleboy

New member
May 19, 2008
1,026
0
0
Well, that's why everyone should start with metacritic (or something similar) when they're considering a game. One person's opinion alone is useless, unless you are intimately familiar with that person's habits and tastes.
As you mention yourself (with the game in question), the one good review sticks out like a sore thumb when you have all the scores lined up on one page. Just about everyone will know that something is fishy and steer around that site/reviewer from then on.
Anyway, if you buy a bad game you usually don't have anyone to blame but yourself. You know what kind of games you like and it takes a maximum of 5 minutes to browse the net for enough reviews to form a proper opinion on something.
 

Wolfwind

New member
May 28, 2008
326
0
0
To be honest, I don't even know why some people rely so heavily on reviews. Personally, I usually read reviews just for fun AFTER I've played a game just to see what other people think, purely out of curiosity. Especially considering that I only have a handful of friends who play the games I do and everyone else I know is strickly FPS crazy.

Either way, I agree with the previous post. If you feel you need another person's opinion before investing time and money into a game, then yeah, check out the reviews, and check out more than one. Metacritic is great because you can get a wide array of opinions, but in the end, they're just numbers.

So then, don't just rely on the numbers. It's really annoying when people are all like "OH, SO-AND-SO GAME GOT ONLY 7.4!" Like... yeah and? That number is supposed to mean diddly shit to me? If anything, read what the reviewer has to say about the game. They explain why THEY think the game warrents that number, which gives you actual information to base whether or not YOU want to play the game or not.

But in the end, people should just use their own judgement when it comes to playing games. It's true, not all reviewers and sites are operating unbiased, so if there's a game you're interested in, ask friends, play demo's, even watch Youtube video's or speedruns of the game or something so that you can get a feel of the game. Rent the ***** or something.

I'm just saying this for people who are really picky though. Like I said, I'll buy a game based on the assumption alone that I'll like it. Usually I'm right, but then again I'm not difficult to please.
 

Anarchemitis

New member
Dec 23, 2007
9,102
0
0
Wolfwind said:
To be honest, I don't even know why some people rely so heavily on reviews. Personally, I usually read reviews just for fun AFTER I've played a game just to see what other people think, purely out of curiosity...
Aye. Otherwise I watch/read them to pique my interest from what little I may know about the game, or parodies thereof.
 

poleboy

New member
May 19, 2008
1,026
0
0
Well, I tend to rely mostly on my own sense of judgment when buying games as well. However, sometimes reviews can help you avoid bad decisions. Let's use an example:
I was really excited about the Dragon Quest game for Wii.
Then I remembered that I never finished DQ VI because I got bored with it halfway through, and I decided to read up on the new game. It turns out that it is in many ways an beginner RPG. Only one town, minimum inventory management, easy combat... major turn-offs for a long-time RPG buff. I'm sure it's a fun game but all the reviews cleared pointed to the fact that I would have the game wrapped up and done in a day or two.
 

HSIAMetalKing

New member
Jan 2, 2008
1,890
0
0
I don't trust reviews-- especially "user" reviews, because normal people are just plain bad at reviewing. I trust gameplay videos and nice, clean information.
 

irrelevantnugget

New member
Mar 25, 2008
807
0
0
Anarchemitis said:
Wolfwind said:
To be honest, I don't even know why some people rely so heavily on reviews. Personally, I usually read reviews just for fun AFTER I've played a game just to see what other people think, purely out of curiosity...
Aye. Otherwise I watch/read them to pique my interest from what little I may know about the game, or parodies thereof.
I rely on reviews to know about its cons, mainly. If there's no cons in a review, it's not a good one. Even if everybody was enthusiastic about Portal... not everybody mentioned it would last me 2 hours. Good thing I played someone else's game, then.

Game longevity would also be an important crux. I'm about to buy a PSP, but I won't get God of War, even though I enjoyed it a lot when I played it. But 5-6 hours of gameplay for 54 euro's... Might as well hire it for 3 days, that'll cost me not even a tenth of retail price.

The need for some people to see a score before they'll buy it is quite awkward, I'm glad when I can simply see a summarized version of its pro's and con's, but a score still helps me decide every now and then (higher than 80% is often enough to look up more info)
 

neems

New member
Jan 4, 2008
176
0
0
The problem I find, at least in relation to pc gaming, is that sites such as Gamespot and IGN have so much more content than more 'reputable' sites. Constantly updated news feeds, previews, videos, hands on et al.

I have seen several supposedly dedicated pc gaming sites (including one that has a fairly large 'backer') that just never seem to have any content. One review every three months? Not good enough.
 

haruvister

New member
Jun 4, 2008
576
0
0
Wolfwind said:
Personally, I usually read reviews just for fun AFTER I've played a game just to see what other people think
I do this with movies because I don't mind wasting a negligible amount of money to watch a bad film. When a movie leaves is overrated and I feel like I'm the only one who loathes it, Metacritic can be useful to find like-minded critics.

On topic, I think it's easier to spot a 'brown paper envelope' review with games because there is greater consensus on which games are good and which are bad, owing to the fact that movies and books - and, to an extent, music - are necessarily read on multiple levels. Games can be reviewed in a far more scientific manner as they are largely apolitical and non-alleogrical so there's less room for interpretation.
 

klarax

New member
Mar 24, 2008
161
0
0
I can usually tell if I'm going to like a game by just watching a game play trailer. Anyone else do that too?
 

Arachon

New member
Jun 23, 2008
1,521
0
0
Gamplay trailers (or atleast the official ones) are usually edited to give a result not attainable during gameplay (be it applying filters to increase the graphical quality, add sounds etc), so I find it hard to be able to trust them.
 

UndeadAreGo

New member
Nov 7, 2007
9
0
0
Agreed. Trailers can still get me excited, but you have to constantly remember that someone got paid to edit footage into the most heart-pounding piece possible.
 

irrelevantnugget

New member
Mar 25, 2008
807
0
0
UndeadAreGo said:
Agreed. Trailers can still get me excited, but you have to constantly remember that someone got paid to edit footage into the most heart-pounding piece possible.
Unless you work for 3DRealms and are making DKF trailers.
HAH.
 

L.B. Jeffries

New member
Nov 29, 2007
2,175
0
0
Eh, I just get to know the reviewer. I follow people's work by name, not by site or game. You learn to trust their sensibilities and how much salt you should serve with each review.
 

cleverlymadeup

New member
Mar 7, 2008
5,256
0
0
Saphatorael said:
Game longevity would also be an important crux. I'm about to buy a PSP, but I won't get God of War, even though I enjoyed it a lot when I played it. But 5-6 hours of gameplay for 54 euro's... Might as well hire it for 3 days, that'll cost me not even a tenth of retail price.
game length is always the picky one, with the psp they are constrained by disc size, it's about 5-7 hours at least, that's not counting the extra challenges but fun none the less

as for reviews, i take a lot of them with a grain of salt, tho metacritic can be good and other aggregate websites. if both critic and fan ratings line up, i'd say the rating is fair, if there's a difference then as the saying goes, something is rotten in the state of denmark