Why the current review system should be scrapped.
Published Monday 7 Jun 2010 7:14pm |
21
I saw an article along the lines of this rather recently and wanted to express my own opinion on the subject. The current review system isn't working and is turning into a mess (This in no way is directed at NZG).
The current rating system most widely used is the 10/10 counting in decimals which really is a rating out of 100 is distorsted and should change. Back in the day even though there were alot less games around, the scores meant hugely different things, a 10/10 was an absolute masterpiece for the ages, example Pokemon Red/Blue and Ocarina of Time which are clearly exactly that, 9/10s were very formidable games and rare and 8/10 were great games and worth your time etc.. you know what I'm getting at.
Now anything averaging below 90/100 on Metacritic is considered a 'flop' or not worth your money which is really quite sad, recent case would be Alan Wake, which sales (at last here) have been poor. Too many 10/10s are given out and too many 9s.
My solution or projected alterate method is to adopt what movies use, a 5/5 rating using whole numbers only. A much simpler and accurate rating cause lets face it, reviews are opinion pieces and the discrepancies between each reviews can be minimized using this.
The main reason is, when reveiwing a game, its hard to give it a score without being subjective, your not going to play a game and think to yourself, "I'm feeling a 8.0" then an hour later, "Oh its bumped up to 8.6" it doesn't work like that really.
A rating out of 5 can put games into smaller categories and do two important things, give more reasons for gamers to actually READ the reviews and also give games which aren't the pinnacle of quality a chance as well. a 5/5 rating will mean something along the lines of;
A 5 being fantastic game, well made and fun to play, 4 being a great game with some minor flaws but worth a look. 3 being if it piques your interest take a look/rent. 2 being some major flaws but some may enjoy and 1 being avoid (The Leisure Suit larry's, Rogue Warriors).
Even though this has no chace of happening, I can dream, gamers like to back up their puchases a little too much sometimes.
COMMENTS (21)
I think major thing to remember is that reviews are one person's opinion. That's why you'll get people that disagree so often.
The other thing is that I would say it's pretty well known that the game review scoring system is screwed worldwide. It's just a fact now that 7.5 is nothing more than average, and a 9+ game is required for it to be "a great game". I don't think there's any way this can be fixed. Not with aggregation sites such as Metacritic and GameRankings. If one website is to move to a 5-star rating system, these websites will just turn it into a percentage of 100, and then we're back to square one.
The other thing is that I would say it's pretty well known that the game review scoring system is screwed worldwide. It's just a fact now that 7.5 is nothing more than average, and a 9+ game is required for it to be "a great game". I don't think there's any way this can be fixed. Not with aggregation sites such as Metacritic and GameRankings. If one website is to move to a 5-star rating system, these websites will just turn it into a percentage of 100, and then we're back to square one.
Nice blog and valid points.
Most of us here at NZGamer would prefer that the text said it all and we didn't have to put a number at the end. For those that want to skim the text though, a summary and score is vital though. Just take scores with a grain of salt, people get too worked up over .01%. Also we need a score to get counted by sites like Metacritic, which send a lot of readers our way. Only thing is it sends a lot of fanboys our way to say we are biased if we don't rate their favourite game higher than the average site lol.
With my reviews I can only write my thoughts and hope readers can tell if the game sounds like it appeals to them or not. We aren't gospel.
Most of us here at NZGamer would prefer that the text said it all and we didn't have to put a number at the end. For those that want to skim the text though, a summary and score is vital though. Just take scores with a grain of salt, people get too worked up over .01%. Also we need a score to get counted by sites like Metacritic, which send a lot of readers our way. Only thing is it sends a lot of fanboys our way to say we are biased if we don't rate their favourite game higher than the average site lol.
With my reviews I can only write my thoughts and hope readers can tell if the game sounds like it appeals to them or not. We aren't gospel.
I can see what you are getting at with the people getting upset over scores. It was pretty sad to see people saying that Alan Wake was a pretty big disappointment for only getting a 8.5.
People really are setting their standards way too high
People really are setting their standards way too high
Not a bad blog bud. Some pics and a bit of extra length would get a 5 out of me.
I'm seeing what you're meaning with the rating system and I agree to a point. But unfortunately, yes, Metacritic would take a perfectly acceptable 4-star and turn it into a 80 out of 100 which certain games would take to mean only 'good'.
If I could have things my way (which would probably turn out terrible but it could be interesting) I'd ditch scores entirely. A review would just be an in-depth article and the reader would look at the section and say "Hey, I really like the idea of that game mechanic" or "What? This game has 40 escort missions?" That way, I think people would actually buy games because they like the way the game works as opposed to a number attached to it.
I'm seeing what you're meaning with the rating system and I agree to a point. But unfortunately, yes, Metacritic would take a perfectly acceptable 4-star and turn it into a 80 out of 100 which certain games would take to mean only 'good'.
If I could have things my way (which would probably turn out terrible but it could be interesting) I'd ditch scores entirely. A review would just be an in-depth article and the reader would look at the section and say "Hey, I really like the idea of that game mechanic" or "What? This game has 40 escort missions?" That way, I think people would actually buy games because they like the way the game works as opposed to a number attached to it.
Thanks for the replies, yeah you guys are right, some things I forget to mention.
Quite sad when the NZG GoW3 review was posted on N4g, couple mins later people were saying things like 'BS' or Blacklisted'.
I can obviously understand why sites do it but yeah, gamers should read reviews, probably doesn't apply here too much but some other sites, sheesh.
Quite sad when the NZG GoW3 review was posted on N4g, couple mins later people were saying things like 'BS' or Blacklisted'.
I can obviously understand why sites do it but yeah, gamers should read reviews, probably doesn't apply here too much but some other sites, sheesh.
"I think major thing to remember is that reviews are one person's opinion. That's why you'll get people that disagree so often."
But then on the flip side of this, what then is the point of them? To get the personal opinion of someone I don't know? Over time, yeah, a yardstick of opinion might develop, but even then how can they be useful to anyone? I think all too often the issue is that reviewers fail to back up their opinion with something that let's the reader go: "Oh yeah, I can see where he's coming from. He's wrong, but I can see why he thinks that way."
As an aside, the high score thing comes from the fact that in America, 50% is a fail.
Sort of a dead horse, though, isn't it?
But then on the flip side of this, what then is the point of them? To get the personal opinion of someone I don't know? Over time, yeah, a yardstick of opinion might develop, but even then how can they be useful to anyone? I think all too often the issue is that reviewers fail to back up their opinion with something that let's the reader go: "Oh yeah, I can see where he's coming from. He's wrong, but I can see why he thinks that way."
As an aside, the high score thing comes from the fact that in America, 50% is a fail.
Sort of a dead horse, though, isn't it?
The numbers just a way lazy people can get an overall idea without having to read it. If people are generally interested in a game they'll read your review and decide on a conclusion of their own.
Good blog I think too many nines and tens are given out also.
I think Phoenix and Wozza have summed it up nicely.
There are plenty of games out there that deserve attention they never get because they only scored 6-8/10.
There are plenty of games out there that deserve attention they never get because they only scored 6-8/10.
I personally like the larger range (i.e. 0-100) as you can get a low 4 star, or a high 4 star and you wouldn't know... With numbers, you know there's a considerable difference between eg 75 and 95... where as stars won't show that... More accurate the better I think.
I don't necessarily think that the review system has to change, a grading out of 10 allows for leeway (for example .5's).
I think the problem is that a lot of critics are a tad too nice. A cruel to be kind approach is really needed with this sort of thing, I use to be able to rely on reviews a lot more than I can nowadays.
I think the problem is that a lot of critics are a tad too nice. A cruel to be kind approach is really needed with this sort of thing, I use to be able to rely on reviews a lot more than I can nowadays.
Then when sites like Edge use it correctly, they are regarded as the harshest around.
I still think 10/10 should be an impossibility unless the game cures aids and cancer and 0/10 should be an impossibility because even if it shows a blank screen then its better than nothing.
But people don't see it that way of course...they think giving a 'perfect' score is somehow feasible
But people don't see it that way of course...they think giving a 'perfect' score is somehow feasible
8 June 2010, 04:06 PM
Reply to Takuyafire
I still think 10/10 should be an impossibility unless the game cures aids and cancer and 0/10 should be an impossibility because even if it shows a blank screen then its better than nothing.
But people don't see it that way of course...they think giving a 'perfect' score is somehow feasible
Well, I think that entirely depends on your viewpoint of what a 10/10 game means.I still think 10/10 should be an impossibility unless the game cures aids and cancer and 0/10 should be an impossibility because even if it shows a blank screen then its better than nothing.
But people don't see it that way of course...they think giving a 'perfect' score is somehow feasible
If your opinion is that a 10/10 is absolutely perfect in every possible way, there are no bugs (no matter how minor), it gives you nights of endless pleasure (oh dear god, I think I just quoted a Celine Dion song) and THEN cooks you breakfast the morning after.. of course it's not going to be possible to score a 10.
On the other hand, is others may say that a 10/10 is the creme de la creme when it comes to games. They are the ones that you'd recommend to every single one of your gaming mates, and ones you'd believe absolutely essential in every gaming collection. Could they have flaws? Certaintly, but they don't get in the way of being absolutely brilliant.
I know which side of the fence I'd rather sit on.
Yeah. Whether a game gets 10/10 or not depends on your definition of the numerator 10.
Takuya's definition of 10 is some kind of theoretical perfect philosophical thing, which is silly because the only place where you find actual perfection is in mathematics. But everything we experience exists in the practical realm, so there is no point in using theoretical standards to judge the real world.
It seems to me the only time one would adopt that stance is if you expressly want to deny whatever the chance of scoring 10/10.
Takuya's definition of 10 is some kind of theoretical perfect philosophical thing, which is silly because the only place where you find actual perfection is in mathematics. But everything we experience exists in the practical realm, so there is no point in using theoretical standards to judge the real world.
It seems to me the only time one would adopt that stance is if you expressly want to deny whatever the chance of scoring 10/10.
GiantBomb.com use 5 star ratings in whole so 1* 2* 3* 4* 5* are what they use. Nice blog dude.
Yeah this article pretty much sums it up eh ... I used to be a strategy gamer ... mostly Age of Empires and Age of Empires 2 ... I was right up there with the top players in Australasia ... all of my holidays were spent in front of my computer playing these games online! (even with my Zfree dialup connection). Unfortunately eventually life does seem to take over ... and before you know it you've turned gumby ... a few years ago I decided to jump into one of the gaming rooms to play Age Of Empires 2 against some rookies and got totally owned =( I could still remember the old strategies ... but the game had changed ... people played differently ... and I didn't start the game with a proper plan and found I was painfully slow!
Good article =( Makes me sad actually ...
Good article =( Makes me sad actually ...
11 June 2010, 07:42 PM
Reply to hogie
Yeah this article pretty much sums it up eh ... I used to be a strategy gamer ... mostly Age of Empires and Age of Empires 2 ... I was right up there with the top players in Australasia ... all of my holidays were spent in front of my computer playing these games online! (even with my Zfree dialup connection). Unfortunately eventually life does seem to take over ... and before you know it you've turned gumby ... a few years ago I decided to jump into one of the gaming rooms to play Age Of Empires 2 against some rookies and got totally owned =( I could still remember the old strategies ... but the game had changed ... people played differently ... and I didn't start the game with a proper plan and found I was painfully slow!
Good article =( Makes me sad actually ...
Wrong blog perhaps?
Yeah this article pretty much sums it up eh ... I used to be a strategy gamer ... mostly Age of Empires and Age of Empires 2 ... I was right up there with the top players in Australasia ... all of my holidays were spent in front of my computer playing these games online! (even with my Zfree dialup connection). Unfortunately eventually life does seem to take over ... and before you know it you've turned gumby ... a few years ago I decided to jump into one of the gaming rooms to play Age Of Empires 2 against some rookies and got totally owned =( I could still remember the old strategies ... but the game had changed ... people played differently ... and I didn't start the game with a proper plan and found I was painfully slow!
Good article =( Makes me sad actually ...
Lots of good discussion here. But lets not forget the english lexicon has words like; Bad, Fair, Good, Great, Excellent, all for expressing exactly how we feel about something.
If you have catagorised a game into 5 or more parts of it's whole, and rated each with words rather than scores, you give a much clearer representation of how you found it. Afterall, in your mind you process the information using adaptive language before you attribute it a number, eg:
The graphics were 'good', but not 'great', therefore it gets a 6 or 7... considering boss X was 'amazing' to look at, I will call it 7.
And then someone comes along and says, why did you review parts of a whole, and not the whole package? And things get a little more complex. And before you know it you are back to numbers again.
I have only added to the confusion really. I would also add, I like the 'out of ten catagory' review, it's how I have been reading game reviews since the dawn of video game magazines. So by having my little rant, I just want to provoke discussion, not change.
If you have catagorised a game into 5 or more parts of it's whole, and rated each with words rather than scores, you give a much clearer representation of how you found it. Afterall, in your mind you process the information using adaptive language before you attribute it a number, eg:
The graphics were 'good', but not 'great', therefore it gets a 6 or 7... considering boss X was 'amazing' to look at, I will call it 7.
And then someone comes along and says, why did you review parts of a whole, and not the whole package? And things get a little more complex. And before you know it you are back to numbers again.
I have only added to the confusion really. I would also add, I like the 'out of ten catagory' review, it's how I have been reading game reviews since the dawn of video game magazines. So by having my little rant, I just want to provoke discussion, not change.
Cool blog bro.
It would be nice to have no definite number rating given to the game, with only the actual words (wow) and good/bad/ugly comments counting as the review, but yah, it's important to feed the metacritics and get web traffic in return.
I figure that if you're the kind of person who realises the ratings system nowadays doesn't seem very balanced, you're probably a smart enough person to form your opinions based on what the review says and can ignore the number, pretty much.
Oh yah, I know I'm a bit late in replying here, but Takuyafire, you say a 10/10 should be prettyh much unachievable for a game, but I notice several animes on your watched list have a 10/10 rating. Animes are just better than games, or did those ones cure aids and cancer?
It would be nice to have no definite number rating given to the game, with only the actual words (wow) and good/bad/ugly comments counting as the review, but yah, it's important to feed the metacritics and get web traffic in return.
I figure that if you're the kind of person who realises the ratings system nowadays doesn't seem very balanced, you're probably a smart enough person to form your opinions based on what the review says and can ignore the number, pretty much.
Oh yah, I know I'm a bit late in replying here, but Takuyafire, you say a 10/10 should be prettyh much unachievable for a game, but I notice several animes on your watched list have a 10/10 rating. Animes are just better than games, or did those ones cure aids and cancer?
Subscribe to the RSS Feed for this Blog
Find My Forum Content
Add Digitaldude to your friends list
Log in to comment or Register now!