Forum Navigation: Forum Index » Off-Topic » Suggestion Box

Want FREE books and FREE Amazon gift cards?

Each day we announce via email a book that is either FREE or on a temporary sale at a great discount price. These are not your average free books. These are incredible insider deals on well-rated books. is where tomorrow's bestsellers are born. We also give away over $1,000 per month of free Amazon gift cards in free daily giveaways, exclusively to those signed up to these announcements! Hurry, sign up free now:

Sorry, this proves you are human.

Score system

(Formerly the "Support, Feedback and Forum Announcements" forum.)
Please help us make Online Book Club even better! Please post suggestions, feedback and ideas for new features. Wild brainstorming and potentially 'crazy ideas' are super-strongly encouraged! :)

For new members (or old members who run into an issue), please make a post in this forum asking any questions you have about using the site and how it works that are not answered in the FAQ. Not only are we happy help you, but also we can use your feedback to make the site better for tomorrow's new member! A lot of the instructions throughout the site and answers in the FAQ are there because someone else pointed out that it wasn't clear before.

If you have a question or problem regarding the review team system, whether as author or a reviewer, please use the private contact forum.

Re: Score system

Post Number:#31 by va2016
» 21 Apr 2017, 04:35

Scott wrote:
gali wrote:I understand. However if the authors rate the quality of the reviews according to the rates given or criticism of their work, it kind of defeats the purpose of writing honest reviews in my view. I myself found parts of the system unfair and it discourages me.

The author's do not rate the reviews. It is based on other factors. At this time, the biggest thing that would negatively impact the editor's score is if a board warning is issued for a review that does not meet the guidelines or request a rewrite. In theory, average reviews should get a rating of 5 out of 10, and almost no reviewers if any should get a score of 10 out of 10 as that would be perfection and leave no room for improvement.

I'm thinking maybe the 'editorial' rating is subjective and thus can come off as offensive. Even a rating of above average but not perfect can come off as an insult. I'm not completely sure the best way to avoid that. Originally, the rating was supposed to default to 5 unless there was something for which to give an above average rating or a penalty recorded in the database (such as a review being rejected as not being spellchecked, etc.). I'm adjusting the formula so that the rating will tend to be higher unless there are explicit issues for which the score will be penalized, the idea being that lack of problem should be taken as more of a credit.

I was thinking about this a while back, and subtracting points for mistakes seems like a required
component in order to keep in check the reviewers getting slack, although I feel there could be
levels of mistakes (severe ones like clear spoilers, minor ones like a missing article), and corresponding
reduction of points.

I do believe that there can be objective assessment of giving additional points for reviews which stand out
above an average review, come up with the total score first, and then subtract points for the mistakes.

For example,

1) 50 points for an average review that covers the basics
2) add 10 points for say, reference to similar books and comparing this book with them.
3) add 10 points for say, paying good attention to grammar, punctuation, mechanical errors
and pointing them out.
4) add 10 points to say, language assessment (figures of speech, command over English etc) and
how the reviewer has recognized and written about them in the review.

5) subtract 2 points for say, a missing article
6) subtract 15 points for a severe mistake of not following the guideline
7) subtract 10 points for a clear spoiler

80 points - 27 points = 53 points

As of this writing, the scoring system has changed, and may be the editorial team
is already doing what I described, but just thought of putting that out. But, I observed
silly errors as well as the serious errors carry same reduction of 10 points, which I think
is not fair.

-- 21 Apr 2017, 05:24 --

maraman wrote:I’d like to share some of my contemplations about the current formula for getting scores. When I saw it, I didn’t like the formulation “unlimited potential loss of points for penalties”. In my opinion, it should be defined more precisely (one or five or…? points for a reminder email, e.g.). I was really astounded when I rechecked my score and saw that from 12 points I went down to -4 (I got two reminder emails after which I reacted promptly). Does anyone else have similar experience?

It's possibly not because of the reminders, but because of a recent review that you submitted
which got negative editorial comments. You might want to check your scores on each reviewer
score sections thoroughly so that you know where the points went down.
User avatar
Posts: 142
Joined: 26 Dec 2016, 02:15
Currently Reading:
Bookshelf Size: 23 books

View Reviewer Page
2017 Reading Goal: 50 Books
Goal Completion: 20%

Did you know?
Once you join the forums and log in you will get to enjoy a very ad-reduced experience. It's easy and completely free!

Re: Score system

Post Number:#32 by Scott
» 23 Apr 2017, 19:26

The Review Team editing system has already been updated since this topic was created to make it more objective and clear.

This topic was created in 2014, so I will lock this topic.
"That virtue we appreciate is as much ours as another's. We see so much only as we possess." - Henry David Thoreau

"Non ignara mali miseris succurrere disco." Virgil, The Aeneid
Publishing Contest ~ 960 Votes ~ View Scott's Entry
User avatar
Site Admin
Posts: 2957
Joined: 31 Jul 2006, 23:00
Location: CT
Favorite Author: Voltairine de Cleyre
Favorite Book: Of Mice and Men
Currently Reading: Save the Last Bullet for God
Bookshelf Size: 186 books

View Reviewer Page
Reading Device: Nook Simple
2017 Reading Goal: 36 Books
Goal Completion: 11%


Who is online

Users browsing this forum: No registered users and 1 guest


Return Home » Off-Topic » Suggestion Box