Score system

(Formerly the "Support, Feedback and Forum Announcements" forum.)
Please help us make Online Book Club even better! Please post suggestions, feedback and ideas for new features. Wild brainstorming and potentially 'crazy ideas' are super-strongly encouraged! :)

For new members (or old members who run into an issue), please make a post in this forum asking any questions you have about using the site and how it works that are not answered in the FAQ. Not only are we happy help you, but also we can use your feedback to make the site better for tomorrow's new member! A lot of the instructions throughout the site and answers in the FAQ are there because someone else pointed out that it wasn't clear before.

---

IMPORTANT: The Public Suggestion Box is NOT for discussing issues with the Review Team. If you are a reviewer and need help, please first check the Review Team Page and then if you still need help use the Review Team Support Forum. If you are an author and need help, please first check the Author Dashboard and if that does not resolve your issue use the private contact form. For reference, there is a contact link on every page of the website.

---

To ensure the above procedures are used, posts by new members in the Suggestion Box will be held for moderation.

There are over 240,000 members at OnlineBookClub.org. Following the proper procedures to get help or make suggestions actually helps us help you much faster.
Forum rules
Please do not discuss issues related to the Review Team in the Public Suggestion Box. If you have an issue or question related to the review Team, please check either the Author Dashboard (if you are an author or publisher), or check the Review Team Page (if you are a reviewer).
User avatar
ALRyder
Posts: 552
Joined: 20 Jan 2014, 14:01
Currently Reading: The Last Stormlord by Glenda Larke
Bookshelf Size: 13
Reviewer Page: onlinebookclub.org/reviews/by-alryder.html
Latest Review: "Diet Enlightenment" by Rachel L. Pires

Re: Score system

Post by ALRyder » 20 Mar 2014, 17:45

npandit wrote:I have a question about the score system too.

What is "number of disputes over private blurbs"?
This is my question as well

User avatar
claire mckay
Posts: 147
Joined: 16 Nov 2013, 16:35
Favorite Author: JRR Tolkien
Favorite Book: Lord of the Rings
Bookshelf Size: 9
Reviewer Page: onlinebookclub.org/reviews/by-claire-mckay.html
Latest Review: "The M-Word" by Josephine Stine
Location: Glasgow

Post by claire mckay » 20 Mar 2014, 18:03

When you complete a paid review you are asked to summarise the ending and add comments but this is just for the author for feedback and confirmation that you did indeed read the whole book. I believe this is the private blurb and so I guess you'd be marked down if the author felt you hadn't read the whole book and raised a dispute on that. That's what I think anyway but you might need Scott to confirm that!Hope that helps.

User avatar
Scott
Site Admin
Posts: 3107
Joined: 31 Jul 2006, 23:00
2018 Reading Goal: 52
2017 Reading Goal: 36
2018 Reading Goal Completion: 3
2017 Reading Goal Completion: 25
Currently Reading: Before We Were Yours
Bookshelf Size: 225
Reviewer Page: onlinebookclub.org/reviews/by-scott.html
Reading Device: B00L89V1AA
Publishing Contest Votes: 960
fav_author_id: 2660
Location: CT

Post by Scott » 20 Mar 2014, 18:43

claire mckay wrote:When you complete a paid review you are asked to summarise the ending and add comments but this is just for the author for feedback and confirmation that you did indeed read the whole book. I believe this is the private blurb and so I guess you'd be marked down if the author felt you hadn't read the whole book and raised a dispute on that. That's what I think anyway but you might need Scott to confirm that!Hope that helps.
Yes, exactly.
"That virtue we appreciate is as much ours as another's. We see so much only as we possess." - Henry David Thoreau

"Non ignara mali miseris succurrere disco." Virgil, The Aeneid

User avatar
ALRyder
Posts: 552
Joined: 20 Jan 2014, 14:01
Currently Reading: The Last Stormlord by Glenda Larke
Bookshelf Size: 13
Reviewer Page: onlinebookclub.org/reviews/by-alryder.html
Latest Review: "Diet Enlightenment" by Rachel L. Pires

Post by ALRyder » 20 Mar 2014, 19:28

Ah, that makes sense I guess. It does kind of stink to lose 5 points just because you haven't had any paid reviews yet though.

User avatar
Scott
Site Admin
Posts: 3107
Joined: 31 Jul 2006, 23:00
2018 Reading Goal: 52
2017 Reading Goal: 36
2018 Reading Goal Completion: 3
2017 Reading Goal Completion: 25
Currently Reading: Before We Were Yours
Bookshelf Size: 225
Reviewer Page: onlinebookclub.org/reviews/by-scott.html
Reading Device: B00L89V1AA
Publishing Contest Votes: 960
fav_author_id: 2660
Location: CT

Post by Scott » 21 Mar 2014, 09:26

It's meant to be a wash in that case, you get 5 out of 10, so that you are not losing or gaining any points, or are gaining and losing equal points depending on how you look at it.
"That virtue we appreciate is as much ours as another's. We see so much only as we possess." - Henry David Thoreau

"Non ignara mali miseris succurrere disco." Virgil, The Aeneid

User avatar
sivienna
Posts: 24
Joined: 19 Feb 2013, 22:18
Favorite Author: Cornelia Funke
Currently Reading: Lee Raven Boy Thief
Bookshelf Size: 8
Reviewer Page: onlinebookclub.org/reviews/by-sivienna.html
Latest Review: "The Unknown Man" by J.G. Gatewood
fav_author_id: 4539

Post by sivienna » 02 May 2014, 10:51

When will you make the FINAL scoring system? Sorry, but this stuff about scoring system makes me a bit frustrated. My level keeps changing. 3 to 1 to 2 to 1 again. It feels like my effort to raise my level is useless.

User avatar
anomalocaris
Posts: 326
Joined: 24 Apr 2014, 01:14
Bookshelf Size: 3
Reviewer Page: onlinebookclub.org/reviews/by-anomalocaris.html
Latest Review: "Kaitlyn a Wants To See Ducks" by Jo meserve Mach and Vera Lynne Stroup- Rentier

Post by anomalocaris » 02 May 2014, 11:44

I"m new to the board, and still waiting for a chance to review, so weight my thoughts accordingly. I'm in agreement with some of the points made, particularly with regard to the BOTM. The logic being used is essentially, "How could someone possibly give a competent review of a Stephen King novel if they've never read Nora Roberts?" If the reviewer can read an assigned book, and give a thorough, competent review, then whether they've read other books that happen to be popular with the demographic using this particular forum is irrelevant. The current system means that the majority of reviews will be coming from a group of reviewers who all fall within a fairly narrow demographic, which may be detrimental to authors requesting reviews on books that don't fall within the current popular style.

I'm also on board with the idea that scoring on the basis of number of views is problematic. It means that a reviewer can artificially force a score up by repeatedly viewing the thread or by asking a couple of friends to do the same, while a more honest reviewer, or one who doesn't (as noted above) want to pester friends to read his work is ultimately penalized.

This isn't intended to be confrontational! Just tossing in some thoughts that may not have been fully taken into consideration. Use them if you find them helpful. Disregard them if you don't.
You can't put a rope around the neck of an idea.
--Vol. Bobby Sands

User avatar
Scott
Site Admin
Posts: 3107
Joined: 31 Jul 2006, 23:00
2018 Reading Goal: 52
2017 Reading Goal: 36
2018 Reading Goal Completion: 3
2017 Reading Goal Completion: 25
Currently Reading: Before We Were Yours
Bookshelf Size: 225
Reviewer Page: onlinebookclub.org/reviews/by-scott.html
Reading Device: B00L89V1AA
Publishing Contest Votes: 960
fav_author_id: 2660
Location: CT

Post by Scott » 02 May 2014, 12:01

Why is your level dropping? What was your score before? What is your score now?

Are you sure your level isn't being reported as 1 simply because your score expired and is thus coming through as 0?

The only adjustment I recall making recently was to split the popularity between a cumaltative measure and an average measure.

My goal is to always update the score to better reflect averages. My idea is that a score of 50 is average, and that almost nobody should have a 100. The score is meant to measure one's desirability as reviewer, which namely means the quality of review activity and participation in the community. The score should be adjusted to prevent any measures of cheating. For instance, if post count improves score, one might make a bunch of fluff posts with like 3 words each to try to artificially inflate their score. But then I might change the scoring system to only count posts of a certain length. The particular metrics used at any given time are to as fairly as possible gauge the value a reviewer has to prospective authors namely through participation in the forum community and delivery of quality reviews; that is final and I have no plans to change that. But I do plan to continually make slight adjustments to the actual formula to generate the score to get it to better reflect that.
"That virtue we appreciate is as much ours as another's. We see so much only as we possess." - Henry David Thoreau

"Non ignara mali miseris succurrere disco." Virgil, The Aeneid

User avatar
PashaRu
Posts: 9172
Joined: 15 Mar 2014, 17:02
Currently Reading: "voices and groans and shrieks and wailings"
Bookshelf Size: 199
Reviewer Page: onlinebookclub.org/reviews/by-pasharu.html
Latest Review: "Damn Females on the Lawn" by Rachel Hurd
Location: East of the sun and west of the moon

Post by PashaRu » 02 May 2014, 18:27

No system is going to be perfect, but I think the one we're working with is pretty fair. If reviewers want to do reviews, especially paid ones, there should be some criteria in place for assessing the person as to his/her competency. I'd actually like to see more weight given to the editorial analysis and review activity. I've read a few reviews that demonstrate a lack of good English/writing skills, including poor grammar and improper/awkward sentence structure. Okay, this isn't a college English course, but wouldn't more credence be given to someone who shows an adequate understanding of English? After all, we're reading English books, and if a person does not have an adequate grasp of the language, is he/she in a good position to assess others in this area, especially quality of writing? I realize that the editorial analysis is subjective, but there are some things that are simply either right or wrong within the accepted parameters of English.

As far as changing the criteria for post count - eliminating one-, two-, or three-word posts from the scoring system - I'd be in favor of that. There are a lot of threads that allow a person to inflate his post count by contributing practically nothing to the community. Admittedly, I add to these threads as well, because it's fun. So I'm not in favor of eliminating them, but shouldn't an active member be making a significant contribution to the community?

Anyway, just my two cents.
[Insert quote here. Read. Raise an eyebrow. Be mildly amused. Rinse & repeat.]

User avatar
gali
Site Admin
Posts: 25225
Joined: 22 Oct 2013, 07:12
2018 Reading Goal: 100
2017 Reading Goal: 100
2018 Reading Goal Completion: 6
2017 Reading Goal Completion: 105
Currently Reading: The Best of Our Spies
Bookshelf Size: 1767
Reviewer Page: onlinebookclub.org/reviews/by-gali.html
Reading Device: B00I15SB16
fav_author_id: 2484
Location: Lost in a good book

Post by gali » 03 May 2014, 00:55

I think now that the system is fair and I am satisfied with it. The current system helps out to pick good reviewers.

A word to the wise: In order to increase the numbers of views and responds to the reviews, one should participate more in the community itself. By commenting on others' reviews, one will get comments on his own reviews.

It isn't truth that the current system forms "a group of reviewers who all fall within a fairly narrow demographic". It is quite the opposite in fact and the authors gain from the diversity of tastes.

Regarding the English skills, I think that people who don't have an adequate grasp of the language, avoid reading in English or writing reviews.... So this point is moot. Furthermore, one can asses writing or a book no matter his language skills. One doesn't have to be a teacher or an author to do that. I agree that some reviews may have "poor grammar and improper sentence structure", but Scott goes over the reviews and doesn't publish those with bad grammar. What I like here is the diversity of reviews. If all reviews followed the same mold, they would make a boring reading.

From the personal angel, I have read in English more than 20 years. My English may not be perfect as some, but I can still appreciate a good writing (or a bad one) when I see one. I know it isn't personal, but I just wanted to clarify this issue. :)

That my two cents about it all. :wink:
In the case of good books, the point is not to see how many of them you can get through, but rather how many can get through to you." (Mortimer J. Adler)

User avatar
ALRyder
Posts: 552
Joined: 20 Jan 2014, 14:01
Currently Reading: The Last Stormlord by Glenda Larke
Bookshelf Size: 13
Reviewer Page: onlinebookclub.org/reviews/by-alryder.html
Latest Review: "Diet Enlightenment" by Rachel L. Pires

Post by ALRyder » 28 May 2014, 00:43

If I were going to change anything I would change how much is put towards the book of the month. I may be a bit biased though, because while I have a pretty decent score, that's about the only thing that drops my number :P .

gali, you don't have anything to worry about. I've read your reviews and they're always easy enjoyable reads. You for sure get your point across when it's a good book, and make people want to read it.

Scott, you said that you're thinking of factoring in the score system to how fast we get to see books up for review. I think I have a pretty good score, but what are you thinking the minimum score will be for the fastest people to see the books? For every 5 points under 100 the person loses an hour, or what? It would be nice if it were something like every 20 points, but again, that's just me being biased.

User avatar
gali
Site Admin
Posts: 25225
Joined: 22 Oct 2013, 07:12
2018 Reading Goal: 100
2017 Reading Goal: 100
2018 Reading Goal Completion: 6
2017 Reading Goal Completion: 105
Currently Reading: The Best of Our Spies
Bookshelf Size: 1767
Reviewer Page: onlinebookclub.org/reviews/by-gali.html
Reading Device: B00I15SB16
fav_author_id: 2484
Location: Lost in a good book

Post by gali » 28 May 2014, 01:07

ALRyder wrote:If I were going to change anything I would change how much is put towards the book of the month. I may be a bit biased though, because while I have a pretty decent score, that's about the only thing that drops my number :P .

gali, you don't have anything to worry about. I've read your reviews and they're always easy enjoyable reads. You for sure get your point across when it's a good book, and make people want to read it.

Scott, you said that you're thinking of factoring in the score system to how fast we get to see books up for review. I think I have a pretty good score, but what are you thinking the minimum score will be for the fastest people to see the books? For every 5 points under 100 the person loses an hour, or what? It would be nice if it were something like every 20 points, but again, that's just me being biased.
Thank you for your encouragement. I put a lot of efforts into my reviews and It is good to know they are such. :)
In the case of good books, the point is not to see how many of them you can get through, but rather how many can get through to you." (Mortimer J. Adler)

User avatar
Scott
Site Admin
Posts: 3107
Joined: 31 Jul 2006, 23:00
2018 Reading Goal: 52
2017 Reading Goal: 36
2018 Reading Goal Completion: 3
2017 Reading Goal Completion: 25
Currently Reading: Before We Were Yours
Bookshelf Size: 225
Reviewer Page: onlinebookclub.org/reviews/by-scott.html
Reading Device: B00L89V1AA
Publishing Contest Votes: 960
fav_author_id: 2660
Location: CT

Post by Scott » 04 Jun 2014, 15:37

ALRyder wrote:Scott, you said that you're thinking of factoring in the score system to how fast we get to see books up for review. I think I have a pretty good score, but what are you thinking the minimum score will be for the fastest people to see the books? For every 5 points under 100 the person loses an hour, or what? It would be nice if it were something like every 20 points, but again, that's just me being biased.
I just factored it into the levels, so that there is a waiting time for the lower levels. At this time, I believe it is 6hrs for each level down from 5 one is. A current table of the waiting times is kept on the levels page.
"That virtue we appreciate is as much ours as another's. We see so much only as we possess." - Henry David Thoreau

"Non ignara mali miseris succurrere disco." Virgil, The Aeneid

User avatar
ALRyder
Posts: 552
Joined: 20 Jan 2014, 14:01
Currently Reading: The Last Stormlord by Glenda Larke
Bookshelf Size: 13
Reviewer Page: onlinebookclub.org/reviews/by-alryder.html
Latest Review: "Diet Enlightenment" by Rachel L. Pires

Post by ALRyder » 04 Jun 2014, 15:51

I saw the change. Thank you. I should have come back on here and taken the question off once I realized, sorry.

maraman
Posts: 20
Joined: 06 Mar 2017, 13:45
Currently Reading:
Bookshelf Size: 5
Reviewer Page: onlinebookclub.org/reviews/by-maraman.html
Latest Review: "Health Tips, Myths, and Tricks" by Morton E Tavel, MD

Post by maraman » 21 Apr 2017, 02:47

I’d like to share some of my contemplations about the current formula for getting scores. When I saw it, I didn’t like the formulation “unlimited potential loss of points for penalties”. In my opinion, it should be defined more precisely (one or five or…? points for a reminder email, e.g.). I was really astounded when I rechecked my score and saw that from 12 points I went down to -4 (I got two reminder emails after which I reacted promptly). Does anyone else have similar experience?

Locked

Return to “Public Suggestion Box”