Reviewer Score Suggestion

(Formerly the "Support, Feedback and Forum Announcements" forum.)
Please help us make Online Book Club even better! Please post suggestions, feedback and ideas for new features. Wild brainstorming and potentially 'crazy ideas' are super-strongly encouraged! :)

For new members (or old members who run into an issue), please make a post in this forum asking any questions you have about using the site and how it works that are not answered in the FAQ. Not only are we happy help you, but also we can use your feedback to make the site better for tomorrow's new member! A lot of the instructions throughout the site and answers in the FAQ are there because someone else pointed out that it wasn't clear before.

---

IMPORTANT: The Public Suggestion Box is NOT for discussing issues with the Review Team. If you are a reviewer and need help, please first check the Review Team Page and then if you still need help use the Review Team Support Forum. If you are an author and need help, please first check the Author Dashboard and if that does not resolve your issue use the private contact form. For reference, there is a contact link on every page of the website.

---

To ensure the above procedures are used, posts by new members in the Suggestion Box will be held for moderation.

There are over 240,000 members at OnlineBookClub.org. Following the proper procedures to get help or make suggestions actually helps us help you much faster.
Forum rules
Please do not discuss issues related to the Review Team in the Public Suggestion Box. If you have an issue or question related to the review Team, please check either the Author Dashboard (if you are an author or publisher), or check the Review Team Page (if you are a reviewer).
L_Therese
Posts: 585
Joined: 25 Sep 2013, 05:21
2018 Reading Goal: 50
2017 Reading Goal: 100
2018 Reading Goal Completion: 30
2017 Reading Goal Completion: 40
Currently Reading: American Psycho
Bookshelf Size: 1975
Reviewer Page: onlinebookclub.org/reviews/by-l-therese.html
Latest Review: Dido: The Tragedy of a Woman by David Lane

Re: Reviewer Score Suggestion

Post by L_Therese » 29 Nov 2016, 02:25

Regarding the Editor Analysis Score, can we set a limitation on how far back into the reviewer's history it analyzes? If it can be set so that it only looks at review scores from the past year (for example), new review scores would have a more measurable effect on the editor analysis portion of the reviewer's score. Since there is now a 90% or above threshold for Level 6, this metric needs to be able to move for reviewers who've been at this for awhile.

User avatar
Gravy
Gravymaster of Bookshelves
Posts: 31949
Joined: 27 Aug 2014, 02:02
2018 Reading Goal: 65
2017 Reading Goal: 60
2018 Reading Goal Completion: 67
2017 Reading Goal Completion: 78
Favorite Author: Seanan McGuire
Favorite Book: As many as there are stars in the sky
Currently Reading: Black
Bookshelf Size: 889
fav_author_id: 3249

Post by Gravy » 29 Nov 2016, 05:32

I'll tag @"Scott" :tiphat:
"If you want to know what a man's like, take a good look at how he treats his inferiors, not his equals."

User avatar
Scott
Site Admin
Posts: 3151
Joined: 31 Jul 2006, 23:00
2018 Reading Goal: 52
2017 Reading Goal: 36
2018 Reading Goal Completion: 5
2017 Reading Goal Completion: 25
Favorite Author: Voltairine de Cleyre
Currently Reading: The Woman in the Window
Bookshelf Size: 229
Reviewer Page: onlinebookclub.org/reviews/by-scott.html
Reading Device: B00L89V1AA
Publishing Contest Votes: 960
fav_author_id: 2660
Signature Addition: testtesttest

Post by Scott » 04 Dec 2016, 16:25

Sure, I just made it so only the most recent 30 editor comments will be calculated.

To be clear, that's not the most recent 30 reviews. Rather, it is the most recent 30 editor comments. Some reviews may have multiple editor comments. Some reviews may have none.
"That virtue we appreciate is as much ours as another's. We see so much only as we possess." - Henry David Thoreau

"Non ignara mali miseris succurrere disco." Virgil, The Aeneid
testtesttest

User avatar
bookowlie
Special Discussion Leader
Posts: 7713
Joined: 25 Oct 2014, 09:52
2017 Reading Goal: 52
2017 Reading Goal Completion: 50
Favorite Book: The Lost Continent
Currently Reading:
Bookshelf Size: 321
Reviewer Page: onlinebookclub.org/reviews/by-bookowlie.html
Latest Review: The Dating Policy by Suzanne Eglington

Post by bookowlie » 04 Dec 2016, 18:46

Scott wrote:Sure, I just made it so only the most recent 30 editor comments will be calculated.

To be clear, that's not the most recent 30 reviews. Rather, it is the most recent 30 editor comments. Some reviews may have multiple editor comments. Some reviews may have none.
I'm not really sure what the result of this will be. Does this mean that a reviewer's average editorial score will change?
"I am not afraid of storms, for I am learning how to sail my ship" - Louisa May Alcott

User avatar
anwidmer
Posts: 282
Joined: 30 May 2018, 12:46
2018 Reading Goal: 80
2018 Reading Goal Completion: 26
Favorite Book: The knowing
Currently Reading: The Awakening
Bookshelf Size: 45
Reviewer Page: onlinebookclub.org/reviews/by-anwidmer.html
Latest Review: Becoming the Dragon by Alex Sapegin

Post by anwidmer » 02 Jul 2018, 06:36

Scott wrote:
17 Oct 2016, 13:14
That's very true about the Book of the Day boost.

I'd like to add a 'subscribe' or 'follow' option for reviewers such that the subscribers would get an email alert each time the reviewer has a new review published. This would be similar to how one can currently subscribe to a specific topic or forum to get notified of new posts or topics respectively. This is feature I'd like to add independently of the next sentence. I think it would be a much better way of measuring the popularity and reach of reviewers than views/replies.

The above might mitigate some of the 'Book of the Day boost' so to speak. I could also make the scoring formula a bit more sophisticated so that it measures previous Books of the Day separately from other reviews. Though, it's all averages anyway so with enough reviews it should average out regardless.
Im gettinag alot of views on my reviews however since ive done so many the average is low leaving my points hurting. Maybe a system where once you hit a certain amount of published reviews you get points? I dont know. It just seems unfair that out of almost 2000 views ive only gotten 1 point. And it is because of the fact that im reviewing alot of books. I enjoy doing it, but this has caused me to halt on them until i can get my score up. I dont want to lose the few points i have when the average goes down from a new review

User avatar
CatInTheHat
Bookshelves Moderator
Posts: 2075
Joined: 31 May 2016, 11:53
2018 Reading Goal: 52
2017 Reading Goal: 52
2018 Reading Goal Completion: 90
2017 Reading Goal Completion: 98
Favorite Book: Cry the Beloved Country
Currently Reading: Rogue Captain
Bookshelf Size: 468
Reviewer Page: onlinebookclub.org/reviews/by-catinthehat.html
Latest Review: Lunch Money by Roger M. Cullen
Reading Device: B00JG8GOWU
Publishing Contest Votes: 0

Post by CatInTheHat » 02 Jul 2018, 08:22

anwidmer wrote:
02 Jul 2018, 06:36

Im gettinag alot of views on my reviews however since ive done so many the average is low leaving my points hurting. Maybe a system where once you hit a certain amount of published reviews you get points? I dont know. It just seems unfair that out of almost 2000 views ive only gotten 1 point. And it is because of the fact that im reviewing alot of books. I enjoy doing it, but this has caused me to halt on them until i can get my score up. I dont want to lose the few points i have when the average goes down from a new review
That would allow people to become lax in their participation on the forums. There would be less incentive to interact. As you interact more, the number of views per review will increase to bring the number of points up. I know this from personal experience.
Life without a good book is something the CatInTheHat cannot imagine.


Grateful to get the opportunity to explore new books with those in the OBC.

User avatar
AmySmiles
Previous Member of the Month
Posts: 1255
Joined: 21 Mar 2018, 10:43
Favorite Author: Dana Peters
Currently Reading:
Bookshelf Size: 147
Reviewer Page: onlinebookclub.org/reviews/by-amysmiles.html
Latest Review: Letters From The War by Amanda Bryant
fav_author_id: 154082

Post by AmySmiles » 02 Jul 2018, 08:45

anwidmer wrote:
02 Jul 2018, 06:36
Scott wrote:
17 Oct 2016, 13:14
That's very true about the Book of the Day boost.

I'd like to add a 'subscribe' or 'follow' option for reviewers such that the subscribers would get an email alert each time the reviewer has a new review published. This would be similar to how one can currently subscribe to a specific topic or forum to get notified of new posts or topics respectively. This is feature I'd like to add independently of the next sentence. I think it would be a much better way of measuring the popularity and reach of reviewers than views/replies.

The above might mitigate some of the 'Book of the Day boost' so to speak. I could also make the scoring formula a bit more sophisticated so that it measures previous Books of the Day separately from other reviews. Though, it's all averages anyway so with enough reviews it should average out regardless.
Im gettinag alot of views on my reviews however since ive done so many the average is low leaving my points hurting. Maybe a system where once you hit a certain amount of published reviews you get points? I dont know. It just seems unfair that out of almost 2000 views ive only gotten 1 point. And it is because of the fact that im reviewing alot of books. I enjoy doing it, but this has caused me to halt on them until i can get my score up. I dont want to lose the few points i have when the average goes down from a new review
It takes a lot of time, but I find that commenting on others reviews helps, and Catinthehat is right, being active on the forums helps as well. I know from experience because when I wasn't very active and I wasn't commenting on others reviews I got very little views. I've been very active this past week or so, and have increased my views substantially. Give it a try it can't hurt anything.
Anyone who says they have only one life to live must not know how to read a book.
–Author Unknown

User avatar
anwidmer
Posts: 282
Joined: 30 May 2018, 12:46
2018 Reading Goal: 80
2018 Reading Goal Completion: 26
Favorite Book: The knowing
Currently Reading: The Awakening
Bookshelf Size: 45
Reviewer Page: onlinebookclub.org/reviews/by-anwidmer.html
Latest Review: Becoming the Dragon by Alex Sapegin

Post by anwidmer » 02 Jul 2018, 19:28

Thank you! Another question I have is that if you do a private review do you still get an editor scorecard on it? I ask because it's been taking longer to get one than it normally does

User avatar
anwidmer
Posts: 282
Joined: 30 May 2018, 12:46
2018 Reading Goal: 80
2018 Reading Goal Completion: 26
Favorite Book: The knowing
Currently Reading: The Awakening
Bookshelf Size: 45
Reviewer Page: onlinebookclub.org/reviews/by-anwidmer.html
Latest Review: Becoming the Dragon by Alex Sapegin

Post by anwidmer » 02 Jul 2018, 21:03

Scott wrote:
04 Dec 2016, 16:25
Sure, I just made it so only the most recent 30 editor comments will be calculated.

To be clear, that's not the most recent 30 reviews. Rather, it is the most recent 30 editor comments. Some reviews may have multiple editor comments. Some reviews may have none.

I havent noticed multiple editor comments on my reviews, they appear to come from just one editor. Am i reading this incorrectly? Sorry to be a pain i just want to understand fully.

User avatar
CatInTheHat
Bookshelves Moderator
Posts: 2075
Joined: 31 May 2016, 11:53
2018 Reading Goal: 52
2017 Reading Goal: 52
2018 Reading Goal Completion: 90
2017 Reading Goal Completion: 98
Favorite Book: Cry the Beloved Country
Currently Reading: Rogue Captain
Bookshelf Size: 468
Reviewer Page: onlinebookclub.org/reviews/by-catinthehat.html
Latest Review: Lunch Money by Roger M. Cullen
Reading Device: B00JG8GOWU
Publishing Contest Votes: 0

Post by CatInTheHat » 02 Jul 2018, 22:04

anwidmer wrote:
02 Jul 2018, 21:03
Scott wrote:
04 Dec 2016, 16:25
Sure, I just made it so only the most recent 30 editor comments will be calculated.

To be clear, that's not the most recent 30 reviews. Rather, it is the most recent 30 editor comments. Some reviews may have multiple editor comments. Some reviews may have none.

I havent noticed multiple editor comments on my reviews, they appear to come from just one editor. Am i reading this incorrectly? Sorry to be a pain i just want to understand fully.
Unless it's changed, one's earlier reviews are checked by two editors. I believe that once one becomes more established, it's only one editor that looks at it.
Life without a good book is something the CatInTheHat cannot imagine.


Grateful to get the opportunity to explore new books with those in the OBC.

User avatar
anwidmer
Posts: 282
Joined: 30 May 2018, 12:46
2018 Reading Goal: 80
2018 Reading Goal Completion: 26
Favorite Book: The knowing
Currently Reading: The Awakening
Bookshelf Size: 45
Reviewer Page: onlinebookclub.org/reviews/by-anwidmer.html
Latest Review: Becoming the Dragon by Alex Sapegin

Post by anwidmer » 02 Jul 2018, 23:38

Thank you for the reply!

User avatar
kfwilson6
Previous Member of the Month
Posts: 1915
Joined: 14 Feb 2018, 15:30
2018 Reading Goal: 100
2018 Reading Goal Completion: 93
Currently Reading: Secrets Hidden
Bookshelf Size: 289
Reviewer Page: onlinebookclub.org/reviews/by-kfwilson6.html
Latest Review: Let's Get Sandy at the Beach by Grampa Farkas
Reading Device: B00JG8GOWU

Post by kfwilson6 » 05 Jul 2018, 21:29

Per the initial question which I see is a year and a half old, when you reach level 6 do you stay at that level or are you required to maintain the points?

User avatar
MsTri
Posts: 1082
Joined: 02 Jul 2017, 12:56
2018 Reading Goal: 12
2017 Reading Goal: 0
2018 Reading Goal Completion: 308
Favorite Book: <a href="http://forums.onlinebookclub.org/shelve ... 15362">The Prodigal Son</a>
Currently Reading: A Game of Thrones
Bookshelf Size: 359
Reviewer Page: onlinebookclub.org/reviews/by-mstri.html
Latest Review: The Real News! by John Bernard Ruane
Reading Device: B00L89V1AA

Post by MsTri » 06 Jul 2018, 11:47

kfwilson6 wrote:
05 Jul 2018, 21:29
Per the initial question which I see is a year and a half old, when you reach level 6 do you stay at that level or are you required to maintain the points?
Once a person reaches level 6, their reviews are no longer graded, but a minimum of activity needs to be done to maintain that score. In my case, my final Editor's score was high enough that I really only need to make one or two comments on the BotM forums each month, but I know other level 6s who have to grade a few reviews each month or whatever to keep their level up... With that being said, that doesn't mean we can get sloppy on our reviews, either; I think I read somewhere once that if the quality is consistently going down on the reviews, a demotion is possible; while our reviews are no longer "graded", they're still "checked".

User avatar
kfwilson6
Previous Member of the Month
Posts: 1915
Joined: 14 Feb 2018, 15:30
2018 Reading Goal: 100
2018 Reading Goal Completion: 93
Currently Reading: Secrets Hidden
Bookshelf Size: 289
Reviewer Page: onlinebookclub.org/reviews/by-kfwilson6.html
Latest Review: Let's Get Sandy at the Beach by Grampa Farkas
Reading Device: B00JG8GOWU

Post by kfwilson6 » 06 Jul 2018, 11:53

MsTri wrote:
06 Jul 2018, 11:47
kfwilson6 wrote:
05 Jul 2018, 21:29
Per the initial question which I see is a year and a half old, when you reach level 6 do you stay at that level or are you required to maintain the points?
Once a person reaches level 6, their reviews are no longer graded, but a minimum of activity needs to be done to maintain that score. In my case, my final Editor's score was high enough that I really only need to make one or two comments on the BotM forums each month, but I know other level 6s who have to grade a few reviews each month or whatever to keep their level up... With that being said, that doesn't mean we can get sloppy on our reviews, either; I think I read somewhere once that if the quality is consistently going down on the reviews, a demotion is possible; while our reviews are no longer "graded", they're still "checked".
Interesting. Thank you for the information :)

User avatar
bookowlie
Special Discussion Leader
Posts: 7713
Joined: 25 Oct 2014, 09:52
2017 Reading Goal: 52
2017 Reading Goal Completion: 50
Favorite Book: The Lost Continent
Currently Reading:
Bookshelf Size: 321
Reviewer Page: onlinebookclub.org/reviews/by-bookowlie.html
Latest Review: The Dating Policy by Suzanne Eglington

Post by bookowlie » 06 Jul 2018, 12:27

When you reach Level 6, you have the chance to become an editor. If you edit a monthly minimum number of reviews (on a rolling basis), your editorial quality subscore will stay at the maximum number for that part of your score. If you don't keep up the maximum, your score will go down and it will go back to whatever is the average score for your reviews. Keep in mind that the quota for the edits is on a rolling basis. The system does a look back at the number of edits you've done for the past 30 days, as opposed to the total for the month (for example, June).
"I am not afraid of storms, for I am learning how to sail my ship" - Louisa May Alcott

Post Reply

Return to “Public Suggestion Box”