Register | Sign In


Understanding through Discussion


EvC Forum active members: 65 (9162 total)
2 online now:
Newest Member: popoi
Post Volume: Total: 915,819 Year: 3,076/9,624 Month: 921/1,588 Week: 104/223 Day: 2/13 Hour: 0/1


Thread  Details

Email This Thread
Newer Topic | Older Topic
  
Author Topic:   New Feature: Message Rating System
Admin
Director
Posts: 12998
From: EvC Forum
Joined: 06-14-2002
Member Rating: 2.3


Message 1 of 258 (526625)
09-28-2009 8:15 PM


I've just installed a new feature: a message rating system.
Each message can now be rated on a scale from 1 to 5. Little rating buttons now appear in the left hand column next to each message. Messages that have been rated display their rating. Members whose messages have been rated are given a rating which is displayed with their profile info next to each message, and with their member profiles.
This is just the bare bones. In the future the feature will be made graphically attractive (something like the Netflix approach), rankings of the best posts by week, month, year, and all-time will be provided, and members will be able to comment on rated messages.

--Percy
EvC Forum Director

Replies to this message:
 Message 2 by NosyNed, posted 09-28-2009 8:20 PM Admin has replied
 Message 3 by Theodoric, posted 09-28-2009 8:28 PM Admin has replied
 Message 6 by Dr Jack, posted 09-29-2009 5:00 AM Admin has seen this message but not replied
 Message 49 by shalamabobbi, posted 08-15-2010 1:15 AM Admin has seen this message but not replied

  
NosyNed
Member
Posts: 8996
From: Canada
Joined: 04-04-2003


Message 2 of 258 (526628)
09-28-2009 8:20 PM
Reply to: Message 1 by Admin
09-28-2009 8:15 PM


Logged in
It may not be obvious that you have to be logged in to get the buttons.

This message is a reply to:
 Message 1 by Admin, posted 09-28-2009 8:15 PM Admin has replied

Replies to this message:
 Message 4 by Admin, posted 09-28-2009 8:30 PM NosyNed has not replied

  
Theodoric
Member
Posts: 9076
From: Northwest, WI, USA
Joined: 08-15-2005
Member Rating: 3.7


Message 3 of 258 (526630)
09-28-2009 8:28 PM
Reply to: Message 1 by Admin
09-28-2009 8:15 PM


Is 1 good and 5 bad?
Or is it the other way around?
Edited by Theodoric, : No reason given.

Facts don't lie or have an agenda. Facts are just facts

This message is a reply to:
 Message 1 by Admin, posted 09-28-2009 8:15 PM Admin has replied

Replies to this message:
 Message 5 by Admin, posted 09-28-2009 8:30 PM Theodoric has not replied

  
Admin
Director
Posts: 12998
From: EvC Forum
Joined: 06-14-2002
Member Rating: 2.3


Message 4 of 258 (526631)
09-28-2009 8:30 PM
Reply to: Message 2 by NosyNed
09-28-2009 8:20 PM


Re: Logged in
NosyNed writes:
It may not be obvious that you have to be logged in to get the buttons.
The software checks to make sure you're logged in before it will display the buttons. This is because each member's rating for a message is stored in the database by his member ID. The database is updated directly from the mouse-click using Ajax.
But what a wonderful coincidence that you're on-line! As I mentioned, I want to make the feature more graphically attractive. Can I get an icon that looks like this, only icon-size, of course:

--Percy
EvC Forum Director

This message is a reply to:
 Message 2 by NosyNed, posted 09-28-2009 8:20 PM NosyNed has not replied

  
Admin
Director
Posts: 12998
From: EvC Forum
Joined: 06-14-2002
Member Rating: 2.3


Message 5 of 258 (526633)
09-28-2009 8:30 PM
Reply to: Message 3 by Theodoric
09-28-2009 8:28 PM


1 is lowest or worst, 5 is highest or best.

--Percy
EvC Forum Director

This message is a reply to:
 Message 3 by Theodoric, posted 09-28-2009 8:28 PM Theodoric has not replied

  
Dr Jack
Member
Posts: 3514
From: Immigrant in the land of Deutsch
Joined: 07-14-2003
Member Rating: 8.7


Message 6 of 258 (526700)
09-29-2009 5:00 AM
Reply to: Message 1 by Admin
09-28-2009 8:15 PM


So, what's the gain in this feature?
My experience on other webforums is that post rating rapidly becomes little more than a way of saying "ya! boo! you suck!". Given the predominance of resident evolutionists here I imagine it will simply emphasise that weakness.

This message is a reply to:
 Message 1 by Admin, posted 09-28-2009 8:15 PM Admin has seen this message but not replied

Replies to this message:
 Message 7 by Granny Magda, posted 09-29-2009 5:48 AM Dr Jack has seen this message but not replied

  
Granny Magda
Member
Posts: 2462
From: UK
Joined: 11-12-2007
Member Rating: 4.0


Message 7 of 258 (526709)
09-29-2009 5:48 AM
Reply to: Message 6 by Dr Jack
09-29-2009 5:00 AM


I have to say I agree with Mr Jack. I am dubious as to the value of this. Creationists are under under enough pressure as it is, this feature is just going to rub salt in the wound. I see that poor old Peg has already been stuck with a 1 rating.
People are just going to vote low for messages they disagree with and high for those that they approve of, regardless of writing style or message quality. It will discourage creationist participation and encourage divisiveness.
Mutate and Survive

"A curious aspect of the theory of evolution is that everybody thinks he understands it." - Jacques Monod

This message is a reply to:
 Message 6 by Dr Jack, posted 09-29-2009 5:00 AM Dr Jack has seen this message but not replied

  
Kitsune
Member (Idle past 4301 days)
Posts: 788
From: Leicester, UK
Joined: 09-16-2007


Message 8 of 258 (526710)
09-29-2009 5:58 AM


I third that. I think the ratings could potentially distract people from the actual discussion. And I have experience of being an unpopular poster on a creationist forum; the more science I posted, the fewer stars I got. I have a feeling that the unpopular things I say here could go the same way, though I think most of the regular posters aren't petty enough to bother.
I wonder if the system could be tweaked so that the ratings are used to flag up exemplary posts? So one star could mean "this post is quite good" and 5 stars could mean "this is bloody marvellous and everyone here should take a look." Though I'm a bit hazy, too, on what's meant by quality. Quality to me is RAZD's recent posts about homo erectus but it's also Dr. Adequate's razor-sharp posts which don't always contain a lot of information but are just damn funny.

  
PaulK
Member
Posts: 17822
Joined: 01-10-2003
Member Rating: 2.2


Message 9 of 258 (526729)
09-29-2009 8:00 AM


I agree that a negative rating is not worth having. If we have to have a message rating system, I'd like even the lowest rating to express approval. Not that I think that even that is a great idea.
I'd rather have a system that flagged problem posts for moderator attention. The "Post of the Month" feature is great for reporting good posts, the "report problem posts" thread is not so good.

  
Admin
Director
Posts: 12998
From: EvC Forum
Joined: 06-14-2002
Member Rating: 2.3


(1)
Message 10 of 258 (526737)
09-29-2009 8:26 AM


How good an idea is this?
Responding to the last few posts, I don't have any experience with message rating systems at other boards, but the downside risks mentioned above do seem real to me. The intent is consistent with what LindaLou mentioned at one point, and is the same as the Post of the Month threads. Members should rate messages as to their quality, not as to whether they agree or disagree, or whether they like or dislike the author.
In case it helps, I'll describe the algorithm for calculating member ratings that I'll be installing soon. The current algorithm is extremely simplistic, just the average rating across all of the ratings other member's have assigned (people might have noticed that they cannot rate their own posts).
The new algorithm will first calculate a single rating from each of the other members by averaging all their ratings for the member whose rating is being calculated. Then the member's rating will be the average of all these ratings from all the other members. This prevents any single member from overly influencing a member's rating by visiting all that member's old messages and giving every single one a low or high rating. When someone does this, all those ratings still only count once when calculating a member's rating.
One advantage of the rating system here is that your feedback goes directly to the implementer. This isn't a case of somebody buying bulletin board software and then one day deciding to enable the message rating feature. This is a case of somebody implementing a bulletin board software system from scratch, and then one day finally getting around to implementing a message rating system. Since this person would like to one day market this software, features like message rating (and many other features, too) are essential in order to be competitive. EvC Forum is actually the testbed for dBoard bulletin board software. The current membership are the guinea pigs for this development process, and the big advantage is that I'm not only listening to all feedback, I can actually go in and modify the software in reaction to that feedback.
I hope people have noticed that this board has features that no other bulletin board system has, and this will be the case with the message rating system, too, it will just take a little more time. Sometime soon you'll be able to list best messages of the day, week, month, year and all-time, not just for the current, but for any. And every message with one or more ratings will be able to collect comments about the message and why it is good or bad or whatever, similar to the Post of the Month threads but much more flexible since any and all can add comments and discussions can develop. It will be as if every rated message had its own thread.

--Percy
EvC Forum Director

Replies to this message:
 Message 11 by New Cat's Eye, posted 09-29-2009 10:35 AM Admin has seen this message but not replied
 Message 13 by RAZD, posted 09-30-2009 9:00 PM Admin has seen this message but not replied
 Message 16 by Perdition, posted 10-02-2009 11:43 AM Admin has seen this message but not replied

  
New Cat's Eye
Inactive Member


(1)
Message 11 of 258 (526807)
09-29-2009 10:35 AM
Reply to: Message 10 by Admin
09-29-2009 8:26 AM


Re: How good an idea is this?
I think there's gonna be a lot of 1's and 5's with very little 2-4's.
Another thing I've seen that might work good is just a thumbs up or thumbs down. A post starts at a "0" and then each thumbs up gives it a +1 and each thumbs down gives is -1. You can tell how much people like a post by how far positive or negetive it goes.
I don't think you should scrap the idea but I don't think a 1-5 rating system yields the best results.

This message is a reply to:
 Message 10 by Admin, posted 09-29-2009 8:26 AM Admin has seen this message but not replied

  
CosmicChimp
Member
Posts: 311
From: Muenchen Bayern Deutschland
Joined: 06-15-2007


Message 12 of 258 (526811)
09-29-2009 10:45 AM


This is OUTSTANDING! My favorite forum has just gotten noticeably better. The hits just keep coming.
Edited by CosmicChimp, : No reason given.

  
RAZD
Member (Idle past 1405 days)
Posts: 20714
From: the other end of the sidewalk
Joined: 03-14-2004


Message 13 of 258 (527328)
09-30-2009 9:00 PM
Reply to: Message 10 by Admin
09-29-2009 8:26 AM


Re: How good an idea is this?
Hi Percy,
The intent is consistent with what LindaLou mentioned at one point, and is the same as the Post of the Month threads. Members should rate messages as to their quality, not as to whether they agree or disagree, or whether they like or dislike the author.
That will be difficult to control.
I've been on boards where ratings were used to grade participants from the lurkers, who did not have to justify their ratings -- it could be that they honestly rated people OR it could be that they used the ratings as part of their campaign to prove their side.
Certainly it is difficult to objectively rate a post that you are debating against, and this will be the average result.
You might want fewer buttons with some guide as to their meaning
Good Point/s
Above Average Post
Post of the Month Material
Enjoy.

we are limited in our ability to understand
by our ability to understand
Rebel American Zen Deist
... to learn ... to think ... to live ... to laugh ...
to share.


• • • Join the effort to solve medical problems, AIDS/HIV, Cancer and more with Team EvC! (click) • • •

This message is a reply to:
 Message 10 by Admin, posted 09-29-2009 8:26 AM Admin has seen this message but not replied

Replies to this message:
 Message 14 by Minnemooseus, posted 10-01-2009 3:51 AM RAZD has seen this message but not replied

  
Minnemooseus
Member
Posts: 3941
From: Duluth, Minnesota, U.S. (West end of Lake Superior)
Joined: 11-11-2001
Member Rating: 10.0


Message 14 of 258 (527346)
10-01-2009 3:51 AM
Reply to: Message 13 by RAZD
09-30-2009 9:00 PM


3 thumbs up for a 3 button system
For the 1 to 5 system, I find the 3 to be pretty useless, and the 1 and 2 to be near totally useless. Why bother trying to rate if a message is average, poor or profoundly bad.
Good Point/s
Above Average Post
Post of the Month Material
I like! A 1, 2, or a 3 system where you only flag messages you find to have some special good quality (something better than "OK, but so what"). Keep track of them separately for the individual messages (with maybe also an average) and do a number of ratings and average and for the member values. Maybe you could even offer a message filter that only shows messages over a chosen threshold.
Of course, maybe there could be a forth button to cover what had been the old 1, 2 and 3's. The "apathetic" rating button. I don't think we need an "atheistic" button, for messages one might think don't actually exist.
Moose

This message is a reply to:
 Message 13 by RAZD, posted 09-30-2009 9:00 PM RAZD has seen this message but not replied

Replies to this message:
 Message 17 by Stile, posted 10-02-2009 12:55 PM Minnemooseus has seen this message but not replied
 Message 18 by Adminnemooseus, posted 10-02-2009 9:52 PM Minnemooseus has seen this message but not replied

  
onifre
Member (Idle past 2951 days)
Posts: 4854
From: Dark Side of the Moon
Joined: 02-20-2008


(1)
Message 15 of 258 (527633)
10-01-2009 11:46 PM


If you actually give a shit what your rating is you need to get a life...LOL
Really? What does a rating mean?
- Oni

  
Newer Topic | Older Topic
Jump to:


Copyright 2001-2023 by EvC Forum, All Rights Reserved

™ Version 4.2
Innovative software from Qwixotic © 2024