Improve voting on brainstorm

Bug #197721 reported by Henrik Nilsen Omma
14
Affects Status Importance Assigned to Milestone
ideatorrent
Confirmed
Medium
Unassigned

Bug Description

There are several requests for changes to the brainstorm voting system that might be best addressed with a general rethink of how voting works. I'm opening this bug to start a discussion around the right way of solving it.

The comments are:

* Allow changing of votes
 * We currently don't allow this, but not for any particular reason.
* Provide a 'no vote option'
 * aka a 'I've looked at this but don't care either way'
* A sorting list of the ideas 'I have voted on so far'
* Hide the current score until you vote
 * alleged to skew the vote too much
* [are there more?]

The current voting system has a few unintended side-effects. It seems people are often voting down ideas that are duplicates rather than reporting the dupe (a more discoverable dupe button will help). When someone finally reports a dupe you end up combining an idea with a high + score with one with a large negative score, and that may not be what people intended.

Once an idea gets a negative score below -10 I suspect it has very little chance of recovering. The only hope is to resubmit the idea (at which point it will be duped with the original nagative). Adding a no-vote option might reduce some knee-jerk down-voting.

Some participants seem to want to read through the entire list of ideas and vote on all of them. This is great for us because it gives us good vote coverage and effective triage of the ideas. However, these users are currently forced to choose +1 or -1, which can lead to unfortunate results. Often they simply want to see that an idea has been considered and a zero vote might be most appropriate.

My proposal:

* I suggest we add a 'zero vote' button and that we alow votes to be changed.
* We should also provide a sort view for ideas I've voted on and NOT voted on (a todo-vote list).
* We should continue to show the current score on the front page. It's useful for those who are just looking. Adding the zero vote button should reduce the bias effect.
* On the bug page itself we can add total +1, -1 and 'don' care' votes

I'm attaching a mock-up of what the new buttons might look like in the different states.

Tags: qa-poll
Revision history for this message
Henrik Nilsen Omma (henrik) wrote :
Changed in ubuntu-qa-website:
importance: Undecided → Medium
status: New → Confirmed
Revision history for this message
Estesark (ollie-jl) wrote :

> * [are there more?]

Yes, at least one more which I have been involved in: https://bugs.launchpad.net/ubuntu-qa-website/+bug/196983

> My proposal:
> *I suggest we add a 'zero vote' button and that we alow votes to be changed.
> * We should also provide a sort view for ideas I've voted on and NOT voted on (a todo-vote list).
> * We should continue to show the current score on the front page. It's useful for those who are just looking. Adding the zero vote button should reduce the bias effect.
> * On the bug page itself we can add total +1, -1 and 'don' care' votes

I agree with and support all four of those proposals.

Revision history for this message
Hilton Gibson (hgibson) wrote :
Revision history for this message
Hilton Gibson (hgibson) wrote :

Would it be possible to talk to the www.gnome-look.org people ?
Their rating is a percentage. How do they calculate it ?

Revision history for this message
Przemek K. (azrael) wrote :

If 'Hide the current score until you vote' gets implemented then 'Allow changing of votes' probably shouldn't because people could just randomly vote to see the score, and then change their vote to match their real preference.

Revision history for this message
Ricardo Bertagna (bert-wp) wrote :

I have some proposals for the following questions:
1. How could we fairly show the ideas ?
2. How should we rank the ideas ?
3. How to address the "hot-ideas" ?
----------
1. The brainstorm should count how many times an idea was show. Because that would make sure every idea was exposed the same number of times. If an idea is exposed less than others its voting is biased. So it would solve the problem of fairness giving every title its change to be read equally.

2. The users may vote only for positive or negative ( no need for zero-vote supposing we count the views ). But the rank should not be showed as Positive or Negative. It should rather be showed as a percentage: R = 100 * Vp / (Vn + Vp), where R = the rate, or rank, Vp = positive votes, Vn = negative votes.

3. When you see an idea with rank zero (currently) it could mean no body voted for it. But it could mean 50% voted positive and the other 50% voted negative. If we rank it percentually that problem would be solved. Further more when we reach the point when an idea have acceptance of 50% of the users this means that idea is somewhat conflicting or popular or in another context "hot", because it really divides the opinions!

I think we could give the high-conflict-opnion ideas a higher score so that it's more exposed giving it the chance to be solved (I mean solving by escaping it from the "uncertainty region" around 50%). This may be accomplished by this formula:

P = Q*[(-R^2) / (R^2 + K) + 1.0]

Where Q is the number of views balanced by R, the renormalized percentual vote rank, and K controls how fast the rank falls to zero. What this formula does?

a. When an idea have more consensus (far from 50% critical region at zero when normalized) it will have its rank attenuated.
b. When an idea is far form consensus it will have it's viewing rank closer to its real count.

Note that the voting rank(R) is different from the scheduling rank (P), the former is meant to show how accepted an idea is and the latter is meant to show ideas fairly and stimulate solving conflicts in hot-ideas!

We could use another scheme, it's just a proposal. The number of view could also be used for some aditional information in the future like answering (how much percent of the users comment out something and so on).

Thanks.

Revision history for this message
clubsoda (clubsoda) wrote :

If there's a risk of people voting down duplicates even though they like the actual idea, then how about adding a "report duplicate" button right next to the voting arrows?

affects: ubuntu-qa-website → ideatorrent
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.