DS Forums

 
 

Should The Scoring System Be Changed?


Reply
Thread Tools Search this Thread
Old 30-10-2015, 20:36
Monkseal
Forum Member
 
Join Date: Dec 2008
Posts: 7,654
They say it and the tied tables will not give equal weighting. I am sure public votes are very very rarely going to be tied, so last week 12 couples left top would get 12 and bottom would get 1. Where as with the judges scores always tied the top got 12 and the bottom got 5. How is that equally weighted?. It's biased towards judges scoring.
If there's a lower spread in the judges scores then it gives the public score more weighting than the judges, not less. To push it to the extreme, If all the judges ranking scores were either 1,000,001 or 1,000,000 but the public ranking scores were 10 to 1, the public scores would be far more important, even though the judges numbers were higher.

The best way to work out comparative weight of importance of two (or more) sets of marks producing a combined ranking is to take the standard deviation of each range of marks. The higher the standard deviation, the more "weight" the ranking scale has. Hence why people argue that Craig is the most influential judge, as his standard deviation is usually the highest.
Monkseal is offline   Reply With Quote
Please sign in or register to remove this advertisement.
Old 30-10-2015, 20:40
Ellie1967
Forum Member
 
Join Date: Nov 2014
Posts: 1,727
Tied votes actually make it harder for lower placed (but still able) celebs to escape the dance off.
I thought ties made it easier for lower placed celebs to escape the dance off, provided they are popular with the public, because their combined score is higher than it would be if the judges marks went all the way down to 1 instead of, say, 5
Ellie1967 is offline   Reply With Quote
Old 30-10-2015, 20:43
davegold
Forum Member
 
Join Date: Oct 2013
Posts: 1,217
Any fans of a celeb that goes out should not blame the system, the judges, or anyone else. The celeb needed more public votes, that's all. The public gets what the public wants and if the public really want a celeb to stay in the competition then that's what happens.
davegold is offline   Reply With Quote
Old 30-10-2015, 20:44
Alli-F
Forum Member
 
Join Date: Jun 2004
Location: DOTS are evil!
Posts: 32,338
I thought ties made it easier for lower placed celebs to escape the dance off, provided they are popular with the public, because their combined score is higher than it would be if the judges marks went all the way down to 1 instead of, say, 5


It does. Because of ties the bottom celeb may have 4 or 5 points instead of 1. So much easier to climb over other celebs in public vote.
Alli-F is offline Follow this poster on Twitter   Reply With Quote
Old 30-10-2015, 20:45
Fred.
Forum Member
 
Join Date: Oct 2015
Posts: 1,587
Preferred the old way of the public vote deciding who is eliminated, but I can see why the BBC has the dance-off.

BBC's funding has been reduced one way or another over the last few years, so the Sunday night show with the dance-off is a cheaper way of producing a new, good programme with lots of viewers. (Sunday night show used to be just edited highlights.)

Celebrities don't like it to be known that they were bottom of the public vote and the dance-off fudges that. That's why I doubt they'll ever let the 'public' have the casting vote rather than Len.

But once you're in the know about the scoring system, you can work out who had the lowest public vote
Fred. is offline   Reply With Quote
Old 30-10-2015, 20:46
marinamau
Forum Member
 
Join Date: Oct 2010
Posts: 4,213
They say it and the tied tables will not give equal weighting. I am sure public votes are very very rarely going to be tied, so last week 12 couples left top would get 12 and bottom would get 1. Where as with the judges scores always tied the top got 12 and the bottom got 5. How is that equally weighted?. It's biased towards judges scoring.
I thought ties made it easier for lower placed celebs to escape the dance off, provided they are popular with the public, because their combined score is higher than it would be if the judges marks went all the way down to 1 instead of, say, 5
Exactly! The "new" (series 9 onwards) system allows for the public favourites escape the dance off pretty easily with ties in the leaderboard. Basically, Jeremy could have been 3rd lowest in the public vote (only Ainsley and Jamelia having less votes) for him to avoid the dance off, as in equal points (judges 3 + popular vote 2 = 5 trumps judges 4 + popular vote 1=5 )
marinamau is offline   Reply With Quote
Old 30-10-2015, 20:49
Tall Paul
Guest
 
Join Date: Oct 2010
Posts: 8,584
Any fans of a celeb that goes out should not blame the system, the judges, or anyone else. The celeb needed more public votes, that's all. The public gets what the public wants and if the public really want a celeb to stay in the competition then that's what happens.
The fact ppl turned on pixie was stupid and downright cruel IMHO, but to be fair BBC didn't edit her all that well be it VTs, judges comments, the fact that although brilliant she didn't tell a story all that much etc.......

It's a shame really that she went as in fairness she was as good as frankie and Caroline. I think the BBC staff influenced lens casting vote decision to put simon through. Trouble was it wasn't a credible decision len made.
Tall Paul is offline   Reply With Quote
Old 30-10-2015, 20:54
Alli-F
Forum Member
 
Join Date: Jun 2004
Location: DOTS are evil!
Posts: 32,338
Any fans of a celeb that goes out should not blame the system, the judges, or anyone else. The celeb needed more public votes, that's all. The public gets what the public wants and if the public really want a celeb to stay in the competition then that's what happens.


As mentioned before, that wasn't the case in the Tom/Lisa/Rachel semi final. He couldn't escape the dance off even topping the vote and that's why system changed.
Alli-F is offline Follow this poster on Twitter   Reply With Quote
Old 30-10-2015, 21:14
Ellie1967
Forum Member
 
Join Date: Nov 2014
Posts: 1,727
Any fans of a celeb that goes out should not blame the system, the judges, or anyone else. The celeb needed more public votes, that's all. The public gets what the public wants and if the public really want a celeb to stay in the competition then that's what happens.
Not necessarily, because of the dance-off. Once it gets to the end with fewer people, the person with the highest public vote can still mathematically end up in the dance off and be sent home by the judges.
Ellie1967 is offline   Reply With Quote
Old 30-10-2015, 21:24
Monkseal
Forum Member
 
Join Date: Dec 2008
Posts: 7,654
Not necessarily, because of the dance-off. Once it gets to the end with fewer people, the person with the highest public vote can still mathematically end up in the dance off and be sent home by the judges.
If there are no ties, the person with the highest public vote canalways mathematically end up in the dance off and be sent home by the judges.
Monkseal is offline   Reply With Quote
Old 30-10-2015, 21:27
Cadiva
Forum Member
 
Join Date: Nov 2007
Location: In sunny (hah!) Yorkshire
Posts: 13,940
So, the important bit it's not the scoring but the "10 points", "9 points" which would be the equivalent of their places in the leaderborad, is that it?)
Yes, the actual points they score is irrelevant, it's the place they are on the leaderboard which gives them the number which is then added to the public vote placement.
Cadiva is offline Follow this poster on Twitter   Reply With Quote
Old 30-10-2015, 21:33
robbleona
Forum Member
 
Join Date: Mar 2009
Posts: 1,833
If four couples tied on the same score they will each get maximum points which is fair enough but the couple finishing fifth only gets one point less. Other than simplicity there are no pluses to this marking system. It gives an advantage to the poorer dancers and more weight to the popularity vote as opposed to dancing ability.
so what? its an ENTERTAINMENT show as well as a dancing show...
plus the comments made about series 6!!
robbleona is offline   Reply With Quote
Old 30-10-2015, 21:33
VicsMum
Forum Member
 
Join Date: Oct 2010
Location: SESomething
Posts: 2,460
The judges scores should be purely figurative then, working only as "guidance". I don't suppose it's fair that the public's favourite can end in the dance off and risk being sent home. Keep the dance off to keep them happy, but it would be fair that realistically the two couples with least votes ended up in the b2
VicsMum is offline   Reply With Quote
Old 30-10-2015, 21:43
robbleona
Forum Member
 
Join Date: Mar 2009
Posts: 1,833
The judges scores should be purely figurative then, working only as "guidance". I don't suppose it's fair that the public's favourite can end in the dance off and risk being sent home. Keep the dance off to keep them happy, but it would be fair that realistically the two couples with least votes ended up in the b2
yes....like in that show on the 'other side'......!

thats the real debate...should it be the public who decide, or 4 judges who have always had their 'favourites' and mark them accordingly?
robbleona is offline   Reply With Quote
Old 30-10-2015, 21:46
spider9
Forum Member
 
Join Date: Oct 2005
Location: On the sofa
Posts: 4,319

The best way to work out comparative weight of importance of two (or more) sets of marks producing a combined ranking is to take the standard deviation of each range of marks. The higher the standard deviation, the more "weight" the ranking scale has. Hence why people argue that Craig is the most influential judge, as his standard deviation is usually the highest.
Can't believe no one has picked up on Monkseal's perfectly simple explanation here.

Statistics are beautiful to some people.
spider9 is offline   Reply With Quote
Old 30-10-2015, 21:46
BeyonceCastle
Forum Member
 
Join Date: Sep 2013
Posts: 513
Oh, I thought you meant different like the French...they do separate marks for artistic and technical from week 5 which is an interesting way of looking at it as even then, artistic doesn't necessarily mean Jeremy
BeyonceCastle is offline   Reply With Quote
Old 30-10-2015, 21:47
TerryM22
Forum Member
 
Join Date: Sep 2009
Posts: 17,987
If four couples tied on the same score they will each get maximum points which is fair enough but the couple finishing fifth only gets one point less. Other than simplicity there are no pluses to this marking system. It gives an advantage to the poorer dancers and more weight to the popularity vote as opposed to dancing ability.
In a word yes, let the viewers decide.
TerryM22 is offline   Reply With Quote
Old 30-10-2015, 22:49
natalian
Forum Member
 
Join Date: Nov 2011
Posts: 2,589
Personally, I think it is mad that the couples can get a random number of points for the same position from week to week depending on how many might be tied in the judges scores. The whole purpose of the judges scores is to try to rank the couples. If they end up tied then the judges should be asked to break the tie by determining how the tied couples rank (as indeed they did in one Christmas special where four couples tied at teh top of the leaderboard) We all know that two couples who both get, say, a 'Severrrrn' aren't in reality going to be equal. It is just that there are too many couples and too few scores to be able to create a proper ranking order.
natalian is offline   Reply With Quote
Old 30-10-2015, 23:24
tabithakitten
Forum Member
 
Join Date: May 2008
Posts: 7,240
Yes, they should absolutely change the scoring system.

Jay, Anita, Helen and Katie should all be marked out of 20.
Jeremy, Jamelia and Georgia should be marked out of 10.
Carol, Kirsty and Kellie should be marked out of 5.
Peter should take a bow and be given a turnip.

This is until the semi-finals where Jay should be marked out of 100, Anita out of 6, Katie and Helen out of 2 and a half, and whoever's left should be pushed around the floor on an oiled teatray until they fall off.
tabithakitten is offline   Reply With Quote
Old 30-10-2015, 23:26
TerryM22
Forum Member
 
Join Date: Sep 2009
Posts: 17,987
Personally, I think it is mad that the couples can get a random number of points for the same position from week to week depending on how many might be tied in the judges scores. The whole purpose of the judges scores is to try to rank the couples. If they end up tied then the judges should be asked to break the tie by determining how the tied couples rank (as indeed they did in one Christmas special where four couples tied at teh top of the leaderboard) We all know that two couples who both get, say, a 'Severrrrn' aren't in reality going to be equal. It is just that there are too many couples and too few scores to be able to create a proper ranking order.
They could be accused of fixing things if that were to happen.
TerryM22 is offline   Reply With Quote
Old 30-10-2015, 23:30
natalian
Forum Member
 
Join Date: Nov 2011
Posts: 2,589
They could be accused of fixing things if that were to happen.
They are accused of fixing things on a weekly basis anyway. What that accusation really means is: "the judges didn't like my favourite as much as me therefore it must be fixed" or "the judges liked the one I don't like more than me therefore it must be fixed". In reality it isn't fixed and nor would it be fixed if the judges were to rank the tied couples.

I would note that if the judges had ranked the tied couples in the semi final of series 6 the Tom Chambers controversy would not have happened as it would have been mathematically possible for him to be saved from the dance off on the viewer vote.
natalian is offline   Reply With Quote
Old 31-10-2015, 00:16
Fred.
Forum Member
 
Join Date: Oct 2015
Posts: 1,587
Since they've had the dance-off - though I don't like it I can see why the BBC have it - have always thought they should go by just the public vote from the semi-final.

Though they'd lose the dance-off on the Sunday show, they'd still have the elimination of one person and I'm sure they can find something to fill in the few minutes space just for one week.

However it's much better now the judges have no real say in the final and they have 4 pairs - unless someone is injured - hope not!!

Amazed me at the time that they had to say 'no elimination' that week in the middle of the show in series 6 - after someone had explained the maths.

Often wondered who it was - did someone phone in? a member of the audience? the electrician? Bruno?!?!?
Fred. is offline   Reply With Quote
Old 31-10-2015, 00:59
BeeBumble
Forum Member
 
Join Date: Nov 2009
Posts: 5,624
I wasn't watching during series 6 would someone care to explain what happened during the semi-final?
BeeBumble is offline   Reply With Quote
Old 31-10-2015, 01:49
Cadiva
Forum Member
 
Join Date: Nov 2007
Location: In sunny (hah!) Yorkshire
Posts: 13,940
The judges scores should be purely figurative then, working only as "guidance". I don't suppose it's fair that the public's favourite can end in the dance off and risk being sent home. Keep the dance off to keep them happy, but it would be fair that realistically the two couples with least votes ended up in the b2
The Judges' scores are figurative and for guidance, it's who they think are the best each week. When it comes to a tie, the public vote carries more weight and always has, same as how in the final it's only the public vote which counts.

I wasn't watching during series 6 would someone care to explain what happened during the semi-final?
Alli explained it earlier in the thread. Because the Judges' tied Lisa and Rachel there was no way Tom could avoid being in the dance off even if he had been the public favourite (which he was), which meant people paying to vote for him were effectively "throwing away money" as he couldn't be saved from the Dance Off.
As there'd been huge controversy about phone voting on other (mostly commercial but did include Blue Peter from the BBC) shows, the Beeb had no choice but to put all three through.

The problem with Lisa/Rachel/Tom semi final was they tied Lisa and Rachel at top of leaderboard on 3 points each. Back then Tom got 1 point, not 2 like he'd get now so there is no way he could avoid the dance off because even if he topped the public vote he'd get 3 points from public & 1 from judges, so vote looked like

Rachel 3 from judges 2 from public = 5

Lisa 3 from judges 1 from public = 4

Tom 1 from judges 3 from public = 4

And the judges would obviously choose Lisa in a dance off as she'd topped the leaderboard, so they put all three through to the final and now person below ties get 1 less not 2 less points.
Cadiva is offline Follow this poster on Twitter   Reply With Quote
Old 31-10-2015, 08:42
VintageWhine
Forum Member
 
Join Date: Nov 2010
Posts: 672
They say it and the tied tables will not give equal weighting. I am sure public votes are very very rarely going to be tied, so last week 12 couples left top would get 12 and bottom would get 1. Where as with the judges scores always tied the top got 12 and the bottom got 5. How is that equally weighted?. It's biased towards judges scoring.
Quite right, except for the last sentence: it's actually biased towards the public vote, as the judges range becomes compressed when there are ties, and the poorer performers get boosted.

There's actually another method (which still maintains the immunity from a Chambersgate situation), but which does indeed favour the judges, if that's what you want to do:

Allocate 1 point to the bottom pair, and 2 points to the next one up, etc. In the event of a tie, the tied couples all get the same points as they would if they hadn't been tied. BUT the next pair(s) up, instead of getting just 1 more point, get boosted by however many couples were involved in the tie.

For example, say there are 7 couples: one at the top of the judges' scores, one in second place, the next 4 tied, and one at the bottom. The bottom pair gets 1 point, the next 4 each get 2 points, the second-placed couple gets 6 points, and the top couple gets 7 points. So, the full range of 1 to 7 points is preserved.

This method tends to help the best performers, which in my view is preferable to what we have now. But what do I know...

Actually, what we need is a system which isn't corrupted by tied scores. There are umpteen ways in which this could be done (most of them fairly radical), but I rather think the BBC actually prefers the extra jeopardy which results from these random scoring anomalies.
VintageWhine is offline   Reply With Quote
 
Reply




 
Forum Jump


All times are GMT. The time now is 08:01.