Originally Posted by Katra:
“Are you a professional judge? Or maybe just a biased armchair know It all!!”
Judges can be evaluated.
You can test judges marks by asking fellow professionals to mark . its pretty clear that many professionals don't agree with these judges marks, rankings, or comments. Their marks would fail with outside external examination.
You can ask a wide body of public opinion, if they saw what the judges told thm they saw. In this case, a lot of the public saw something different. Its not only DS fans - its common to social media, and other comments on boards like the Guardian - and, unless people can type on two sites at once, its not the same people.
Judges comments have to be internally consistent with their marks. You can't say fantastic, exceptional, mention no problems, and give a 9 - its like writing really complete, well argued and convincing, and giving a B. These judges repeatedly fail to make their marks match their comments.
Judges's mark,s and reasoning, have to be consistent between candidates. You can' t say x matters for candidate one, and then ignore it, or say you are ignoring it, and give candidate 2 full marks. it stinks of favouritism , incompetence, or corruption.
Modern technology means you can see, and replay, what happens, yourself. This means you can see If a guy, who was described as moving really welL, spent just 20% of his time moving
You don't use a marking scale that bunches different performances on the same mark, and then relies on someone pulling one mark out of line with the others, to create differentiation in the scoreboard. That just means one mark has to be defended - as being significantly better or worse, and one judge is seen to be creating a bigger issue than exists.
If you do have to make the marks produce an order, with one judge adjusting the totals, it needs collaborative marking. And that in turn suggest you may have just thought of an order and total, and rigged the marks to produce it. And that, in turn, suggests the question of when the total was agreed. You each need to mark blind, and not look like you have a set order decided, before you started marking anything.
You don't mark what you are not qualified to mark - dancers don't get to be judges on acting. The dance captain doesn't give acting notes for good reason. Only Craig produces thing, s and he's not known for acting masterpieces. Acting is for the public to judge - in so far as they can see anything, on TV. And if the public don't see enough to judge , nor can they believe a judge who tells them how emotional it was.
Some comments are inherently stupid, and suggest criteria that shouldn't be criteria, and need more thought. You can' t , for example,tell people they can't score highly - because they are too young to act the emotions , its essentially an argument that anyone young shouldn't apply . By that logic , you couldn't examine 16 year olds on any issue involving anything they hadn't experienced, and you could mark anyone down for lacking height, excessive strength or unusual flexibility. If you mark Claudia, you consider her age, allow for her height, but also count what she's doing, thats more difficult than anything else going on.