Latest Updates:
Page Index Toggle Pages: 1 2 3 [4] 5 
Topic Tools
Very Hot Topic (More than 25 Replies) Dvorkovich on cheating (Read 26742 times)
an ordinary chessplayer
God Member
*****
Offline


I used to be not bad.

Posts: 1807
Location: Columbus, OH (USA)
Joined: 01/02/15
Re: Dvorkovich on cheating
Reply #18 - 08/27/20 at 17:01:04
Post Tools
@hicetnunc - Yes, it's a good thought experiment. But what makes it convincing is the 1600 has an OTB rating and OTB games to examine. This is already more evidence, and more kinds of evidence than just the algorithm applied to some online moves. I would find the OTB games especially persuasive, as this is an apples to apples comparison.

@Confused_by_Theory - "Borderline cases will exist". Yes, absolutely, this is an outstanding point. No matter where the border is placed, there will be borderline cases.

@MNb - Relating to DNA evidence, of course it's not 100% reliable and of course we don't reject it for being less than 100%. But is it literally the only piece of evidence against the accused? Like: we found some DNA on a murder victim, we matched it to you based on a database, you are going to jail. I know many people would say, "DNA, you did it", but I hope that in a court of law there would be additional evidence.

@everyone - Please don't take my attitude to mean that online players can't be banned. I actually don't have any problem with players being banned for "strong suspicion of cheating", which is all that I think an algorithm can provide -- as long as the ban is narrow. Meaning, we don't ban a player from OTB events for suspicion of online cheating. Meaning, if we can meet a rigorous legal proof of cheating, then a broad ban is justified.

So my ideal policy would be, in the "terms of competition", it's specified if the algorithm says you are using a computer, you are penalized in this event, or on this server, or by this organizer, or whatever the terms say. National federations and FIDE should not be extending these bans, only in the case of the national federation or FIDE is the organizer should they be applying a ban. And ban only online play.

But if you are brain-dead enough to, for instance, leave your webcam on and thus we have proof beyond a reasonable doubt, then the sanctions can be broad in scope, e.g. banned from OTB events as well.
  
Back to top
 
IP Logged
 
hicetnunc
Full Member
***
Offline


"Do something scary every
day"

Posts: 237
Location: Paris, France
Joined: 01/04/03
Gender: Male
Re: Dvorkovich on cheating
Reply #17 - 08/27/20 at 11:46:01
Post Tools
an ordinary chessplayer wrote on 08/27/20 at 04:09:59:
(...) People get mesmerized by the large number of moves fed into the algorithm, and start to believe that the laws of large numbers apply. It's true in the computation of the algorithm sense, but in the legal sense it boils down to a single fact. And it's an indirect fact.


Why wouldn't the law of large numbers apply, if humans actually do play different moves than computers ? I mean, how is it different from estimating your odds of beating a much stronger player in a 2-games, vs. 6-games or 12 games match ?

I don't know about the legal aspect, but I don't find unreasonable to draw conclusions from a large enough # of moves/games provided your detection model is robust. The moves have been played, even if it was online.
  

48 yo, 1920 elo
Back to top
 
IP Logged
 
MNb
God Member
*****
Offline


Rudolf Spielmann forever

Posts: 10777
Location: Moengo
Joined: 01/05/04
Gender: Male
Re: Dvorkovich on cheating
Reply #16 - 08/27/20 at 10:11:01
Post Tools
hicetnunc wrote on 08/27/20 at 08:00:59:
Shall we close our eyes and say there's no material evidence, or are we okay to take some (limited sanctions) so that proper online tournaments can be held ?

Wrong question; I refer again to the example of DNA and fingerprints.
The correct question is what margin of error we think acceptable. For that question your extreme example isn't helpful.
  

The book had the effect good books usually have: it made the stupids more stupid, the intelligent more intelligent and the other thousands of readers remained unchanged.
GC Lichtenberg
Back to top
 
IP Logged
 
Confused_by_Theory
God Member
*****
Offline


I Love ChessPublishing!

Posts: 662
Location: Europe
Joined: 05/13/15
Gender: Male
Re: Dvorkovich on cheating
Reply #15 - 08/27/20 at 09:01:40
Post Tools
Hi.

For anyone who missed it there was a European online championship relatively recently that saw a few cheaters here and there Roll Eyes. Similar tournaments would be interesting, mainly to see if cheaters can keep up with bans over time. It would not exactly be fun even if absolute numbers of people cheating fell over time though. Someone would still try cheating in most major online tournaments and this would be demoralising and bad for the competition. Online you need to be able to ban.

Borderline cases will exist for Fide due to large numbers of cheaters being reviwed I am fairly sure. They are obviously looking for input on where to have the border (or maybe where not to have it). I still don't have any meaningful input to give due to lack of understanding.

Have a nice day
  
Back to top
 
IP Logged
 
Confused_by_Theory
God Member
*****
Offline


I Love ChessPublishing!

Posts: 662
Location: Europe
Joined: 05/13/15
Gender: Male
Re: Dvorkovich on cheating
Reply #14 - 08/27/20 at 08:14:21
Post Tools
Hi.

If you in theory have one algorithm checking moves against the computers chosen moves, another checking time management for patterns and say one checking how long before games deviate from previous games. Then surely each can be considered evidence.

If all these three algorithms were meshed into one and all given output was some numerical representation that got dubbed probability of cheater, then I get how that might be troublesome to trust blindly in a legal sense. Some understanding of the algorithm used is probably needed or maybe some kind of output that is detailed and not a single numeric value.

Let's save that for the big questions.
  
Back to top
 
IP Logged
 
hicetnunc
Full Member
***
Offline


"Do something scary every
day"

Posts: 237
Location: Paris, France
Joined: 01/04/03
Gender: Male
Re: Dvorkovich on cheating
Reply #13 - 08/27/20 at 08:00:59
Post Tools
Thought experiment : imagine there's a 7-year-old-kid who has 1100 elo rating and wins European online rapid championship with 100% score. Cheating detection algorithm says there's 99,99% he cheated, and all his moves match 1st or 2nd engine choice in every game. Then we look at his recently recorded OTB games and there, same algorithm says his engine correlation scores are akin to a 1600 player, he finds top 1-2 engine moves 1/3rd of time and odds of cheating in OTB are estimated at 0,000001%.

Shall we close our eyes and say there's no material evidence, or are we okay to take some (limited sanctions) so that proper online tournaments can be held ?

Because that's the kind of situation FIDE will arbitrate, not borderline cases where someone will play like 400-600 pts above his level (even if this will be cheating as well most of the times) - as it won't fall under their threshold. Only very very blatant cheaters will be flagged, to give a semblance of justice. In my experience, all detection algorithms err on the side of caution (and that's probably for the better).

I'm all for material evidence, but it's impossible to implement in online chess. I'm happy to see FIDE official tournaments online with anti-cheating measures based on statistics. People won't have any obligation to take part anyway ?!
  

48 yo, 1920 elo
Back to top
 
IP Logged
 
MNb
God Member
*****
Offline


Rudolf Spielmann forever

Posts: 10777
Location: Moengo
Joined: 01/05/04
Gender: Male
Re: Dvorkovich on cheating
Reply #12 - 08/27/20 at 06:05:09
Post Tools
Jupp53 wrote on 08/26/20 at 17:21:42:
But there must be a proof. A probability on basis of computational measures is no proof, even if it is 1:1.000.000.

Then I suppose you reject DNA comparisons and fingerprints too. They only provide such probabilities, even if much smaller than your 1 : 1 000 000.
  

The book had the effect good books usually have: it made the stupids more stupid, the intelligent more intelligent and the other thousands of readers remained unchanged.
GC Lichtenberg
Back to top
 
IP Logged
 
an ordinary chessplayer
God Member
*****
Offline


I used to be not bad.

Posts: 1807
Location: Columbus, OH (USA)
Joined: 01/02/15
Re: Dvorkovich on cheating
Reply #11 - 08/27/20 at 04:09:59
Post Tools
There are different standards in different legal settings, e.g. preponderance of the evidence; or beyond a reasonable doubt. Maybe there one can refer to some "uncertainty" about the legal result, but it involves weighing up multiple different examples of evidence, and ideally different kinds of evidence.

In the case of the algorithm, though, there is a "probability" attached to the result of the algorithm, but in the end it amounts to an uncertainty whether there is or is not a single piece of evidence against the accused. People get mesmerized by the large number of moves fed into the algorithm, and start to believe that the laws of large numbers apply. It's true in the computation of the algorithm sense, but in the legal sense it boils down to a single fact. And it's an indirect fact. I'm not a lawyer, but isn't such an indirect fact the weakest form of evidence?

In the cases of otb cheating, to my knowledge there has always been physical evidence like a device, or caught in the act, or sometimes refusal to submit to a physical inspection despite being warned of the penalty. Without direct evidence, it remains suspicion of cheating. 

It's one thing to have an online policy of no computers, but it's quite another thing to organize a competition where there is no possibility of directly verifying whether or not the players are complying. It's hard for me to take such an organizer and event seriously. One of many reasons why I don't play online. People should just admit that in the absence of effective direct controls, it's just a game and not a competition.
  
Back to top
 
IP Logged
 
Confused_by_Theory
God Member
*****
Offline


I Love ChessPublishing!

Posts: 662
Location: Europe
Joined: 05/13/15
Gender: Male
Re: Dvorkovich on cheating
Reply #10 - 08/26/20 at 23:09:13
Post Tools
Hi.

I guess working with probabilities is generally not complexity free. Is there not some legal principles that if there is uncertainty don't give the maximum penalty though?

Have a nice day.

  
Back to top
 
IP Logged
 
Jupp53
God Member
*****
Offline


be

Posts: 988
Location: Frankfurt/Main
Joined: 01/04/09
Gender: Male
Re: Dvorkovich on cheating
Reply #9 - 08/26/20 at 17:21:42
Post Tools
If this were only about chess ...

Going from "in dubio pro reo" to "in dubio pro probabilitas" is a dangerous change in juridical cases, taken in a wider sense.

I think those cheating hunters destroy much much more, than they even start to think of. According to my experience they are not able to see this. "Law and order" as usual.  Angry It is all right to find measures against cheating. But there must be a proof. A probability on basis of computational measures is no proof, even if it is 1:1.000.000.
  

Medical textbooks say I should be dead since April 2002.
Dum spiro spero. Smiley
Narcissm is the humans primary disease.
Back to top
 
IP Logged
 
cathexis
God Member
*****
Offline


No matter where you go,
there you are.

Posts: 661
Location: Stafford, Virginia USA
Joined: 03/03/20
Gender: Male
Re: Dvorkovich on cheating
Reply #8 - 08/26/20 at 16:52:13
Post Tools
Grin Thanks!
  
Back to top
 
IP Logged
 
Confused_by_Theory
God Member
*****
Offline


I Love ChessPublishing!

Posts: 662
Location: Europe
Joined: 05/13/15
Gender: Male
Re: Dvorkovich on cheating
Reply #7 - 08/26/20 at 15:53:40
Post Tools
Hey.

Check the anti-cheating guidelines. Fide recommends not rating the games and letting the results be loss for cheater and still half a point for opponent (0-0.5F). In open tournaments at least. In round robin opponents gets declared winners but still not rated.

Norms still valid though. You are only unlucky if somehow needing rating from games against cheaters otherwise should be ok.

May the rating gods be with you in the future.
  
Back to top
 
IP Logged
 
cathexis
God Member
*****
Offline


No matter where you go,
there you are.

Posts: 661
Location: Stafford, Virginia USA
Joined: 03/03/20
Gender: Male
Re: Dvorkovich on cheating
Reply #6 - 08/26/20 at 14:04:05
Post Tools
Another thing that may have already been covered (but I missed) would be:

After a valid tournament, I have just made my norms for Candidate Master. Hooray! But now, it turns out when I finished at 11 points @ 10-0-2 that the 2 draws were against a player who has since been D/Q'd for cheating. So am I now only 10-0-0? Could this mean I don't qualify for CM anymore?  Or if I won the tournament but now I only have 10points, but some other player has 10 1/2 hence, I lose the tourney as well! So now, I not only don't make my norms but I have to hand over the prize (if any) as well? Very goofy premise, yes. But if cheating is indeed becoming more common than this will become relevant sooner or later. 

Do any here know how such things are handled? Or is this still in unknown territory too?

Just curious,

Andrew

P.S. The FIDE regs give this:

Quote:
VII. Sanctions
1. Sanctions for cheating-related offenses are prescribed in the Fide Handbook (e.g.
B.01.045, A.09.3.2). These include, notably: return of awards; a ban up to 15 years on
taking part in a chess competition or in any chess-related activity; revocation of titles
and sport results; fines up to $25.000.


But I assume those are for the offender, not their victims.
  
Back to top
 
IP Logged
 
Confused_by_Theory
God Member
*****
Offline


I Love ChessPublishing!

Posts: 662
Location: Europe
Joined: 05/13/15
Gender: Male
Re: Dvorkovich on cheating
Reply #5 - 08/26/20 at 05:57:03
Post Tools
Hi.

cathexis wrote on 08/25/20 at 17:53:20:

Well. That was a weird story. Hope arbiters didn't take it seriously.

I imagine someone in the future who is a heck of a lot more verifiably flagged for cheating (say by an algorithm) and then comes back after x years of ban would not always have a pleasant time at tournaments either. Maybe you need some kind of thought towards that as well if computer assistance bans go way up in the future.

cathexis wrote on 08/25/20 at 17:53:20:
What's the point re: computer-assisted cheating? Because I am less concerned with how many decimal places the "statistical estimate" is than the possibilities of abuse of said tools when a human Arbiter has the final say. For example; If the tool gives a 99% probability, but cannot be enforced except by a FIDE official who can arbitrarily decide, "Naw! that guy's OK," then just decide to ignore the results.( No matter he's a Fav of FIDE and not some protesting, trouble-making fellow like Kasparov!) Well, that worries me more than the tool itself. IOW, not only is there an old joke about statistics ("garbage in, garbage out") but also in any chain of authority it is man that is always the weakest link.

I mean if singular individuals handle Fide's anti cheating algorithm that does indeed give a lot of power to them and in some dark future scenario the possibility of abuse. Somehow that should be taken into account when designing the system.

If we get a bit technical I feel something similar to the rating report system might be a way to do the reporting procedure when it comes to cheating cases. Club officials would fill in some form about the alleged cheating (with games included if possible), some national coordinator looks at it and sends to Fide, a list only with what cheating reports Fide has received is kept for all to see (not the reports themselves)...
Then, in my imagination even though direct bans seem more likely, Fide would run the algorithm/-s and send a detailed report to both the national federation and club. The national federation would decide on consequence. Countries may well handle cases differently and in theory the harshest ones may need some kind of reining in but it gets around the question of Fide acting as both prosecutor and judge. If cheating in Fide organised events I guess ban from entering future Fide organised events and recommendation to national federation to extend ban to national competetion is ok. Realistically if national federations have faith in Fide's anti-cheating procedures (as ideally would be the case) this should be a formality.

Have a nice day.
  
Back to top
 
IP Logged
 
cathexis
God Member
*****
Offline


No matter where you go,
there you are.

Posts: 661
Location: Stafford, Virginia USA
Joined: 03/03/20
Gender: Male
Re: Dvorkovich on cheating
Reply #4 - 08/25/20 at 17:53:20
Post Tools
Bobby Fischer famously accused the Russians of collusion against him, an accusation that is often reported as later admitted to having been accurate. Former Director Fidomanes has had similar accusations made against him regarding tournament shenanigans.

What's the point re: computer-assisted cheating? Because I am less concerned with how many decimal places the "statistical estimate" is than the possibilities of abuse of said tools when a human Arbiter has the final say. For example; If the tool gives a 99% probability, but cannot be enforced except by a FIDE official who can arbitrarily decide, "Naw! that guy's OK," then just decide to ignore the results.( No matter he's a Fav of FIDE and not some protesting, trouble-making fellow like Kasparov!) Well, that worries me more than the tool itself. IOW, not only is there an old joke about statistics ("garbage in, garbage out") but also in any chain of authority it is man that is always the weakest link. Remember this story:

https://www.youtube.com/watch?v=S2JedouTRZo

Just sayin"!

Andrew
  
Back to top
 
IP Logged
 
Page Index Toggle Pages: 1 2 3 [4] 5 
Topic Tools
Bookmarks: del.icio.us Digg Facebook Google Google+ Linked in reddit StumbleUpon Twitter Yahoo