Page Index Toggle Pages: 1 ... 9 10 [11] 12 
Topic Tools
Very Hot Topic (More than 25 Replies) Yelena Dembo on Chess.com (Read 99777 times)
Markovich
God Member
*****
Offline



Posts: 6099
Location: Columbus, Ohio
Joined: 09/17/04
Re: Yelena Dembo on Chess.com
Reply #27 - 09/20/10 at 16:43:37
Post Tools
Paul Cumbers wrote on 09/20/10 at 16:42:27:
One thing I'm curious about...
How would/could the accused go about trying to prove their innocence?  Undecided


A good point.  But don't forget, they are not called "accused."  The are called "known cheaters."
  

The Great Oz has spoken!
Back to top
 
IP Logged
 
Paul Cumbers
Full Member
***
Offline



Posts: 175
Location: Grantham
Joined: 01/04/03
Gender: Male
Re: Yelena Dembo on Chess.com
Reply #26 - 09/20/10 at 16:42:27
Post Tools
One thing I'm curious about...
How would/could the accused go about trying to prove their innocence?  Undecided
  
Back to top
 
IP Logged
 
Markovich
God Member
*****
Offline



Posts: 6099
Location: Columbus, Ohio
Joined: 09/17/04
Re: Yelena Dembo on Chess.com
Reply #25 - 09/20/10 at 16:41:52
Post Tools
"...so it's unfair to expose anyone on so flimsy evidence"

My point exactly.
  

The Great Oz has spoken!
Back to top
 
IP Logged
 
TalJechin
God Member
*****
Offline


There is no secret ingredient.

Posts: 2892
Location: Malmö
Joined: 08/12/04
Gender: Male
Re: corr on Chess.com
Reply #24 - 09/20/10 at 16:29:10
Post Tools
When writing the FKG I remember analysing an old Estrin game with Fritz, and at one point both players followed a fritz line for something like (at least) 10 ply in a row - and at the time of the game fritz didn't exist and computers were hardly any good...

One of the big points of playing corr instead of otb is to have more time to make better decisions, so wouldn't one expect strong corr players to be closer to "perfection" than GMs playing OTB, even without computer aid? 

And even with computer aid, the correlation between choosing one of the top three moves from the computer must also be dependent on at what time you take the "top three" - in a complicated position and allowing it, say, 48 hours thinking time it would probably produce a very long list of different combinations of "top threes" during that time. While at another point in a game there may be only three reasonable moves to choose from.

This topic reminds me of a recent local football story, some trainer was complaining that the statistics clearly showed that the referees' decisions (freekicks & cards) are mainly in favour of the top teams when they play the teams at the bottom. He tried to make a big deal about this, until someone simply pointed out that the top teams usually also have the ball most of the time in those games...


Anyway, since it's practically impossible to prove cheating beyond any doubt, I guess the person accused would have a good case for a libel suit in the US. 

And it would be a wise decision to remove the name of the player accused by chess.com from this thread, as all is just hearsay and accusations based on statistics. After all the forum is high ranked on google on all chess topics, so it's unfair to expose anyone on so flimsy evidence.
  
Back to top
 
IP Logged
 
Dink Heckler
God Member
*****
Offline


Love-Forty

Posts: 900
Joined: 02/01/07
Gender: Male
Re: Yelena Dembo on Chess.com
Reply #23 - 09/20/10 at 15:44:37
Post Tools
I always suspected that Kamasutra needed some artificial aids...some of those mating positions are truly Grandmaster standard  Smiley

I guess chess.com is a business, so if they are rational, they will maximise the number of punters using their site. By upholding some notion of 'fairness', however arbitrary, I'm guessing that they have their eyes firmly on the bottom line. They could care less about standards of evidence, I imagine...not saying it's right....

  

'Am I any good at tactics?'
'Computer says No!'
Back to top
 
IP Logged
 
micawber
God Member
*****
Offline


like many sneaks and skunks
in history he's a poet

Posts: 852
Location: Netherlands
Joined: 09/07/05
Gender: Male
Re: Yelena Dembo on Chess.com
Reply #22 - 09/20/10 at 15:41:21
Post Tools
These statistical analyses do remind me of Topalov's toilet-gate.
As far as I remember, Kramnik scored well above the norms used by the cheat-hunters.
At the time it was allready pointed out, that both
lengthy opening lines, opening preparation, exchanges and forced lines all contribute to an elevation of these scores. So you have to look at the games themselve to judge if computer assistence is likely or not.
  
Back to top
 
IP Logged
 
Markovich
God Member
*****
Offline



Posts: 6099
Location: Columbus, Ohio
Joined: 09/17/04
Re: Yelena Dembo on Chess.com
Reply #21 - 09/20/10 at 15:33:12
Post Tools
Dink Heckler wrote on 09/20/10 at 15:03:45:
So the very notion that rate of matchup with some engine is likely to correlate with success is bogus.

I don't think that's the hypothesis at all. Rather, that correlation with engines correlates with use of engines....which reasonable people may agree or disagree with.

Anyway, these things surely aren't about rigour. If you set out to filter out 'cheaters', you'll have lot's of type-I and type-II errors. No one cares much because the stakes are so low. However, in this case, it can impact on someone's profession (however obliquely), so the stakes are raised. But the procedure has been the same all along, I guess....a few people get cast out via somewhat contentious methodologies per encourager les autres; no more, no less...statistical (or, heaven forbid, judicial) standards of proof need not neccessarily be met.



I visited the chess.com website and read their discussion of how they identify cheaters.  They say that they employ statistical methods and also apply judgment.  They then go on to say, "We will publish here the names of known cheaters."  But no such certainty can possibly emerge from statistical analysis.  For any given degree of confidence there is always the chance that a particular result is random.  Even perfectly valid estimates of degree of confidence are subject to possible misspecification error.  And where does judgment come in?

Really when you think about it, what they're doing is irresponsible.  Let's say you declare someone a cheater when his matchup rate or whatever falls above the 98% confidence limit of that statistic.  Well then, by assumption, 2% of all players will be called out as cheats even though innocent.

One rather interesting question is, what is the rate of supposed cheating in relation to the estimated degree of confidence with which it is detected?  How does the actual rate of exceedence, in other words, match the model's prediction of the probability of falling in the "cheating" range?

They can run their website any way they want to, but my problem is with publishing the names of real people, such as Dembo, as "known" cheaters when nothing really is known at all.

I must say I find it odd that anyone thinks that publishing such a name as "Kamasutra" as a "known" cheater will do anything to shame anyone.  He's anonymous, you know?  And so is almost everyone else on chess.com.
  

The Great Oz has spoken!
Back to top
 
IP Logged
 
Jupp53
God Member
*****
Offline


be

Posts: 988
Location: Frankfurt/Main
Joined: 01/04/09
Gender: Male
Re: Yelena Dembo on Chess.com
Reply #20 - 09/20/10 at 15:04:59
Post Tools
Does it have any common sense to speculate about reasons for cheating? If yes, please tell me. It will make me think a little.

From experiencing the differences of CC with and without engines I really doubt you can proof anything by the method published in the topic in chessgames.com. But maybe here I will learn something too.

Most interesting is the public damage done to a person without a clear-cut proof and the behavior of the public and the chess.com site as well. A German proverb says: I can't gorge as much as I want to barf.  Cry
  

Medical textbooks say I should be dead since April 2002.
Dum spiro spero. Smiley
Narcissm is the humans primary disease.
Back to top
 
IP Logged
 
Dink Heckler
God Member
*****
Offline


Love-Forty

Posts: 900
Joined: 02/01/07
Gender: Male
Re: Yelena Dembo on Chess.com
Reply #19 - 09/20/10 at 15:03:45
Post Tools
So the very notion that rate of matchup with some engine is likely to correlate with success is bogus.

I don't think that's the hypothesis at all. Rather, that correlation with engines correlates with use of engines....which reasonable people may agree or disagree with.

Anyway, these things surely aren't about rigour. If you set out to filter out 'cheaters', you'll have lot's of type-I and type-II errors. No one cares much because the stakes are so low. However, in this case, it can impact on someone's profession (however obliquely), so the stakes are raised. But the procedure has been the same all along, I guess....a few people get cast out via somewhat contentious methodologies per encourager les autres; no more, no less...statistical (or, heaven forbid, judicial) standards of proof need not neccessarily be met.

  

'Am I any good at tactics?'
'Computer says No!'
Back to top
 
IP Logged
 
Markovich
God Member
*****
Offline



Posts: 6099
Location: Columbus, Ohio
Joined: 09/17/04
Re: Yelena Dembo on Chess.com
Reply #18 - 09/20/10 at 14:53:21
Post Tools
Smyslov_Fan wrote on 09/20/10 at 04:41:33:
Actually, chess.com's methodology is rather interesting. 

They ran stats on the best correspondence players of pre-computer generations, such as Estrin and company. Then they took a look at how the moves, after they left the database, matched up to engines. They focused only on games against other 2200 players. They found a fairly consistent threshhold.


Leaving aside the question of whether this is to be believed at all, and further that of whether it was done with any rigor, the devil is in the term fairly consistent, which indicates that the entire process is subject to error.  It is, therefore, a statistical question.
Smyslov_Fan wrote on 09/20/10 at 04:41:33:

It doesn't matter which +2900 engine they use, the results will be the same.
 

The same?  I posit on the contrary that choice of engine is a source of variation.

Smyslov_Fan wrote on 09/20/10 at 04:41:33:

This is what they found:

The best a human can do in terms of matching a computer's play, is:
 
Top move:     65%
Top 2 moves  75%
Top 3 moves  85%



Clearly this is not the maximal possible degree of matching, since you contradict this below.  So what is it, an average, a median, something somebody pulled out of thin air?  What is the population?  What is the sample?  What are the methods?  We are simply in the dark.

Smyslov_Fan wrote on 09/20/10 at 04:41:33:

Dembo's stats were:

Top move:  73.3
Top 2          88.2
Top 3          93.5



Since the process is subject to error, the question is, given some reasonably specified statistical model and some estimate of the variability of human-machine matchup, with what degree of confidence can it be said that Dembo's matchup was different from that expected?

Somehow I doubt that sufficient rigor was applied to this question.  If the entire analysis and all the data were reported on the internet, one could review it.  In the mean time, scant credit can be given to its alleged results.


Smyslov_Fan wrote on 09/20/10 at 04:41:33:

But for those scoffing at correlations as proof, that's what statistics studies, correlations.


Don't make me laugh.  Until I required quite recently, I made my living this way, you know?

Smyslov_Fan wrote on 09/20/10 at 04:41:33:

The likelihood of a human matching a computer 100% approaches 0, so their approach makes sense. Perhaps the tolerances are a bit low though.


What tolerances?  What approach?  We simply don't know enough to evaluate the method used.

Smyslov_Fan wrote on 09/20/10 at 04:41:33:

It's very likely that Dembo cheated.


Shame on you.

Smyslov_Fan wrote on 09/20/10 at 04:41:33:

But I don't know if it's a certainty. I'd have to run the numbers myself, which doesn't interest me much.


Run the numbers yourself????  With what population? With what data? With what model?  If you had the expertise to "run the numbers," I expect you would have raised the questions yourself by now.

And of course it's not certain, since at best, it's a statistical result!!

Finally let me say that only an idiot would want to match a computer all the time, since computers remain rather stupid about many positions.  So the very notion that rate of matchup with some engine is likely to correlate with success is bogus.



  

The Great Oz has spoken!
Back to top
 
IP Logged
 
Matemax
God Member
*****
Offline


Chesspub gives you strength!

Posts: 1302
Joined: 11/04/07
Re: Yelena Dembo on Chess.com
Reply #17 - 09/20/10 at 13:57:19
Post Tools
Very interesting stuff - I also play "online chess" on chess.com and wondered about all those closed accounts due to "cheating".

It's not simple to find out where cheating starts - I think chess.com says, that analysing the topical position with an engine is cheating. But what if you have done that analyses before? - Let's say Dembo plays the Caro Kann - I think she can use all the comp analyses she did writing her book, because she has done that before the game.

I played a +2600 guy who was condemned to be a cheater but felt that he just played strong and not obviously like a computer. In the final position (where the game is now stuck) I would say he has some winning chances in the endgame, but not more. 

You are also allowed to move the pieces and do an analyses the old fashioned way - without the comps. If I were an IM like Dembo this should be enough to perform really well
Shocked
  
Back to top
 
IP Logged
 
Schaakhamster
God Member
*****
Offline


I Love ChessPublishing!

Posts: 650
Joined: 05/13/08
Re: Yelena Dembo on Chess.com
Reply #16 - 09/20/10 at 13:36:55
Post Tools
TonyRo wrote on 09/20/10 at 13:34:26:
When do (hopefully you'll detect my humorous tone):

a) Humans

b) Women

have to be logical?


It does help (sometimes)  Grin
  
Back to top
 
IP Logged
 
TonyRo
God Member
*****
Offline


I'm gonna crack your skull!

Posts: 1846
Location: Cleveland, OH
Joined: 11/26/07
Gender: Male
Re: Yelena Dembo on Chess.com
Reply #15 - 09/20/10 at 13:34:26
Post Tools
When do (hopefully you'll detect my humorous tone):

a) Humans

b) Women

have to be logical?
  
Back to top
 
IP Logged
 
Schaakhamster
God Member
*****
Offline


I Love ChessPublishing!

Posts: 650
Joined: 05/13/08
Re: Yelena Dembo on Chess.com
Reply #14 - 09/20/10 at 13:09:03
Post Tools
TonyRo wrote on 09/20/10 at 12:46:48:


Totally agree. That's why I said "There is some reward there". It certainly makes sense to both of us to not do it, but you never know what's going on in other people's heads who are up there. 

I'm not saying she did it - I've talked with Yelena more than once and she was very cordial, and very knowledgeable, I'm just trying to understand why she might have done it if she did it.


IF she has cheated I would guess that the reason probably won't be very rational (from a professional standpoint): perhaps because she felt that every one else was cheating, for the thrill,... .

It would be a bit like a millionaire shoplifting.   

  
Back to top
 
IP Logged
 
TonyRo
God Member
*****
Offline


I'm gonna crack your skull!

Posts: 1846
Location: Cleveland, OH
Joined: 11/26/07
Gender: Male
Re: Yelena Dembo on Chess.com
Reply #13 - 09/20/10 at 12:46:48
Post Tools
Schaakhamster wrote on 09/20/10 at 12:10:08:
TonyRo wrote on 09/20/10 at 11:19:16:
GMTonyKosten wrote on 09/20/10 at 10:43:26:
I don't understand why she should bother to 'cheat', unless there were large cash prizes involved it doesn't make any sense to risk tarnishing her reputation just to play a better correspondence game.


There is some reward there, since she's a fairly prolific trainer of amateurs. If she's one of the head honcho's at chess.com, it looks good to prospective students.


Yes but that reward (if there is any, her IM title would her a lot more reward then being at the top of a casual corr. site)  wouldn't weigh up to the possible consequences of getting caught cheating. It doesn't really make sense for a chess professional to risk her/his reputation to win a few meaningless corr. games. Weird... .


Totally agree. That's why I said "There is some reward there". It certainly makes sense to both of us to not do it, but you never know what's going on in other people's heads who are up there. 

I'm not saying she did it - I've talked with Yelena more than once and she was very cordial, and very knowledgeable, I'm just trying to understand why she might have done it if she did it.
  
Back to top
 
IP Logged
 
Page Index Toggle Pages: 1 ... 9 10 [11] 12 
Topic Tools
Bookmarks: del.icio.us Digg Facebook Google Google+ Linked in reddit StumbleUpon Twitter Yahoo