Latest Updates:
Page Index Toggle Pages: [1] 2 3 
Topic Tools
Very Hot Topic (More than 25 Replies) No rating inflation? (Read 12827 times)
Glenn Snow
God Member
*****
Offline



Posts: 1720
Location: Franklin
Joined: 09/27/03
Gender: Male
Re: No rating inflation?
Reply #33 - 04/06/12 at 05:27:12
Post Tools
ReneDescartes wrote on 04/04/12 at 21:52:03:
You know, it's strange how the ELO system has created the impression that a struggle between human beings is a matter of weighing two quantities.

Will deeds of heroism soon receive numeric expression? Really, Oswald Spengler must be rolling in his grave with laughter over the whole idea of ratings.  You could quantify the relative strength of composers (surely composers today must be better--humans progress, after all!).

I think humans enjoy watching a fight, as Lasker points out, and of course in a fight you want to know who will win. And it is a fundamental fact of nature, as Wittgenstein might say, that wolves eat lambs; and so we speak strength or ferocity considered apart from a particular fight. But this is very far from a numeric idea.  Numeric ratings are well-ordered in a mathematical sense, but "who will win" is not; A beats B beats C beats A, as is well known.

Furthermore, it is unclear what is being imagined when we say Bacrot (#37 today) plays better than Karpov did, or to get right down to it, that Carlsen is stronger than Fischer. We want to know who would win, or who is the more ferocious animal, but the way the world is, a great white shark would eat a grizzly in the water but a grizzly would eat a shark on land.

Which of the following scenarios tests whether Carlsen's rating is inflated relative to Fischer's?
(1) Carlsen and Fischer are given databases and eight months to prepare, but sequestered. They play an unlimited match to 6 wins. Fischer goes up 5-0, but Carlsen exhausts Fischer with a long series of draws, and the older Fischer's physical condition becomes the main determining factor in the match. With no Campomanes in the wings, a physically collapsing Fischer loses.  (2)Fischer and Carlsen play a match, but they get to exert psychological pressure on the organizers and each other before the match. Fischer effectively shatters Carlsen's nerves before the match begins. Fischer wins. (3) Carlsen's play develops to where it is seen as more beautiful even than Capablanca's. He wins everything in sight. But when the two play a match after a year's preparation, Carlsen cannot tolerate the almost incomprehensible psychological pressure of a fight with Fischer. He loses (Alekhine-Capablanca). (4) 4-year-old Fischer and Carlsen are transported and taught chess in the same technological era (which one? Perhaps their styles are better suited to different eras). They play a match at age 28. Fischer works much harder and wins.

Really, the notion of "the better player" only makes sense where there is a gross disparity in results. For the rest--competition is something we do, not something we are, and descriptive language is far superior to numeric ratings in capturing what transpires when we do it.

--So what is the ratings race? The opacity of the rules, the mathematical priests presiding over the proceedings, and the fact that it includes very many of a given players' games give it the aura of a divine stock price. It is simply ONE more, different, competition, not the distilled essence of a player's capacities.  Human beings are not stocks.

I am not complaining about the existence of ratings; in and of themselves they are harmless. But I believe they are grossly overrated.


This is essentially what I was talking about when I said something to the effect of other considerations would be a factor in trying to determine the best player ever.  Rating inflation or deflation or whatever is interesting primarily just because at times we're curios.
  
Back to top
 
IP Logged
 
ReneDescartes
God Member
*****
Offline


Qu'est-ce donc que je
suis? Une chose qui pense.

Posts: 1240
Joined: 05/17/10
Gender: Male
Re: No rating inflation?
Reply #32 - 04/04/12 at 21:52:03
Post Tools
You know, it's strange how the ELO system has created the impression that a struggle between human beings is a matter of weighing two quantities.

Will deeds of heroism soon receive numeric expression? Really, Oswald Spengler must be rolling in his grave with laughter over the whole idea of ratings.  You could quantify the relative strength of composers (surely composers today must be better--humans progress, after all!).

I think humans enjoy watching a fight, as Lasker points out, and of course in a fight you want to know who will win. And it is a fundamental fact of nature, as Wittgenstein might say, that wolves eat lambs; and so we speak strength or ferocity considered apart from a particular fight. But this is very far from a numeric idea.  Numeric ratings are well-ordered in a mathematical sense, but "who will win" is not; A beats B beats C beats A, as is well known.

Furthermore, it is unclear what is being imagined when we say Bacrot (#37 today) plays better than Karpov did, or to get right down to it, that Carlsen is stronger than Fischer. We want to know who would win, or who is the more ferocious animal, but the way the world is, a great white shark would eat a grizzly in the water but a grizzly would eat a shark on land.

Which of the following scenarios tests whether Carlsen's rating is inflated relative to Fischer's?
(1) Carlsen and Fischer are given databases and eight months to prepare, but sequestered. They play an unlimited match to 6 wins. Fischer goes up 5-0, but Carlsen exhausts Fischer with a long series of draws, and the older Fischer's physical condition becomes the main determining factor in the match. With no Campomanes in the wings, a physically collapsing Fischer loses.  (2)Fischer and Carlsen play a match, but they get to exert psychological pressure on the organizers and each other before the match. Fischer effectively shatters Carlsen's nerves before the match begins. Fischer wins. (3) Carlsen's play develops to where it is seen as more beautiful even than Capablanca's. He wins everything in sight. But when the two play a match after a year's preparation, Carlsen cannot tolerate the almost incomprehensible psychological pressure of a fight with Fischer. He loses (Alekhine-Capablanca). (4) 4-year-old Fischer and Carlsen are transported and taught chess in the same technological era (which one? Perhaps their styles are better suited to different eras). They play a match at age 28. Fischer works much harder and wins.

Really, the notion of "the better player" only makes sense where there is a gross disparity in results. For the rest--competition is something we do, not something we are, and descriptive language is far superior to numeric ratings in capturing what transpires when we do it.

--So what is the ratings race? The opacity of the rules, the mathematical priests presiding over the proceedings, and the fact that it includes very many of a given players' games give it the aura of a divine stock price. It is simply ONE more, different, competition, not the distilled essence of a player's capacities.  Human beings are not stocks.

I am not complaining about the existence of ratings; in and of themselves they are harmless. But I believe they are grossly overrated.
  
Back to top
 
IP Logged
 
Markovich
God Member
*****
Offline



Posts: 6099
Location: Columbus, Ohio
Joined: 09/17/04
Re: No rating inflation?
Reply #31 - 03/24/12 at 14:40:21
Post Tools
Uhohspaghettio wrote on 03/22/12 at 23:29:42:
MartinC wrote on 03/22/12 at 09:40:34:
Excluding openings would be awfully hard though - when do they end? Very late on quite often. 

I mean theoretically even people our sort of strength can catch someone in detailed preparation and play a near perfect game. Very rare of course, but it'd have been basically impossible 40 years ago!


I'm not so sure. There were always "cooks" and traps people could fall into weren't there? Chess Openings Ancient and Modern was published in 1905. The Modern Chess Instructor was published in 1889. 

You could discount variations which have been played substantially already, or maybe to move 25 is another option. Your point about normal club players playing world class games based on theory is a good one.... which is why Morphy for example would be discounted immediately because in every second game everyone over 1200 would have beaten him for the first 15 moves. The other computer analysis had Capablanca and Fischer as the best players ever.


The Handbuch des Schachspiels was first published in 1843.  I have in my posession an original 1874 edition.
  

The Great Oz has spoken!
Back to top
 
IP Logged
 
ErictheRed
God Member
*****
Offline


USCF National Master

Posts: 2534
Location: USA
Joined: 10/02/05
Re: No rating inflation?
Reply #30 - 03/24/12 at 14:29:41
Post Tools
Uruk wrote on 03/24/12 at 14:12:52:
Quote:

In each game, he had the computer evaluate each position in single-line mode to a depth of 13 ply (6 or 7 moves by each player).

Talk about flawed methodology. It's like having an IM compare Karpov and Dreev.


The article didn't really get into specifics about the technicalities of his work, which I'm sure were immense.  I'd think that a large part of it has to do with variance, i.e., how much the computer's evaluation of the position changed throughout the game as opposed to using the computer's evaluation as an absolute measurement.  But I'd be curious to know a little more about the methodology used.
  
Back to top
 
IP Logged
 
Uruk
Senior Member
****
Offline



Posts: 351
Joined: 02/03/09
Re: No rating inflation?
Reply #29 - 03/24/12 at 14:12:52
Post Tools
Quote:

In each game, he had the computer evaluate each position in single-line mode to a depth of 13 ply (6 or 7 moves by each player).

Talk about flawed methodology. It's like having an IM compare Karpov and Dreev.
  
Back to top
 
IP Logged
 
Smyslov_Fan
God Member
Correspondence fan
*****
Offline


Progress depends on the
unreasonable man. ~GBS

Posts: 6902
Joined: 06/15/05
Re: No rating inflation?
Reply #28 - 03/23/12 at 01:27:54
Post Tools
Uhohspaghettio wrote on 03/22/12 at 04:24:08:
He should have discounted openings. There's something a bit odd about all of this, I'll hold on until there's a more credible study with current computers before I believe any of it. 



The goal isn't to find out who played most like an engine. It's to find out who plays better. 

To ignore the improvements in the opening is to ignore ~1/3 of the game. The authors made the right choice to include the openings, not just because it's easier but because improvements in the opening are important!
  
Back to top
 
IP Logged
 
Uhohspaghettio
God Member
*****
Offline


I Love ChessPublishing!

Posts: 515
Joined: 02/23/11
Re: No rating inflation?
Reply #27 - 03/22/12 at 23:29:42
Post Tools
MartinC wrote on 03/22/12 at 09:40:34:
Excluding openings would be awfully hard though - when do they end? Very late on quite often. 

I mean theoretically even people our sort of strength can catch someone in detailed preparation and play a near perfect game. Very rare of course, but it'd have been basically impossible 40 years ago!


I'm not so sure. There were always "cooks" and traps people could fall into weren't there? Chess Openings Ancient and Modern was published in 1905. The Modern Chess Instructor was published in 1889. 

You could discount variations which have been played substantially already, or maybe to move 25 is another option. Your point about normal club players playing world class games based on theory is a good one.... which is why Morphy for example would be discounted immediately because in every second game everyone over 1200 would have beaten him for the first 15 moves. The other computer analysis had Capablanca and Fischer as the best players ever.
  
Back to top
 
IP Logged
 
fling
God Member
*****
Offline


I Love ChessPublishing!

Posts: 1591
Joined: 01/21/11
Gender: Male
Re: No rating inflation?
Reply #26 - 03/22/12 at 10:54:30
Post Tools
Willempie wrote on 03/22/12 at 10:16:11:
fling wrote on 03/22/12 at 09:42:23:
Willempie wrote on 03/22/12 at 09:05:26:
[quote author=605E4A405F5C456C75525D330 link=1332320048/13#13 date=1332345823]Btw how long did Beamon's record stand or has somebody cleared Bubka from the records yet?


Just because one athlete has a one-time incredible performance at high altitude, we can't say that the sport hasn't advanced even though the record isn't broken. In Bubka's case, well, compare it to Einstein as mentioned before. First it took a long time for anyone to understand his theories, now lots of students do.

I am not saying that at all. Just that I feel that progress is overrated and is often due to circumstances that are not directly related to the actual performance. It isnt a coincedence that in athletics the records in technical disciplines have stood that long. There the technique of the athlete itself is a bigger factor and the rest will just get you mm's. 
Same goes for chess, preparation has skyrocketed, but endgames less so.


I see, we are on the same page. Sometimes a problem when discussing things at a forum.
  
Back to top
 
IP Logged
 
MartinC
God Member
*****
Offline


I Love ChessPublishing!

Posts: 2113
Joined: 07/24/06
Re: No rating inflation?
Reply #25 - 03/22/12 at 10:18:19
Post Tools
Endgames surely almost certainly got worse since their glory days of adjournments etc? I mean back then they had all that home analysis to use and bags of time, while now its often just an increment....
  
Back to top
 
IP Logged
 
Willempie
God Member
*****
Offline


I love ChessPublishing
.com!

Posts: 4312
Location: Holland
Joined: 01/07/05
Re: No rating inflation?
Reply #24 - 03/22/12 at 10:16:11
Post Tools
fling wrote on 03/22/12 at 09:42:23:
Willempie wrote on 03/22/12 at 09:05:26:
[quote author=605E4A405F5C456C75525D330 link=1332320048/13#13 date=1332345823]Btw how long did Beamon's record stand or has somebody cleared Bubka from the records yet?


Just because one athlete has a one-time incredible performance at high altitude, we can't say that the sport hasn't advanced even though the record isn't broken. In Bubka's case, well, compare it to Einstein as mentioned before. First it took a long time for anyone to understand his theories, now lots of students do.

I am not saying that at all. Just that I feel that progress is overrated and is often due to circumstances that are not directly related to the actual performance. It isnt a coincedence that in athletics the records in technical disciplines have stood that long. There the technique of the athlete itself is a bigger factor and the rest will just get you mm's. 
Same goes for chess, preparation has skyrocketed, but endgames less so.
  

If nothing else works, a total pig-headed unwillingness to look facts in the face will see us through.
Back to top
 
IP Logged
 
fling
God Member
*****
Offline


I Love ChessPublishing!

Posts: 1591
Joined: 01/21/11
Gender: Male
Re: No rating inflation?
Reply #23 - 03/22/12 at 09:42:23
Post Tools
Willempie wrote on 03/22/12 at 09:05:26:
[quote author=605E4A405F5C456C75525D330 link=1332320048/13#13 date=1332345823]Btw how long did Beamon's record stand or has somebody cleared Bubka from the records yet?


Just because one athlete has a one-time incredible performance at high altitude, we can't say that the sport hasn't advanced even though the record isn't broken. In Bubka's case, well, compare it to Einstein as mentioned before. First it took a long time for anyone to understand his theories, now lots of students do.
  
Back to top
 
IP Logged
 
MartinC
God Member
*****
Offline


I Love ChessPublishing!

Posts: 2113
Joined: 07/24/06
Re: No rating inflation?
Reply #22 - 03/22/12 at 09:40:34
Post Tools
Excluding openings would be awfully hard though - when do they end? Very late on quite often. 

I mean theoretically even people our sort of strength can catch someone in detailed preparation and play a near perfect game. Very rare of course, but it'd have been basically impossible 40 years ago!
  
Back to top
 
IP Logged
 
Jupp53
God Member
*****
Offline


be

Posts: 988
Location: Frankfurt/Main
Joined: 01/04/09
Gender: Male
Re: No rating inflation?
Reply #21 - 03/22/12 at 09:21:56
Post Tools
Maybe this is too abstract.

Willempie is right, if I did understand correctly. A rating system is a rating system is a rating system ...

One feature of the Elo system is the median chess player at 1500 or so(iirc). Looking at the development in the last 50 years I have personally no doubt about a grown strength of a certain group of players training with databases and engines, better training methods, information spread via internet. This would speak against a rating inflation. Elo himself tried to monitor deflation as pointed to here before.

Comparing strength of humans in different periods is something very different from the question of inflation/deflation. In the sixties someone said: "Bobby Fischer is the greatest chess player ever." Mr. Fischer was asked about this and said: "She's right. But she cannot judge it." This is valid for about >95% of all chess players.
« Last Edit: 03/22/12 at 12:13:18 by Jupp53 »  

Medical textbooks say I should be dead since April 2002.
Dum spiro spero. Smiley
Narcissm is the humans primary disease.
Back to top
 
IP Logged
 
Zwischenzugzwang
Senior Member
****
Offline


I Love ChessPublishing
& chess pubs!

Posts: 380
Location: Zotzenbach
Joined: 06/14/11
Gender: Male
Re: No rating inflation?
Reply #20 - 03/22/12 at 09:17:59
Post Tools
Willempie wrote on 03/22/12 at 09:05:26:
There is the improvements in swimming pools (humidity, ...)

You're probably talking about air humidity, as I don't believe that today's water is any more or less humid than 40 years ago!?  Shocked

But seriously: The introduction of huge data bases and computers (and the possibility to connect them) can easily be considered as a paradigmatic change in chess training methods.
  

What do people mean when they say "Chess is the pawn of the soul"?
Back to top
 
IP Logged
 
Willempie
God Member
*****
Offline


I love ChessPublishing
.com!

Posts: 4312
Location: Holland
Joined: 01/07/05
Re: No rating inflation?
Reply #19 - 03/22/12 at 09:05:26
Post Tools
Smyslov_Fan wrote on 03/21/12 at 16:03:43:

Mark Spitz was the greatest swimmer in the world by a long shot in 1972. His times are ~ 10% slower than today's swimmers. Today's Olympians would need to swim 2.4 seconds faster than Spitz' 100m Freestyle world record even to qualify! Only a fraction of that difference can be accounted for by changes in swimwear technology.

There is the improvements in swimming pools (humidity, water composition, temperature etc), food, training programs etc (did I mention doping? Wink), all of them not directly related to the swimming. Just to put some perspective on things.

Btw how long did Beamon's record stand or has somebody cleared Bubka from the records yet?
  

If nothing else works, a total pig-headed unwillingness to look facts in the face will see us through.
Back to top
 
IP Logged
 
Page Index Toggle Pages: [1] 2 3 
Topic Tools
Bookmarks: del.icio.us Digg Facebook Google Google+ Linked in reddit StumbleUpon Twitter Yahoo