Latest Updates:
Page Index Toggle Pages: 1 2 3 [4] 
Topic Tools
Very Hot Topic (More than 25 Replies) Stockfish dethroned (big time)?! (Read 34555 times)
h4rl3k1n
YaBB Newbies
*
Offline


FM

Posts: 14
Location: Germany
Joined: 09/05/16
Gender: Male
Re: Stockfish dethroned (big time)?!
Reply #9 - 12/07/17 at 10:39:09
Post Tools
Interestingly, the machine spends quite some time on overcoming the 2000-2200 threshold. It improved faster before this and faster after this. There seems to be some barrier indeed.
  
Back to top
 
IP Logged
 
MartinC
God Member
*****
Offline


I Love ChessPublishing!

Posts: 2073
Joined: 07/24/06
Re: Stockfish dethroned (big time)?!
Reply #8 - 12/07/17 at 10:15:38
Post Tools
The training is the really computationally intensive bit with neural nets - fairly sure that actually running them once trained doesn't take anything too crazy.

I genuinely didn't think this approach would work quite so well in chess - the brute force search is awfully effective of course. It seems like chess is a bit more interesting than we'd thought Smiley
  
Back to top
 
IP Logged
 
Dink Heckler
God Member
*****
Offline


Love-Forty

Posts: 878
Joined: 02/01/07
Gender: Male
Re: Stockfish dethroned (big time)?!
Reply #7 - 12/07/17 at 09:10:24
Post Tools
Discussion of hashes, opening books etc somewhat obscure the bigger point that even if their machine had only attained, say, ELO 2000 in this way, it would have been an immensely impressive demonstration.

The authors went for maximum publicity and maybe cut a few corners in doing so, but any way you want to slice it, this looks incredibly impressive.
  

'Am I any good at tactics?'
'Computer says No!'
Back to top
 
IP Logged
 
Bonsai
God Member
*****
Offline



Posts: 622
Joined: 03/13/04
Gender: Male
Re: Stockfish dethroned (big time)?!
Reply #6 - 12/07/17 at 06:59:20
Post Tools
Pretty impressive, even if there seems to be a question of the fairness of the Stockfish comparison. I'm inclined to believe they are not making this up based on this being the DeepMind team, who did create AlphaGo in a similar, if slightly more domain specific, way. It would be fascinating whether it does very differently than current engines somewhere.
  
Back to top
 
IP Logged
 
TonyRo
God Member
*****
Offline


I'm gonna crack your skull!

Posts: 1826
Location: Cleveland, OH
Joined: 11/26/07
Gender: Male
Re: Stockfish dethroned (big time)?!
Reply #5 - 12/07/17 at 03:53:48
Post Tools
bragesjo wrote on 12/06/17 at 19:42:25:
Interesting link. It appears that that match was not fare since Stockfish got way to low ram and Alpha Zero got the power of 2000 threads and Stockfish "only" got 64 threads, and way to low ram to run the threads, and timecontrol was only 1 minut per move and Stockfish got no table bases or opening books that is standard today.


My understanding is that it was trained on super-hardware and then played on something at least slightly more reasonable. In any case nodes/s is not a particularly great metric for judging this beast, as it was searching order of magnitudes less than SF despite the difficult to compare hardware. I don't know anything about the computer power of TPUs relative to CPUs, just that they excel in machine learning applications.
  
Back to top
 
IP Logged
 
RdC
God Member
*****
Offline


I Love ChessPublishing!

Posts: 868
Joined: 05/17/08
Re: Stockfish dethroned (big time)?!
Reply #4 - 12/07/17 at 01:31:51
Post Tools
bragesjo wrote on 12/06/17 at 19:42:25:
Stockfish got no table bases or opening books that is standard today.


The DeepMind program was essentially "playing as a human". In other words it had no resource to external assistance other than what it had learned for itself.

On the basis of the games so far published, it has replicated human opening theory and confirmed some assessments without suggesting anything dramatically new.
  
Back to top
 
IP Logged
 
bragesjo
God Member
*****
Offline


CCE at ICCF 2021 and CCM
at ICCF 2023

Posts: 1829
Location: Eskilstuna
Joined: 06/30/06
Gender: Male
Re: Stockfish dethroned (big time)?!
Reply #3 - 12/06/17 at 19:42:25
Post Tools
Interesting link. It appears that that match was not fare since Stockfish got way to low ram and Alpha Zero got the power of 2000 threads and Stockfish "only" got 64 threads, and way to low ram to run the threads, and timecontrol was only 1 minut per move and Stockfish got no table bases or opening books that is standard today.
  
Back to top
WWW  
IP Logged
 
IsaVulpes
Senior Member
****
Offline


No.

Posts: 345
Joined: 12/09/07
Re: Stockfish dethroned (big time)?!
Reply #2 - 12/06/17 at 17:10:42
Post Tools
https://chess24.com/en/read/news/deepmind-s-alphazero-crushes-chess here's a more detailed easier readable article on the topic. It used neither opening books nor tablebases, but just played games against itself until it was the best, reinventing the past centuries of opening theory on the way   Lips Sealed
  
Back to top
 
IP Logged
 
Bibs
God Member
*****
Offline



Posts: 2338
Joined: 10/24/06
Re: Stockfish dethroned (big time)?!
Reply #1 - 12/06/17 at 13:59:14
Post Tools
I have no reason to disbelieve this. More remarkable stuff from Deepmind.

Demis Hassabis runs DeepMind. He knows his onions, and then some. Hugely influential chap considering the work he is doing.
Worth noting that Dharshan Kumaran, one of the listed equal co-authors is a chess GM, though he quit totally many years ago. Demis also a fair chess player.

(Disclaimer of sorts, I left UK years ago, but both old friends from junior days. Er, I think I owe Demis a pint actually).
  
Back to top
 
IP Logged
 
IsaVulpes
Senior Member
****
Offline


No.

Posts: 345
Joined: 12/09/07
Stockfish dethroned (big time)?!
12/06/17 at 12:19:53
Post Tools
Disclaimer: Very unclear basis on everything right now!

According to its developers, AlphaZero (as far as I understand it, the updated version of AlphaGo, the Go program which beat a human elite player for the first time in history) learned chess "in 4 hours", then played a 100 game match with Stockfish 8, and scored +28-0=72 (including 3 wins with black)!

The time control was supposedly 1minute/move, with AZ pulling farther away from Stockfish the longer the timecontrol happened to be.
It uses a drastically different algorithm; rather than going through 70 million positions per second (Stockfish), it checks just 80 thousand, but uses its "deep neural network" to focus much more efficiently on more promising variations (plays like a human, so to speak).

If all of this is true, and it ever makes its way into human hands (currently its not exactly available, and very unclear how well it will fare if it eg were to use less than 64 cores), that would be big news indeed

https://lichess.org/study/EOddRjJ8 You can check out 10 sample games of the 100 game match here (G7+G8 are two of the three Black wins)
https://arxiv.org/pdf/1712.01815.pdf if you want a more detailed explanation of .. everything

Right now it looks a vague bit suspicious to me, as we have no independent party confirming anything, and the games seem a bit strange -
https://lichess.org/0LUhNlLB here for example is one of Stockfish's White losses, which the quick Lichess Analysis (also running Stockfish) evaluates as having 5 Inaccuracies + 1 Mistake & 15 ACPL; basically unheard of in elite Engine chess. That it may misevaluate the AlphaZero program if that is indeed stronger than itself I can understand, but I see little reason as to why Stockfish would criticize *its own* moves to that extend (to compare: Analysis of G94 in Houdini vs Stockfish from TCEC 2016 https://lichess.org/Fp9UmSGv)
  
Back to top
 
IP Logged
 
Page Index Toggle Pages: 1 2 3 [4] 
Topic Tools
Bookmarks: del.icio.us Digg Facebook Google Google+ Linked in reddit StumbleUpon Twitter Yahoo