Hi.

Checked now and could not find anything about Lco Elo strength vs other engines on the LCO site sadly. Seemed like tests were vs other Lco versions (not sure though). As noted earlier there is nothing on CCRL list. I thus basically think TCEC 20 is the best you have to go on.

I found this breakdown:
https://tcecbayeselo.chessdom.org/2021/01/15/tcec-season-20-divp-game-224-stoofv...

Giving some kind of rating estimation for various Lco (26.3 in particular) and some other versions. I guess the Stockfish was Stockfish 12 and not the seemingly improved 13 and Leela not Leela 27 (don't know what's different here), but it's nice to see Leela equal with Stockfish in the group stage. As far as I understand in the final head to head matches Stockfish slowly got the upper hand as they started playing more and more imbalanced starting positions. Presumably there was something that gave Stockfish an edge.

Have a nice day.

Nibbler is brilliant, yes. Being able to immediately see when you've reached a position where 'anything' goes vs a critical one is very useful.

Often quite instructive about just how non forcing certain positions are as well!

Confused_by_Theory wrote on 02/23/21 at 22:55:15:

The strength of Leela is coming from the network and not the engine. Well that is not entirely true of course as you need an engine to grab the knowledge from the network and interprete it to a move. The engine has been optimized a few times to do quicker searches in the network but in the end we can say that the engine adds very little of real knowledge.

On the site https://training.lczero.org/networks/1 you can see each hour a new network is created. Each network is different and has a different strength. The ordo elo is an internal benchmark but this can deviate a lot from a benchmark with other engines which tests have shown before. So in theory to know which Leela is the best you need to test each of the networks combined with each of the engine versions. That are close to a million of combinations.

Finally I think most of us are not going to develop Leela but like to use it as a tool for analysis. Therefore we want to know which version of Leela is the best on our own computers and not some test hardware which can be something much better or weaker.

Every day dozens of Leelas are created so which one do you want to compare with? Besides results are very depending on the hardware you are using.

Also nobody knows which Leela is exactly the strongest one as it is impossible to seriously test all those new versions of Leela. CCRL can't do either so lags sometimes months behind.

Exactly because of this I started to test myself the engines as I explained in 2 articles on my blog: http://chess-brabo.blogspot.com/2019/09/testing-chess-engines.html and http://chess-brabo.blogspot.com/2020/11/testing-chess-engines-part-2.html That gives me much more useful feedback about which engine to use for my own analysis than any published ratinglist.

Pawnpusher wrote on 07/02/20 at 11:02:22:


RC1 works for me, but not with my config-file. But no problem, I'll manage. It seems as if RC1 is the same as the final release of v0.26. I'll try it soon, thanks!

an ordinary chessplayer wrote on 07/01/20 at 17:36:01:


The engine works fine when I remove the config-file. There are several parameters that just gave an error message, but some seem to make the engine get stuck. I might try to debug by commenting out all lines and adding them back. Or just create a totally new file with the basics (like multiplexing and number or threads etc).

Thanks for your help!

fling wrote on 07/01/20 at 14:49:07:

Most likely the name for the config is compiled into the executable. You didn't say if the engine error was fatal or not.

You can try renaming the config, then the engine will either raise an error that it can't find it, or possibly just use default values that you may or may not like.

Once you can get the engine to run (with or without errors), issue the "uci" command. The engine is supposed to report all the parameters that it can accept, and their defaults. Anything not in the list you should remove from the config, or comment them out.

The problem is my config-file. It contains some values that were recognized in v0.24, but not in v0.25 or v0.26.