CCRL update (12th December 2008)

[Graham Banks]

The latest updates of the CCRL Rating Lists and Statistics are available for viewing at:
http://www.computerchess.org.uk/ccrl/4040/ (40/40)
http://computerchess.org.uk/ccrl/404/ (40/4)
The live link to the 40/4 list given below is currently the most up to date for that list.

The lists sometimes get updated during the week and these updates can be viewed here:
http://www.computerchess.org.uk/ccrl/4040.live/ (40/40)
http://computerchess.org.uk/ccrl/404.live/ (40/4)
However, no game downloads are available from these live links.

The links to the various rating lists can be found just beneath the default Best Versions list.
For example there is a 32-bit Single CPU list.

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Currently active testers are:
Graham Banks, Ray Banks, Shaun Brewer, Kirill Kryukov, Dom Leste, Tom Logan, Wassim Saeed, George Speight and Gabor Szots.
Currently inactive testers are:
Sarah Bird, Andreas Schwartmann, Joshua Shriver, Charles Smith, Chris Taylor, Martin Thoresen and Chuck Wilson.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to also look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.


40/40 Notes


4CPU 64-bit Engines

Testing of Naum 4 in this category will commence this week.
In the meantime, Rybka 3 still holds a mammoth lead over Deep Fritz 11, which is currently number two. Naum 4 is of course expected to change this situation.
Not too far behind Deep Fritz 11 are Naum 3.1 and Zappa Mexico II, which are very evenly matched.
Deep Sjeng WC2008 comes in next with a small edge over Deep Shredder 11, which in turn has a small edge over Hiarcs 12, Toga II 1.4.1SE and Bright 0.4a (private).
Glaurung 2.1 and Loop M1-T lie further back.

The relative ratings of the 2CPU engines that have been well tested are pretty much the same as their 4CPU counterparts.


Single CPU Engines

Naum 4 has only 24 games so far in this category, so nothing should be assumed from its current rating.
Rybka 3 currently holds a mammoth lead here also.
The battle for second spot has been tense up till this point in time, with a 20 elo spread covering Naum 3.1, Zappa Mexico II, Fritz 11, Thinker 5.3b Inert and Deep Sjeng WC2008. However, Naum 4 is expected to cement itself in clear second spot.
There is a small margin back to Shredder 11 and Toga II 1.4.1SE.
Cyclone 2.2, Grapefruit 1.0a3 and Hiarcs 12 come in next, comfortably ahead of the group that includes Fruit 2.3.1, Loop 13.6, Glaurung 2.1 and Bright 0.4a (private).


Free Single CPU Engines

Rybka 2.2n2 still heads the field, but Thinker 5.3b Inert has now claimed second spot, ahead of Toga II 1.4.1SE.
Cyclone 2.2 and Grapefruit 1.0a3 currently come in next, ahead of Fruit 2.3.1 and Glaurung 2.1.
Spike 1.2 Turin, Stockfish 1.01 and Bright 0.3a are further back, but clearly stronger than the next group that includes Twisted Logic 20080620, Frenzee Feb08 and Delfi 5.4.

CCRL tests a wide range of free engines, ranging right down to the 1950 elo level. The intention is to get well over 200 games for each of these engines.
Tournaments involving these engines can be followed in our public forum.


Blitz Notes

There are over 350,000 games in the 40/4 database and it is well worth a visit.

Naum 4 64-bit 4CPU has close to 500 games and currently shows an 80+ elo improvement over its predecessor. We have started testing Naum 4 in the 2CPU and 1CPU categories also, so they will appear in the list soon.

Of special interest to some will be the best free 1CPU engines list which is being constructed through a systematic testing approach as mentioned here:
http://kirill-kryukov.com/chess/discuss ... f=7&t=3271


FRC Notes

Ray tests only those engines that can play FRC through the Shredder Classic GUI.
If engine authors have a new and stable version of their engine that will run under this GUI, they should contact Ray if they wish to see it tested.

Rybka 3's lead has been cut to roughly 100 elo by the new and impressive Naum 4.
Incredibly, there is now a similarly large gap back to Deep Sjeng WC2008 and Shredder 11, which are very evenly matched.
Hiarcs Paderborn 2007 comes in next, comfortably ahead of Fruit 051103 and Loop 10.32f (the most recent Loop version that could play FRC).
Ray finished testing Hamsters 0.7.1 during the week, and it now also appears in the list.

For FRC the best list to look at is the pure list.
http://www.computerchess.org.uk/ccrl/404FRC/


Stats/Presentation Notes

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code.
ELO ratings are now saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.