CCRL update (23rd October 2009)

[Graham Banks]

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040/ (40/40)
http://www.computerchess.org.uk/ccrl/404/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are updated separately to each other.
The links given in each update report will give you the currently up to date lists.

The links to the various rating lists can be found just beneath the default Best Versions list.
For example there is a 32-bit Single CPU list.

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Currently active testers are:
Graham Banks, Shaun Brewer, Aser Huerga, Kirill Kryukov, Wassim Saeed, Charles Smith and Gabor Szots.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.


40/40 Notes

There are currently over 210,000 games in our 40/40 database.


4CPU 64-bit Engines

Rybka 3 is clearly stronger than both Naum 4 and Deep Shredder 12, which are engaged in a tight battle for second spot.
Deep Fritz 11 is a reasonable way back in fourth, ahead of Stockfish 1.5.1 and Zappa Mexico II. Stockfish 1.5.1 is still in the early stages of testing and could yet challenge Deep Fritz 11.
Thinker 5.4c Inert and Deep Sjeng WC2008 are next in the list, and are very evenly matched.
Further back still, Hiarcs 12.1, Toga II 1.4.1SE and Bright 0.4a are also evenly matched.


The relative ratings of the 2CPU engines that have been well tested are pretty much the same as their 4CPU counterparts.


Single CPU Engines

Remarkably, Rybka 3 is still almost 100 elo ahead of other engines.
Although we've not yet tested the 64-bit version of Shredder 12, it is safe to say that there is not a lot between Naum 4 and Shredder 12 in the fight for second ranking.
Using the same logic, Stockfish 1.5.1 has now moved ahead of Thinker 5.4c Inert, and could therefore have an edge over Fritz 12.
There is a small gap back to Zappa Mexico II, which in turn has the edge over Deep Sjeng WC2008 and Grapefruit 1.0.
Onno 1.1.1 and Hiarcs 12.1 are further back still. Already we're talking almost 250 elo adrift of Rybka.
Fruit 2.3.1, Loop 13.6 and Bright 0.4a are the next group of engines, ahead of Ktulu 9, Spike 1.2 Turin and Junior 10.
SmarThink 1.20 is still in the early stages of testing, but is likely to end up somewhere amongst the aforementioned group.


Free Single CPU Engines

Rybka 2.3.2a is the the top free engine, ahead of Stockfish 1.5.1 and Thinker 5.4c Inert.
Grapefruit 1.0 remains as the strongest Toga derivative, with a small edge over Cyclone xTreme.
Fruit 2.3.1 and Bright 0.4a come in next.
Protector 1.2.8 and Spike 1.2 Turin are further back still, but with a clear edge over Twisted Logic 20080620, Naum 2.0, Frenzee Feb08, Booot 4.15.0 and Delfi 5.4. The latest version of Twisted Logic is still in the early stages of testing, but is currently 60 elo behind 20080620.
Critter 0.42 is a rapidly improving engine to keep an eye on.

CCRL tests a wide range of free engines, ranging right down to the 2000 elo level. The intention is to get well over 200 games for each of these engines.
Tournaments involving these engines can be followed in our public forum.


Blitz Notes

There are now almost half a million games in the 40/4 database.
Shaun, Gabor and Kirill put a lot of work into this list, testing engines in a very well organised and systematic manner. Well worth a look!


FRC Notes

There is now almost 60,000 games in the database.
Ray has recently tested Cyclone xTreme Fear and is currently testing Stockfish 1.5.1.

Thanks to the much appreciated efforts of Matthias Gemuh, ChessGUI is now able to be used to test all FRC engines, both Winboard/UCI plus Shredder/Arena specific.

Rybka 3 has a big lead over Naum 4. Shredder 12 has yet to be tested, but seems likely to challenge Naum for second spot.
Stockfish 1.5.1 is currently being tested and doesn't yet appear on the list.
Hiarcs 12.1 and Cyclone xTreme Fear (the only Toga derivative tested) come in next.
Fruit 051103 and Loop 10.32f lie further back, ahead of Bright 0.4a and Spike 1.2 Turin.

For FRC the best list to look at is the pure list.
http://www.computerchess.org.uk/ccrl/404FRC/


Stats/Presentation Notes

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code not from the live link though).
ELO ratings are now saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.

For any testers interested in joining our group, please read our homepage before applying.