CCRL update (14th February 2009)

[Graham Banks]

The latest updates of the CCRL Rating Lists and Statistics are available for viewing at:
http://www.computerchess.org.uk/ccrl/4040/ (40/40)
http://computerchess.org.uk/ccrl/404/ (40/4)
The live link to the 40/4 list given below is currently the most up to date for that list.

The lists sometimes get updated during the week and these updates can be viewed here:
http://www.computerchess.org.uk/ccrl/4040.live/ (40/40)
http://computerchess.org.uk/ccrl/404.live/ (40/4)
However, no game downloads are available from these live links.

The links to the various rating lists can be found just beneath the default Best Versions list.
For example there is a 32-bit Single CPU list.

Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Currently active testers are:
Graham Banks, Ray Banks (FRC only), Shaun Brewer, Kirill Kryukov, Dom Leste, Tom Logan, Denis Mendoza, Wassim Saeed, Charles Smith, George Speight and Gabor Szots.
Currently inactive testers are:
Sarah Bird, Andreas Schwartmann, Chris Taylor, Martin Thoresen and Chuck Wilson.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.


40/40 Notes

There are currently over 166,000 games in our 40/40 database.


4CPU 64-bit Engines

Rybka 3 remains unchallenged at the top with a handy lead over Naum 4.
Deep Fritz 11 is a reasonable distance back in third spot, narrowly ahead of Zappa Mexico II.
There is another meaningful gap back to Deep Sjeng WC2008 and Deep Shredder 11.
Hiarcs 12, Toga II 1.4.1SE, Thinker 5.4a Inert and Bright 0.4a (private) come in next and are very evenly matched in strength.
None of the many strong Toga derivatives have been tested in this category.

The relative ratings of the 2CPU engines that have been well tested are pretty much the same as their 4CPU counterparts.


Single CPU Engines

Rybka 3 has a lead of 90 elo over Naum 4, which in turn has a lead of 95 elo over the evenly matched Zappa Mexico II and Fritz 11.
Thinker 5.4a Inert, Deep Sjeng WC2008, Shredder 11 and Toga II 1.4.1SE aren't too far back and are also very close in strength to each other. Grapefruit 1.0 and Cyclone 3.4 look likely to be in this group once they've been more extensively tested.
Hiarcs 12.1, TheMadPrune 1.1.25 and Stockfish 1.2 are the next closely bunched group of engines, ahead of Fruit 2.3.1, Loop 13.6 and Bright 0.4a (private).


Free Single CPU Engines

Rybka 2.2n2 holds onto its spot as the top free engine, ahead of Thinker 5.4a.
Grapefruit 1.0 looks likely to establish itself in third spot, but needs more games to confirm this.
Toga II 1.4.1SE, Glaurung 2.2 and Cyclone 3.4 aren't too far behind, with a small gap back to Stockfish 1.2, TheMadPrune 1.1.25 and Fruit 2.3.2.
There is then a definite gap back to Spike 1.2 Turin and Bright 0.3a.
Twisted Logic 20080620, Delfi 5.4, Frenzee Feb08 and Booot 4.15.0 are the next group of evenly matched engines. Watch out for Crafty 22.10 as it could well have progressed to roughly the same level as this group!

CCRL tests a wide range of free engines, ranging right down to the 2000 elo level. The intention is to get well over 200 games for each of these engines.
Tournaments involving these engines can be followed in our public forum.


Blitz Notes

There are now well over 400,000 games in the 40/4 database and it is well worth a visit.
Shaun, Gabor, Kirill, Denis and Dom put a lot of work into this list.


FRC Notes

Ray currently restricts his testing to FRC only.
Thanks to the much appreciated efforts of Matthias Gemuh, ChessGUI is now able to be used to test all FRC engines, both Winboard/UCI plus Shredder/Arena specific.

There are currently 43,000 games in the database.

Rybka 3 has a big lead over Naum 4, which in turn has a similarly big lead over the evenly matched Shredder 11 and Deep Sjeng WC2008.
Hiarcs 12.1 comes in next, comfortably ahead of Glaurung 2.2.

Since the last update report, Ray has tested The Baron 2.23 and Tornado 2.1.41a. He is currently a good chunk of the way through testing Jonny 2.83. Several other FRC-capable engines are on his waiting list.

For FRC the best list to look at is the pure list.
http://www.computerchess.org.uk/ccrl/404FRC/


Stats/Presentation Notes

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code.
ELO ratings are now saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.

An exciting new development coming soon will be the optional inclusion of engine logos, flags and continent pictures beside each engine name in the rating lists.
An example of what this will look can be seen here in Kirill's special free engines project - KCEC site
The engine logo will function as a link to selection of all engines from the same family. The country flag will be a link to selection of all engines from the same country. The continent picture is a link to selection of all engines from the same continent.