SSDF Rating list - Last Updated 31st of December 2023

Designed for posting all types of tournaments and Games (e.g. Man vs. Machine, Computer vs. Computer and basement matches.)

Moderators: Harvey Williamson, Watchman

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
User avatar
Lars Sandin
SSDF
Posts: 2234
Joined: Sun Nov 18, 2007 4:24 pm
Location: Sundsvall, Sweden

THE SSDF RATING LIST 2022-05-24

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2022-05-24    160235 games played by  424 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Lc0 0.28.2 Cuda-611213 3060Ti           3591   48   -43   280   71%  3438
   2 Stockfish 13 x64 1800X 3.6 GHz          3577   37   -34   440   70%  3426
   3 Lc0 0.26.3 Cuda(67362) 3060Ti           3572   29   -27   680   68%  3442
   4 Dragon Komodo 2.51 x64 1800X 3.6 GHz    3566   42   -39   320   65%  3456
   5 Stockfish 14 x64 1800X 3.6 GHz          3555   39   -37   360   66%  3444
   6 Stockfish 12 NNUE x64 1800X 3.6 GHz     3555   30   -29   560   62%  3465
   7 Dragon by Komodo x64 1800X 3.6 GHz      3544   34   -32   460   63%  3449
   8 Stockfish 11 x64 1800X 3.6 GHz          3537   36   -34   450   70%  3393
   9 Stockfish 10 x64 1800X 3.6 GHz          3514   25   -24   880   68%  3378
  10 Dragon Komodo 2 MCTS x64 1800X 3.6 GHz  3479   45   -44   240   55%  3444
  11 Stockfish 9 x64 1800X 3.6 GHz           3476   26   -24   882   70%  3330
  12 Komodo 13.1 x64 1800X 3.6 GHz           3463   30   -29   560   62%  3379
  13 Komodo 14 x64 1800X 3.6 GHz             3461   31   -31   480   53%  3442
  14 Komodo 13.02 x64 1800X 3.6 GHz          3457   30   -29   600   65%  3346
  15 Komodo 12.3 x64 1800X 3.6 GHz           3447   27   -26   760   66%  3329
  16 Arasan 23.01 x64 1800X 3.6 GHz          3443   39   -38   320   52%  3429
  17 Stockfish 9 x64 Q6600 2.4 GHz           3439   32   -31   480   56%  3394
  18 Booot 6.5 x64 1800X 3.6 GHz             3426   38   -38   320   49%  3435
  19 Pedone 3.1 x64 1800X 3.6 GHz            3423   46   -47   220   48%  3433
  20 Dragon Komodo MCTS x64 1800X 3.6 GHz    3404   38   -38   320   52%  3391
  21 Wasp 5.5 x64 1800X 3.6 GHz              3395   49   -51   194   41%  3456
  22 Wasp 5 x64 1800X 3.6 GHz                3378   41   -44   280   38%  3470
  23 Booot 6.4 x64 1800X 3.6 GHz             3366   36   -36   360   51%  3359
  24 Arasan 22.3 x64 1800X 3.6 GHz           3359   41   -44   280   36%  3454
  25 Pedone 3.1 x64 Q6600 2.4 GHZ            3359   41   -39   300   60%  3290
  26 Booot 6.5 x64 Q6600 2.4 GHz             3359   44   -41   280   62%  3272
  27 Chiron 5.01 x64 1800X 3.6 GHz           3356   38   -40   320   40%  3427
  28 Deep Shredder 13 x64 1800X 3.6 GHz      3353   24   -24   880   64%  3252
  29 Chiron 5.01 x64 Q6600 2.4 GHz           3330   43   -41   280   62%  3244
  30 Marvin 5.2.0 x64 1800X 3.6 GHz          3330   39   -42   320   34%  3447
  31 Marvin 5.1.0 x64 1800X 3.6 GHz          3321   44   -47   240   37%  3412
  32 Wasp 4.5 x64 1800X 3.6 GHz              3289   48   -54   220   29%  3447
  33 Vajolet2 2.8 x64 1800X 3.6 GHz          3288   27   -28   650   38%  3372
  34 Marvin 5.1.0 x64 Q6600 2.4 GHz          3218   46   -48   220   43%  3270
  35 Deep Hiarcs 14 1800X 3.6 GHz            3211   23   -24   880   38%  3295
  36 Deep Rybka 4 x64 Q6600 2.4 GHz          3194   18   -18  1528   62%  3107
  37 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2925   47   -45   228   56%  2882
  38 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2858   24   -25   932   30%  3006
  39 Revelation Hiarcs 13.3 PXA255 500 MHz   2772   57   -52   177   66%  2660
  40 Revelation Shredder 12 PXA255 500 MHz   2706   60   -58   140   56%  2666
  41 Revelation Rybka 2.2 PXA255 500 MHz     2635   45   -43   260   63%  2546
  42 Revelation Deep Sjeng 3 PXA255 500 MHz  2600   62   -67   120   41%  2665
  43 Millennium The King Exclusive 300 MHz   2535   52   -51   180   56%  2496
  44 Revelation Ruffian 2.1 PXA255 500 MHz   2346   68   -71   100   45%  2384
  45 Millennium ChessGenius Excl. M7 300 MHz 2243   52   -49   190   58%  2189
  46 Mephisto London 68030 33 MHz            2194   31   -31   482   50%  2192
  47 Millennium ChessGenius Pro M4 120 MHz   2162   59   -54   160   63%  2066
  48 Mephisto London 68020 12 MHz            2092   61   -54   166   68%  1961
  49 Millennium ChessGenius ARM M4 48 MHz    2069   45   -43   251   58%  2015
  50 Mephisto Roma II 68000 10 MHz           1903   69   -69   100   50%  1903

 1 Lc0 0.28.2 Cuda-611213 3060Ti, 3591											
Stoc13 1800X    20,5-19,5  Dra251 1800X      21-19    Ko14 1800X      27,5-12,5
Wasp55 1800X      30-10    Wasp5 1800X       31-9     Chi5 1800X      31,5-8,5 
Mar52 1800X     37,5-2,5   

 21 Wasp 5.5 x64 1800X 3.6 GHz, 3395											
Lc028 3060Ti      10-30    Dra251 1800X      10-30    Boo65 1800X       17-23
Booot6 1800X      20-14    Mar52 1800X       23-17    

 27 Chiron 5.01 x64 1800X 3.6 GHz, 3356											
Lc028 3060Ti     8,5-31,5  Stoc14 1800X       7-33    Arasa23 1800X     15-25
Boo65 1800X       15-25    Dra MC 1800X      20-20    Wasp5 1800X     18,5-21,5
Mar52 1800X     20,5-19,5  Wasp45 1800X      22-18    

 29 Chiron 5.01 x64 Q6600 2.4 GHz, 3330											
Ped31 Q6600     23,5-16,5  Boo65 Q6600       18-22    DShre13 Q6600   17,5-22,5
Mar51 Q6600     25,5-14,5  DRybka4 Q6600     29-11    Chiro3 Q6600    28,5-11,5
Spike14 Q6600   31,5-8,5   

 30 Marvin 5.2.0 x64 1800X 3.6 GHz, 3330											
Lc028 3060Ti     2,5-37,5  Stoc13 1800X       5-35    Stoc14 1800X     8,5-31,5
Boo65 1800X     17,5-22,5  Wasp55 1800X      17-23    Ped3 1800X      15,5-24,5
Chi5 1800X      19,5-20,5  Wasp45 1800X    22,5-17,5  

 50 Mephisto Roma II 68000 10 MHz, 1903											
London 68020     4,5-15,5  Sapphire II        7-13    Meph. Milano    11,5-8,5 
Kasp. GK-2000     13-7     Rebell 5 MHz      14-6     

This is the second list of 2022 and in this list we can present six new entries.

The first one out is our new leader in the rating list, Leela Chess Zero 0.28.2.
After the first 280 games played, it has recieved an impressive rating of 3591,
which is currently 19 points stronger than the older Lc0-version. It leads the
rating list with 15 points ahead of Stockfish 13. 
As with the formerly tested version, we have used an Nvidia RTX 3060 Ti graphic 
card for the testing. We have used the 30 blocks + 384 filter network, named:
611213 (date 2022-01-06), and as opening book we have used the free opening 
book "Perfect2021.abk" by Sedat Canbaz.

Our second newcomer are Wasp 5.5 from John Stanback. After the first 194 games, 
it has recieved a rating of 3395. This is at the moment 17 points ahead of the 
formerly tested 5.0 version and at the same time 106 points ahead of the
Wasp 4.5 version. Wasp uses its own included opening book.

We are also glad to be able to introduce a new Chiron 5.01 version on our 
rating list. We introduced Chiron 3.01 by Ubaldo Andrea Farina back in the
August list of 2016. Since that was before the AMD 1800X was introduced
as hardware on our rating list, Chiron 3.01 was only tested on our Intel Q6600
hardware at the time. We have now tested Chiron 5.01 on both our hardware levels.
On our 1800X hardware, Chiron 5.01 has reached a rating of 3356 after 320 games
played. And on our Q6600 hardware, Chiron 5.01 has reached a rating of 3330 after 
280 games played. This is at the moment 154 points over the former 3.01 version, 
so a very nice improvement! As opening book we have used the "Perfect2021.abk" 
opening book by Sedat Canbaz.

Our fourth new program on this list are the latest Marvin 5.2.0 version of 
Martin Danielsson. After 320 played games it has reached a rating of 3330, and 
this is currently 9 points ahead of the formerly tested 5.1.0 version. As with 
the 5.1.0 version, it is using its own opening book in the testing.  

And last, but not least, we are also able to introduce a golden oldie from 1989!
It is Richard Lang's Mephisto Roma II 68000-module, which was released in 1989, 
two years after the initial Mephisto Roma was introduced on the market. 
The special thing with this version was that it was the only 16 bit 
Motorola 68000 based engine which could be used in the Mephisto Mobil-board, 
a small handheld version of their modular series of chess boards. 
Perhaps because of this, they had to lower the clock frequency on the 68000 
processor. It has a frequency of 10 MHz instead of the 12 MHz which was used 
on the 1987-version of the Roma program. As nothing else was changed between 
the two programs, the Roma II should in theory be somewhat lower rated than 
the older Roma program with its higher clock frequency. But, after the 
first 100 games, the Roma II has yet managed to position itself 27 points 
higher than the 1987 version and gained a rating of 1903! 
As the old Roma 68000 12 MHz have a staggering amount of 1519 manually played
games under its belt, one can safely assume that the rating of Roma II will 
become lower as more games are played, and the error bars on the Roma II are 
also still high compared to the more trustworthy rating of its older sibling.

Lars Sandin
Lars Sandin, SSDF
User avatar
Lars Sandin
SSDF
Posts: 2234
Joined: Sun Nov 18, 2007 4:24 pm
Location: Sundsvall, Sweden

THE SSDF RATING LIST 2022-12-31

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2022-12-31    161668 games played by  429 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Lc0 0.28.2 Cuda-611213 3060Ti           3575   27   -25   772   66%  3447
   2 Stockfish 13 x64 1800X 3.6 GHz          3574   35   -32   480   69%  3436
   3 Stockfish 15 x64 1800X 3.6 GHz          3574   42   -39   320   66%  3458
   4 Lc0 0.26.3 Cuda(67362) 3060Ti           3571   29   -27   680   68%  3444
   5 Dragon Komodo 3 x64 1800X 3.6 GHz       3571   43   -41   285   62%  3487
   6 Dragon Komodo 2.51 x64 1800X 3.6 GHz    3566   42   -39   320   65%  3457
   7 Stockfish 14 x64 1800X 3.6 GHz          3557   39   -37   360   66%  3445
   8 Stockfish 12 NNUE x64 1800X 3.6 GHz     3554   28   -27   658   61%  3464
   9 Dragon by Komodo x64 1800X 3.6 GHz      3542   34   -32   460   63%  3448
  10 Stockfish 11 x64 1800X 3.6 GHz          3535   36   -34   450   70%  3391
  11 Dragon Komodo 3.1 MCTS 1800X 3.6 GHz    3519   42   -39   306   63%  3430
  12 Stockfish 10 x64 1800X 3.6 GHz          3510   25   -23   920   67%  3375
  13 Dragon Komodo 2 MCTS x64 1800X 3.6 GHz  3478   45   -44   240   55%  3443
  14 Stockfish 9 x64 1800X 3.6 GHz           3474   25   -24   922   68%  3329
  15 Booot 7 x64 1800X 3.6 GHz               3471   50   -51   185   48%  3486
  16 Komodo 13.1 x64 1800X 3.6 GHz           3463   29   -28   600   60%  3152
  17 Komodo 14 x64 1800X 3.6 GHz             3461   30   -30   520   52%  3445
  18 Komodo 13.02 x64 1800X 3.6 GHz          3455   30   -29   600   65%  3344
  19 Arasan 23.01 x64 1800X 3.6 GHz          3452   33   -34   420   48%  3464
  20 Stockfish 9 x64 Q6600 2.4 GHz           3437   32   -31   480   56%  3372
  21 Pedone 3.1 x64 1800X 3.6 GHz            3433   38   -39   320   45%  3470
  22 Booot 6.5 x64 1800X 3.6 GHz             3429   34   -34   400   48%  3440
  23 Dragon Komodo MCTS x64 1800X 3.6 GHz    3401   38   -38   320   52%  3389
  24 Wasp 5.5 x64 1800X 3.6 GHz              3391   41   -43   280   41%  3455
  25 Wasp 5 x64 1800X 3.6 GHz                3379   41   -44   280   38%  3468
  26 Marvin 6.0.0 x64 1800X 3.6 GHz          3365   47   -53   220   31%  3499
  27 Arasan 22.3 x64 1800X 3.6 GHz           3363   39   -42   320   35%  3471
  28 Pedone 3.1 x64 Q6600 2.4 GHZ            3356   41   -39   300   60%  3288
  29 Deep Shredder 13 x64 1800X 3.6 GHz      3351   24   -23   920   62%  3265
  30 Chiron 5.01 x64 1800X 3.6 GHz           3347   33   -35   440   34%  3458
  31 Chiron 5.01 x64 Q6600 2.4 GHz           3328   43   -41   280   62%  3243
  32 Marvin 5.2.0 x64 1800X 3.6 GHz          3328   37   -40   360   32%  3459
  33 Wasp 4.5 x64 1800X 3.6 GHz              3303   43   -47   280   30%  3453
  34 Vajolet2 2.8 x64 1800X 3.6 GHz          3287   27   -28   650   38%  3370
  35 Deep Hiarcs 14 1800X 3.6 GHz            3210   23   -24   880   38%  3283
  36 Deep Rybka 4 x64 Q6600 2.4 GHz          3193   18   -18  1528   62%  3106
  37 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2924   47   -45   228   56%  2881
  38 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2857   24   -25   932   30%  3006
  39 Revelation Hiarcs 13.3 PXA255 500 MHz   2772   57   -52   177   66%  2660
  40 Revelation Shredder 12 PXA255 500 MHz   2706   60   -58   140   56%  2666
  41 Revelation Rybka 2.2 PXA255 500 MHz     2635   45   -43   260   63%  2546
  42 Revelation Deep Sjeng 3 PXA255 500 MHz  2600   62   -67   120   41%  2664
  43 Millennium The King Exclusive 300 MHz   2534   51   -49   190   55%  2499
  44 Revelation Ruffian 2.1 PXA255 500 MHz   2346   68   -71   100   45%  2385
  45 Millennium ChessGenius Excl. M7 300 MHz 2245   50   -48   200   57%  2194
  46 Mephisto London 68030 33 MHz            2195   31   -31   482   50%  2192
  47 Millennium ChessGenius Pro M4 120 MHz   2162   59   -54   160   63%  2066
  48 Mephisto London 68020 12 MHz            2089   60   -53   171   68%  1955
  49 Millennium ChessGenius ARM M4 48 MHz    2069   45   -43   251   58%  2015
  50 Mephisto Roma II 68000 10 MHz           1891   65   -63   119   54%  1862

 3 Stockfish 15 x64 1800X 3.6 GHz, 3574											
Lc028 3060Ti    20,5-19,5  Dra3 1800X      20,5-19,5  SF12NU 1800X      20-20
Boo7 1800X      25,5-14,5  Arasa23 1800X     25-15    Mar60 1800X       32-8 
Chi5 1800X      33,5-6,5   Mar52 1800X     33,5-6,5   

 5 Dragon Komodo 3 x64 1800X 3.6 GHz, 3571											
Lc028 3060Ti    19,5-20,5  Stoc13 1800X    19,5-20,5  Stoc15 1800X    19,5-20,5
Stoc10 1800X      24-16    Boo7 1800X       3,5-1,5   Ped31 1800X     27,5-12,5
Wasp55 1800X    29,5-10,5  DShre13 1800X   33,5-6,5   

 11 Dragon Komodo 3.1 MCTS 1800X 3.6 GHz, 3519											
Lc028 3060Ti      17-23    SF12NU 1800X    12,5-13,5  Ko14 1800X        22-18
Ped31 1800X       36-24    Mar60 1800X       42-18    Chi5 1800X        62-18

 15 Booot 7 x64 1800X 3.6 GHz, 3471											
Lc028 3060Ti    31,5-48,5  Stoc15 1800X    14,5-25,5  Dra3 1800X       1,5-3,5 
Wasp45 1800X      41-19    

 26 Marvin 6.0.0 x64 1800X 3.6 GHz, 3365											
Lc028 3060Ti       6-34    Stoc15 1800X       8-32    Dra31M 1800X      18-42
Boo65 1800X     16,5-23,5  Wasp55 1800X    19,5-20,5

In this last rating list of the year 2022, we can present five new entries. 
First one out is the latest version from team Stockfish, namely Stockfish 15. 
This version landed just a hairline from the number one spot this time and 
grabbed the third position, but only one single point behind the leader Lc0! 
After 480 played games it has earned a rating of 3574, which is 17 points ahead 
of Stockfish 14 and exactly on par with Stockfish 13 at the moment. As opening
book for Stockfish 14, we have used Fauzi Dabat's "Aggressive 5.4 by Fauzi.abk".

Next one out is Dragon Komodo 3 by Mark Lefler and Larry Kaufman. We have tested
both the "normal" version and the Monte Carlo Tree Search-version. The non-MCTS
version of Dragon Komodo 3 earned a fifth place in this rating list, with a
rating of 3571 after 285 games played. It has positioned itself five points 
ahead of the 2.51 version and just four points behind the number one spot at 
the moment!

In the testing of the Monte Carlo Tree Search (MCTS) Dragon Komodo, we have 
used the 3.1 version. It has recieved a rating of 3519 after 306 games
played. It is 41 points stronger than the Dragon Komodo 2 MCTS and took the 
eleventh spot on this rating list. As opening book for both the ordinary and 
the MCTS-version, we have used Erdogan Günes opening book "out10-35.bin".
The sharp-sighted has probably noticed that the nomenclature "x64" is omitted
from the name this time. We can insure that the testing has been done with the
strongest settings, AVX2 and also 64-bit, and that the omission is made just 
because of the length limitations in the naming of the engines. 

I can also add that since most engines that we have tested on both the Q6600 
and 1800X hardware has been 64-bit programs, we will soon make an overhaul to
upcoming rating lists and strip this rather unnecessary designation from the 
names - only adding 32 bit to the names of the few engines that hasn't been 
64-bit compatible.

Well, to get back on track. The next program that we can present in our latest 
rating list, is Alex Morozov's - Booot 7. This time he has used his own 
implementation of Neural Net technology (NN) in evaluation, using Python, 
Delphi and SIMD. This has proved to been useful to the already strong Booot-
program and he has managed to get a rating of 3471 after the first 185 played 
games. This is 42 points ahead of the "ordinary evaluation"-version of 
Booot 6.5 and it now holds the first spot of the engines outside the 
three in the top: Lc0, Stockfish and Dragon Komodo. 
As opening book for Booot 7, we have used the "Perfect2021.abk" opening book 
by Sedat Canbaz. 

Last one out in this rating list is Martin Danielsson with his Marvin-program.
We have tested the 6.0.0-version this time, and it has recieved a rating 
of 3365 after 220 played games. It is 37 points stronger than the last Marvin 
version (5.2.0) which we have tested and we have used Marvin's own opening book 
for the testing.

Since the last rating list, Wasp 4.5 1800X gained 14 points, Pedone 3.1 1800X
gained 10 and Arasan 23.01 1800X gained 9 points. Biggest loss since the last
list was Lc0 0.28.2 which dropped 16 points in the lead. Other notable losses
was Roma II which lost 13 points and Chiron 5.01 1800X, which lost 8 points.  

The next rating list will probably be released relatively soon and will feature
the manually tested Revelation II A.E. Komodo 12.1, and hopefully also contain
some more engines on both the 1800X and Q6600 hardware level. We will also 
begin testing of a more recent version of Lc0 soon, so hopefully it will have 
enough games to be presented as an early bird in the next rating list.
 
Lars Sandin
Lars Sandin, SSDF
User avatar
paulwise3
Senior Member
Posts: 1508
Joined: Tue Jan 06, 2015 10:56 am
Location: Eindhoven, Netherlands

Re: THE SSDF RATING LIST 2022-12-31

Post by paulwise3 »

Lars Sandin wrote: Tue Jan 03, 2023 7:09 am

Code: Select all

In this last rating list of the year 2022, we can present five new entries. 
First one out is the latest version from team Stockfish, namely Stockfish 15. 
This version landed just a hairline from the number one spot this time and 
grabbed the third position, but only one single point behind the leader Lc0! 
After 480 played games it has earned a rating of 3574, which is 17 points ahead 
of Stockfish 14 and exactly on par with Stockfish 13 at the moment. As opening
book for Stockfish 14, we have used Fauzi Dabat's "Aggressive 5.4 by Fauzi.abk".

Next one out is Dragon Komodo 3 by Mark Lefler and Larry Kaufman. We have tested
both the "normal" version and the Monte Carlo Tree Search-version. The non-MCTS
version of Dragon Komodo 3 earned a fifth place in this rating list, with a
rating of 3571 after 285 games played. It has positioned itself five points 
ahead of the 2.51 version and just four points behind the number one spot at 
the moment!

In the testing of the Monte Carlo Tree Search (MCTS) Dragon Komodo, we have 
used the 3.1 version. It has recieved a rating of 3519 after 306 games
played. It is 41 points stronger than the Dragon Komodo 2 MCTS and took the 
eleventh spot on this rating list. As opening book for both the ordinary and 
the MCTS-version, we have used Erdogan Günes opening book "out10-35.bin".
The sharp-sighted has probably noticed that the nomenclature "x64" is omitted
from the name this time. We can insure that the testing has been done with the
strongest settings, AVX2 and also 64-bit, and that the omission is made just 
because of the length limitations in the naming of the engines. 

I can also add that since most engines that we have tested on both the Q6600 
and 1800X hardware has been 64-bit programs, we will soon make an overhaul to
upcoming rating lists and strip this rather unnecessary designation from the 
names - only adding 32 bit to the names of the few engines that hasn't been 
64-bit compatible.

Well, to get back on track. The next program that we can present in our latest 
rating list, is Alex Morozov's - Booot 7. This time he has used his own 
implementation of Neural Net technology (NN) in evaluation, using Python, 
Delphi and SIMD. This has proved to been useful to the already strong Booot-
program and he has managed to get a rating of 3471 after the first 185 played 
games. This is 42 points ahead of the "ordinary evaluation"-version of 
Booot 6.5 and it now holds the first spot of the engines outside the 
three in the top: Lc0, Stockfish and Dragon Komodo. 
As opening book for Booot 7, we have used the "Perfect2021.abk" opening book 
by Sedat Canbaz. 

Last one out in this rating list is Martin Danielsson with his Marvin-program.
We have tested the 6.0.0-version this time, and it has recieved a rating 
of 3365 after 220 played games. It is 37 points stronger than the last Marvin 
version (5.2.0) which we have tested and we have used Marvin's own opening book 
for the testing.

Since the last rating list, Wasp 4.5 1800X gained 14 points, Pedone 3.1 1800X
gained 10 and Arasan 23.01 1800X gained 9 points. Biggest loss since the last
list was Lc0 0.28.2 which dropped 16 points in the lead. Other notable losses
was Roma II which lost 13 points and Chiron 5.01 1800X, which lost 8 points.  

The next rating list will probably be released relatively soon and will feature
the manually tested Revelation II A.E. Komodo 12.1, and hopefully also contain
some more engines on both the 1800X and Q6600 hardware level. We will also 
begin testing of a more recent version of Lc0 soon, so hopefully it will have 
enough games to be presented as an early bird in the next rating list.
 
Lars Sandin
Thanx again Lars for testing :-).
And now up to testing the new Mephisto Phoenix engines and emulations...!

Regards, Paul
2024 Special thread: viewtopic.php?f=3&t=12741
2024 Special results and standings: https://schaakcomputers.nl/paul_w/Tourn ... 25_06.html
If I am mistaken, it must be caused by a horizon effect...
User avatar
Lars Sandin
SSDF
Posts: 2234
Joined: Sun Nov 18, 2007 4:24 pm
Location: Sundsvall, Sweden

Re: SSDF Rating list - Last Updated 31st of December 2022

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2023-05-24*   162991 games played by  435 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Lc0 0.29.0 Cuda-808544 3060Ti           3610   45   -41   287   68%  3466
   2 Lc0 0.28.2 Cuda-611213 3060Ti           3571   26   -25   780   66%  3456
   3 Lc0 0.26.3 Cuda(67362) 3060Ti           3570   29   -27   680   68%  3441
   4 Stockfish 15 x64 1800X 3.6 GHz          3570   39   -36   367   66%  3456
   5 Stockfish 13 x64 1800X 3.6 GHz          3568   35   -32   480   69%  3432
   6 Dragon Komodo 3 x64 1800X 3.6 GHz       3567   40   -38   329   62%  3482
   7 Dragon Komodo 2.51 x64 1800X 3.6 GHz    3565   42   -39   320   65%  3454
   8 Stockfish 14 x64 1800X 3.6 GHz          3555   37   -35   400   65%  3452
   9 Stockfish 12 NNUE x64 1800X 3.6 GHz     3549   26   -25   760   60%  3479
  10 Rebel 16.2 x64 1800X 3.6 GHz            3544   48   -47   209   53%  3522
  11 Dragon by Komodo x64 1800X 3.6 GHz      3536   34   -32   460   63%  3443
  12 Stockfish 11 x64 1800X 3.6 GHz          3529   36   -34   450   70%  3386
  13 Arasan 23.4 x64 1800X 3.6 GHz           3524   54   -55   160   47%  3560
  14 Dragon Komodo 3.1 MCTS 1800X 3.6 GHz    3514   34   -33   440   60%  3447
  15 Stockfish 10 x64 1800X 3.6 GHz          3501   25   -23   920   67%  3378
  16 Booot 7 x64 1800X 3.6 GHz               3477   39   -40   300   46%  3507
  17 Dragon Komodo 2 MCTS x64 1800X 3.6 GHz  3473   45   -44   240   55%  3439
  18 Stockfish 9 x64 1800X 3.6 GHz           3464   24   -23   962   67%  3345
  19 Komodo 14 x64 1800X 3.6 GHz             3455   30   -30   520   52%  3441
  20 Arasan 23.01 x64 1800X 3.6 GHz          3449   33   -34   420   48%  3462
  21 Arasan 23.4 x64 Q6600 2.4 GHz           3439   40   -37   361   68%  3314
  22 Pedone 3.1 x64 1800X 3.6 GHz            3433   38   -39   320   45%  3468
  23 Wasp 6.5 x64 1800X 3.6 GHz              3433   44   -45   242   44%  3478
  24 Stockfish 9 x64 Q6600 2.4 GHz           3427   32   -31   480   56%  3384
  25 Booot 6.5 x64 1800X 3.6 GHz             3426   34   -34   400   48%  3436
  26 Wasp 5.5 x64 1800X 3.6 GHz              3378   37   -39   360   36%  3486
  27 Arasan 22.3 x64 1800X 3.6 GHz           3360   39   -42   320   35%  3468
  28 Marvin 6.0.0 x64 1800X 3.6 GHz          3358   47   -53   220   31%  3494
  29 Pedone 3.1 x64 Q6600 2.4 GHZ            3356   38   -37   340   58%  3303
  30 Deep Shredder 13 x64 1800X 3.6 GHz      3347   24   -23   920   62%  3261
  31 Chiron 5.01 x64 1800X 3.6 GHz           3344   33   -35   440   34%  3455
  32 Marvin 5.2.0 x64 1800X 3.6 GHz          3325   37   -40   360   32%  3456
  33 Chiron 5.01 x64 Q6600 2.4 GHz           3318   34   -34   400   52%  3301
  34 Vajolet2 2.8 x64 1800X 3.6 GHz          3279   27   -28   652   38%  3364
  35 Deep Hiarcs 14 1800X 3.6 GHz            3206   23   -24   880   38%  3289
  36 Revelation 2 A.E. Komodo 12.1 A7 1 GHz  3177   73   -68   100   59%  3113
  37 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2924   47   -45   228   56%  2881
  38 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2857   24   -25   932   30%  3005
  39 Revelation Hiarcs 13.3 PXA255 500 MHz   2772   57   -52   177   66%  2660
  40 Revelation Shredder 12 PXA255 500 MHz   2706   60   -58   140   56%  2666
  41 Revelation Rybka 2.2 PXA255 500 MHz     2635   45   -43   260   63%  2546
  42 Revelation Deep Sjeng 3 PXA255 500 MHz  2600   62   -67   120   41%  2665
  43 Millennium The King Exclusive 300 MHz   2534   49   -48   200   55%  2501
  44 Revelation Ruffian 2.1 PXA255 500 MHz   2346   68   -71   100   45%  2385
  45 Millennium ChessGenius Excl. M7 300 MHz 2249   50   -48   204   58%  2193
  46 Mephisto London 68030 33 MHz            2195   31   -31   482   50%  2192
  47 Millennium ChessGenius Pro M4 120 MHz   2163   59   -54   160   63%  2067
  48 Mephisto London 68020 12 MHz            2089   60   -53   171   68%  1957
  49 Millennium ChessGenius ARM M4 48 MHz    2070   45   -43   251   58%  2015
  50 Mephisto Roma II 68000 10 MHz           1898   63   -59   132   58%  1843

 1 Lc0 0.29.0 Cuda-808544 3060Ti, 3610											
Stoc15 1800X       4-3     Reb162 1800X    21,5-18,5  Aras234 1800X     46-34
Stock9 1800X      29-11    Wasp65 1800X    28,5-11,5  Wasp55 1800X      66-14

 10 Rebel 16.2 x64 1800X 3.6 GHz, 3544											
Lc029 3060Ti    18,5-21,5  Dra3 1800X       4,5-4,5   Stoc14 1800X      19-21
Aras234 1800X   20,5-19,5  Boo7 1800X      23,5-16,5  Wasp65 1800X      24-16

 13 Arasan 23.4 x64 1800X 3.6 GHz, 3524											
Lc029 3060Ti      34-46    Reb162 1800X    19,5-20,5  Boo7 1800X        21-19

 21 Arasan 23.4 x64 Q6600 2.4 GHz, 3439											
Komo12 Q6600    21,5-18,5  Stock8 Q6600    21,5-18,5  Ped31 Q6600     22,5-17,5
Chi5 Q6600      85,5-34,5  DShre13 Q6600     24-16    Vaj28 Q6600        1-0 
Mar51 Q6600     33,5-6,5   DRybka3 Q6600   34,5-5,5   

 23 Wasp 6.5 x64 1800X 3.6 GHz, 3433											
Lc029 3060Ti    11,5-28,5  Stoc15 1800X    11,5-28,5  Reb162 1800X      16-24
Ped3 1800X      44,5-35,5  Komo11 1800X    21,5-18,5  Vaj28 1800X        2-0 

 36 Revelation 2 A.E. Komodo 12.1 A7 1 GHz, 3177											
DShre13 Q6600      6-14    DHiar14 Q6600    9,5-10,5  DJuni12 Q6600   11,5-8,5 
Baro343 Q6600   15,5-4,5   Naum 4  A1200   16,5-3,5   

Since the last rating list we can now present six new entrants in the list. 

First one out is our new leader in the list: Lc0 0.29.0, and also the first 
program that has broken the 3600-barrier in our rating list. More games will 
be needed to lower the error bars, but after the first 297 games it has placed
itself 39 points over the last version tested with a huge rating of 3610! 
It will be interesting to see how it will hold up as more games are played 
against the top programs. 
The Lc0-version which we have tested this time is: Lc0 0.29.0, with the 
19 filter + 512 block network, named 808544 (date: 2023-01-12). As with the
earlier Lc0-versions, we have used the free opening book "perfect2021.abk" 
by Sedat Canbaz for the testing of Lc0.

Our next newcomer in the list are one really strong comeback from the team of
Ed Schroeder and Chris Wittington. Chris Wittington is formely known for 
programs such as: Chess Player 2150/2175, Complete Chess System 
and Chess System Tal (I and II). 
Ed Schroeder is of course known for many of the old dedicated chess computers 
like for instance: Mephisto Polgar, MM IV/V, RISC (I and II), Rebell
and also for versions of his program in the ChessMachine ISA-plugin card for PC.
On the PC-scene he has made the Gideon and Rebel-program famous and lately also 
made several interesting and strong versions of his ProDeo-program.

Since last year they have utilized Neural Net-technology in their joint
effort and has seemingly improved fast. We have waited some time to test it, 
since we wanted it to share most of the functions - like for instance Pondering 
and Multi-Processor functionality, which the others programs that we test on our
latest hardware uses. The version which we have tested is named: Rebel 16.2 and
we have used its own opening book, made by the famous Jeroen Noomen, for the 
testing. After the first 209 games, this strong combo of the program: Rebel 16.2,
and the opening book of Jeroen Noomen, has managed to get an impressive rating 
of 3544 on our 1800X hardware. It is placed 10th in the list at the moment, 
just 5 points shy of the Stockfish 12-program. 
A very strong comeback by Ed, Chris and Jeroen!

Our next addition to the list are Jon Dart's strong and reliable Arasan-program. 
The version that we have tested on our 1800X and Q6600 hardware are Arasan 23.4.
On our 1800X hardware it has reached a rating of 3524 after the initial 160 
games played. That is at the moment 75 points ahead of the formerly tested 23.01
version and a very nice improvement indeed! More games will of course be needed 
to lower the error bars a bit. 
On our Q6600 hardware, Arasan 23.4 has reached a rating of 3439 after 361 games 
played. We never tested the 23.01 version on the Q6600 hardware, but Arasan 23.4 
are a whopping 202 points ahead of the 21.2 version at least! 
We have, as always, used Arasan's own opening book for the testing.                   

We are also glad to be able to present a new strong Wasp version by John Stanback, 
namely Wasp 6.5, on our latest rating list. After the first 242 games played, it 
has reached a rating of 3433! This is 55 points stronger than the 5.5 version 
which we tested before, so a nice improvement there also! We have used Wasp's own
opening book for the testing. 

And we can now finally show the first rating of the manually tested:
Phoenix Revelation II Anniversary Edition chess computer by Ruud Martin/DGT. This
Anniversary Edition of the Revelation II, features an updated hardware relative
to the ordinary Revelation II. The hardware for the Anniversary Edition is an 
Colibri iMX7D with 2 ARM Cortex A7 processors running at 1GHz. The software which 
we have used for the testing is the program Komodo 12.1 by Mark Lefler and
Larry Kaufman. 
The rating that has been reached after the first 100 games is 3177! This is a 
rating that is 253 points ahead of Hiarcs 14.1, which we tested formerly
on the ordinary Revelation II. It is clearly the strongest dedicated chess 
computer which we have tested so far and it has been able to perform admirably 
against the strong Q6600 opposition which it mostly has faced in our testing 
so far. 

Aside from producing more games with the already mentioned newcomers in the
rating list, we are at the moment testing Richard Pijl's - The Baron 3.45, 
and also Alex Morozov's - Booot 7.1. We also hope to have some more programs
ready for the next rating list.  

* This rating list was produced and based on the games/results that were finished 
on the first of May, but the publication of this rating list was unfortunately a 
bit delayed this time.
The testing has of course not stood still since then, and the games/results 
that has been played since this date will of course feature in the next rating 
list, which we plan to have out sometime in august/september.

Lars Sandin
Lars Sandin, SSDF
User avatar
Lars Sandin
SSDF
Posts: 2234
Joined: Sun Nov 18, 2007 4:24 pm
Location: Sundsvall, Sweden

SSDF Rating list 2023-12-31

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2023-12-31    164540 games played by  440 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Lc0 0.29.0 Cuda-808544 3060Ti           3586   30   -28   600   63%  3493
   2 Stockfish 16 x64 1800X 3.6 GHz          3582   50   -48   200   58%  3523
   3 Stockfish 15 x64 1800X 3.6 GHz          3573   37   -35   400   65%  3466
   4 Dragon Komodo 3 x64 1800X 3.6 GHz       3569   36   -34   400   60%  3498
   5 Lc0 0.28.2 Cuda-611213 3060Ti           3569   26   -25   780   66%  3457
   6 Lc0 0.26.3 Cuda(67362) 3060Ti           3569   29   -27   680   68%  3441
   7 Stockfish 13 x64 1800X 3.6 GHz          3569   35   -32   480   69%  3431
   8 Dragon Komodo 3.3 x64 1800X 3.6 GHz     3568   46   -43   248   60%  3492
   9 Dragon Komodo 2.51 x64 1800X 3.6 GHz    3562   39   -36   360   63%  3468
  10 Stockfish 14 x64 1800X 3.6 GHz          3556   37   -35   400   65%  3451
  11 Rebel 16.2 x64 1800X 3.6 GHz            3547   39   -38   320   53%  3526
  12 Stockfish 12 NNUE x64 1800X 3.6 GHz     3547   25   -25   768   59%  3481
  13 Dragon by Komodo x64 1800X 3.6 GHz      3536   34   -32   460   63%  3442
  14 Stockfish 11 x64 1800X 3.6 GHz          3529   36   -34   450   70%  3384
  15 Arasan 23.4 x64 1800X 3.6 GHz           3523   44   -45   240   46%  3541
  16 Dragon Komodo 3.1 MCTS 1800X 3.6 GHz    3514   31   -30   520   58%  3457
  17 Stockfish 10 x64 1800X 3.6 GHz          3502   25   -23   920   67%  3378
  18 Booot 7.1 x64 1800X 3.6 GHz             3484   48   -50   200   42%  3536
  19 Dragon Komodo 2 MCTS x64 1800X 3.6 GHz  3484   41   -41   280   53%  3459
  20 Booot 7 x64 1800X 3.6 GHz               3475   39   -40   300   46%  3508
  21 Arasan 23.01 x64 1800X 3.6 GHz          3449   33   -34   420   48%  3461
  22 Arasan 23.4 x64 Q6600 2.4 GHz           3444   38   -35   400   69%  3306
  23 Wasp 6.5 x64 1800X 3.6 GHz              3442   31   -31   480   51%  3433
  24 Pedone 3.1 x64 1800X 3.6 GHz            3430   38   -39   320   45%  3468
  25 Booot 6.5 x64 1800X 3.6 GHz             3424   34   -34   400   48%  3435
  26 Wasp 5.5 x64 1800X 3.6 GHz              3383   37   -39   360   36%  3480
  27 Marvin 6.0.0 x64 1800X 3.6 GHz          3357   35   -38   420   31%  3495
  28 Pedone 3.1 x64 Q6600 2.4 GHZ            3356   38   -37   340   58%  3302
  29 Deep Shredder 13 x64 1800X 3.6 GHz      3346   24   -23   920   62%  3260
  30 Chiron 5.01 x64 1800X 3.6 GHz           3345   32   -34   480   33%  3464
  31 Chiron 5.01 x64 Q6600 2.4 GHz           3315   34   -34   400   52%  3302
  32 Revelation 2 A.E. Komodo 12.1 A7 1 GHz  3176   73   -68   100   59%  3112
  33 The Baron 3.45 x64 1800X 3.6 GHz        3081   58   -71   160   24%  3280
  34 The Baron 3.43 x64 1800X 3.6 GHz        3076   29   -31   680   26%  3259
  35 The Baron 3.45 x64 Q6600 2.4 GHz        3053   36   -37   360   45%  3086
  36 The Baron 3.43 x64 Q6600 2.4 GHz        3018   32   -32   460   49%  3022
  37 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2924   47   -45   228   56%  2880
  38 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2855   23   -25   972   30%  3006
  39 Revelation Hiarcs 13.3 PXA255 500 MHz   2772   57   -52   177   66%  2660
  40 Revelation Shredder 12 PXA255 500 MHz   2706   60   -58   140   56%  2666
  41 Revelation Rybka 2.2 PXA255 500 MHz     2635   45   -43   260   63%  2546
  42 Revelation Deep Sjeng 3 PXA255 500 MHz  2600   62   -67   120   41%  2665
  43 Millennium The King Exclusive 300 MHz   2534   49   -48   200   55%  2501
  44 Revelation Ruffian 2.1 PXA255 500 MHz   2347   68   -71   100   45%  2385
  45 Millennium ChessGenius Excl. M7 300 MHz 2249   50   -48   204   58%  2193
  46 Mephisto London 68030 33 MHz            2195   31   -31   482   50%  2192
  47 Millennium ChessGenius Pro M4 120 MHz   2163   59   -54   160   63%  2067
  48 Mephisto London 68020 12 MHz            2089   60   -53   171   68%  1957
  49 Millennium ChessGenius ARM M4 48 MHz    2070   45   -43   251   58%  2016
  50 Mephisto Roma II 68000 10 MHz           1898   63   -59   132   58%  1843

 2 Stockfish 16 x64 1800X 3.6 GHz. 3582											
Lc029 3060Ti      20-20    Dra33 1800X       20-20    Dra251 1800X      21-19
Boo71 1800X       26-14    Stock8 1800X      28-12    

 8 Dragon Komodo 3.3 x64 1800X 3.6 GHz. 3568											
Lc029 3060Ti    19.5-20.5  Stoc16 1800X      20-20    Reb162 1800X      21-19
SF12NU 1800X       4-4     Aras234 1800X     24-16    Mar60 1800X     30.5-9.5 
Chi5 1800X      30.5-9.5   

 18 Booot 7.1 x64 1800X 3.6 GHz. 3484											
Lc029 3060Ti    16.5-23.5  Stoc16 1800X      14-26    Reb162 1800X      14-26
Aras234 1800X   19.5-20.5  Wasp65 1800X    20.5-19.5  

 33 The Baron 3.45 x64 1800X 3.6 GHz. 3081											
Komo11 1800X       7-33    Mar51 1800X      7.5-32.5  Ped21 1800X        9-31
Wasp201 1800X     15-25    

 35 The Baron 3.45 x64 Q6600 2.4 GHz. 3053											
Stockf3 Q6600     12-28    DRybka4 Q6600      5-35    DRybka3 Q6600    9.5-30.5
DHiar14 Q6600   15.5-24.5  Chiro3 Q6600    10.5-29.5  Craf25 Q6600      34-26
Arasa16 Q6600   44.5-15.5  King3.5 Q6600     31-9     

This last rating list of 2023 consists of five new entrants. First one out 
is the latest version from Team Stockfish, named Stockfish 16. We have as usual 
used an opening book from Fauzi Dabat for the testing, and this one is called:
"Aggressive 5.6 by fauzi.abk". It's of course still early on in the testing, but 
Stockfish 16 has reached the very strong rating of 3582 after the first 200 
games and have taken over the second place in the rating list.
 
Even though the earlier Stockfish 15 gained 3 points since the last list, 
Stockfish 16 now has a gap of 9 rating points ahead of its former version. 
As Lc0 lost a considerable amount of points since the last rating list, the 
gap between Stockfish and Lc0 have now gone from 40 to just 4 points. It will 
surely be exciting to see how the rating will continue to fluctuate 
in the top of the list as more games will be played with all the top programs.

As incidentally mentioned, Lc0 wasn't able to keep up with its strong start 
in the last rating list and with more than 300 games added since last time,
its rating has been lowered with 24 points. Lc0 still holds the number one 
spot in the list, but now with a much smaller gap to its nearest competitor - 
Stockfish.

Our second newcomer on the list are Mark Lefler's and Larry Kaufmans's - Dragon
Komodo 3.3. It's extremely congested in the top at the moment and even though
Dragon Komodo has made a good impression in its first 248 games, it is at the 
moment only placed eigth in the list, with the rating of 3568. This is one
point behind Dragon Komodo 3, but also just five points behind Stockfish 15 in
third place, so more games will be needed to find out how it will fare in the 
absolute top of the rating list.  As opening book for Dragon Komodo 3.3, we have 
used Erdogan Günes's opening book: "Out10-35.bin". 

Third one out is Alex Morozov's - Booot 7.1, which after the first 200 games
have reached a rating of 3484, which is 9 points ahead of the 7.0 version. 
As opening book for Booot 7.1, we have used Sedat Canbaz's: "Perfect2021.abk".

Last but not least are Richard Pijl's - The Baron 3.45, which we have tested
on both our hardware platforms. As opening book we have used The Baron's own
opening book. On our 1800X hardware, The Baron 3.45 has reached a rating 
of 3081 after the first 160 games. This is at the moment 4 points ahead of 
the 3.43 version which we had tested earlier. On our Q6600 hardware, 
The Baron 3.45 has recieved a rating of 3053 after 360 games played.
This is 35 points ahead of the 3.43 version on the Q6600 hardware, so more 
games will be needed on the 1800X hardware to see if the smaller margin there
will get bigger as more games are played. 

Hope that you all have had a merry Christmas and a happy New Year

Lars Sandin
Lars Sandin, SSDF
Post Reply