SSDF Rating list - Last Updated 31st of December 2023

Designed for posting all types of tournaments and Games (e.g. Man vs. Machine, Computer vs. Computer and basement matches.)

Moderators: Harvey Williamson, Watchman

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
User avatar
Lars Sandin
SSDF
Posts: 2234
Joined: Sun Nov 18, 2007 4:24 pm
Location: Sundsvall, Sweden

THE SSDF RATING LIST 2018-10-16

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2018-10-16    146423 games played by  371 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Stockfish 9 x64 1800X 3.6 GHz           3502   38   -35   482   76%  3302
   2 Stockfish 8 x64 1800X 3.6 GHz           3430   30   -27   860   79%  3203
   3 Stockfish 8 x64 Q6600 2.4 GHz           3416   47   -43   280   70%  3269
   4 Komodo 11.01 x64 1800X 3.6 GHz          3395   26   -24   974   75%  3208
   5 Deep Shredder 13 x64 1800X 3.6 GHz      3367   30   -28   640   68%  3238
   6 Booot 6.3.1 x64 1800X 3.6 GHz           3347   40   -38   320   60%  3273
   7 Komodo 9.1 x64 Q6600 2.4 GHz            3342   21   -20  1395   73%  3167
   8 Komodo 11.01 x64 Q6600 2.4 GHz          3340   35   -34   402   60%  3269
   9 Stockfish 6 x64 Q6600 2.4 GHz           3330   22   -21  1176   69%  3190
  10 Deep Shredder 13 x64 Q6600 2.4 GHz      3296   24   -23   884   64%  3193
  11 Komodo 7 x64 Q6600 2.4 GHz              3269   24   -23   934   65%  3159
  12 Komodo 5.1 x64 Q6600 2.4 GHz            3246   22   -22  1038   64%  3145
  13 Deep Hiarcs 14 1800X 3.6 GHz            3211   30   -31   520   41%  3270
  14 Stockfish 3 x64 Q6600 2.4 GHz           3202   19   -19  1380   61%  3125
  15 Deep Rybka 4 x64 Q6600 2.4 GHz          3201   21   -20  1288   67%  3080
  16 Deep Rybka 3 x64 Q6600 2.4 GHz          3194   22   -21  1371   75%  3002
  17 Deep Hiarcs 14 Q6600 2.4 GHz            3188   19   -18  1450   61%  3113
  18 Chiron 3.01 x64 Q6600 2.4 GHz           3182   27   -28   616   45%  3217
  19 Wasp 2.01 x64 1800X 3.6 GHz             3161   28   -29   646   35%  3270
  20 Naum 4.2 x64 Q6600 2.4 GHz              3146   21   -21  1123   60%  3078
  21 Deep Junior Yokohama x64 Q6600 2.4 GHz  3125   22   -23   930   43%  3170
  22 Naum 4 x64 Q6600 2.4 GHz                3120   19   -18  1436   61%  3039
  23 Deep Junior 13.3 x64 Q6600 2.4 GHz      3117   19   -19  1290   50%  3119
  24 The Baron 3.43 x64 1800X 3.6 GHz        3115   39   -42   320   35%  3222
  25 Spike 1.4 Q6600 2.4 GHz                 3109   16   -16  1911   53%  3090
  26 Deep Shredder 12 x64 Q6600 2.4 GHz      3104   18   -18  1507   62%  3016
  27 Hiarcs 14 Athlon 1.2 GHz                3100   33   -31   480   62%  3018
  28 Hiarcs 13.1 Q6600 2.4 GHz               3099   24   -23   868   56%  3055
  29 Deep Hiarcs 13.2 Q6600 2.4 GHz          3098   23   -23   872   55%  3061
  30 Deep Fritz 13 Q6600 2.4 GHz             3097   24   -24   826   55%  3064
  31 Wasp 2.01 x64 Q6600 2.4 GHz             3062   42   -50   362   19%  3312
  32 Crafty 25 x64 Q6600 2.4 GHz             3028   25   -26   804   35%  3135
  33 The Baron 3.43 x64 Q6600 2.4 GHz        3026   34   -34   400   50%  3022
  34 Arasan 17.2 x64 Q6600 2.4 GHz           3000   26   -26   686   46%  3029
  35 Naum 4 Athlon 1.2 GHz                   2996   23   -24   876   40%  3066
  36 Fritz 13 Athlon 1.2 GHz                 2992   45   -41   280   65%  2881
  37 Shredder 12 Athlon 1.2 GHz              2982   25   -27   760   35%  3089
  38 Wasp 2.01 Athlon 1.2 GHz                2960   32   -31   480   55%  2924
  39 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2923   47   -46   220   55%  2889
  40 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2861   24   -25   932   30%  3010
  41 Pro Deo 2.1 YAT Athlon 1.2 GHz          2826   32   -31   480   57%  2780
  42 Revelation Hiarcs 13.3 PXA255 500 MHz   2772   57   -52   177   66%  2660
  43 Revelation Shredder 12 PXA255 500 MHz   2703   60   -58   140   56%  2663
  44 Revelation Rybka 2.2 PXA255 500 MHz     2628   47   -44   240   62%  2545
  45 Revelation Deep Sjeng 3 PXA255 500 MHz  2599   68   -76   100   37%  2691
  46 ChessGenius 3 ZTE Apex3 ARM A53 1.3 GHz 2458   75   -68   100   62%  2375
  47 Revelation Ruffian 2.1 PXA255 500 MHz   2351   68   -71   100   45%  2392
  48 TASC R30 v. 2.5 ARM6 30 MHz             2273   42   -38   343   69%  2136
  49 Millenium ChessGenius Pro M4 120 MHz    2179   72   -63   120   68%  2051
  50 Millenium ChessGenius ARM M4 48 MHz     2087   57   -53   169   62%  2001

 1 Stockfish 9 x64 1800X 3.6 GHz, 3502											
Stock8 1800X    21,5-18,5  Stock8 Q6600    26,5-13,5  Komo11 1800X      25-15
DShre13 1800X     27-13    Booot6 1800X      28-12    Komo9.1 Q6600     34-8 
Komo11 Q6600    28,5-11,5  Stockf6 Q6600     33-7     Komo7.0 Q6600   32,5-7,5 
Wasp201 1800X     35-5     Baro343 1800X   37,5-2,5   Spike14 Q6600     37-3 

 3 Stockfish 8 x64 Q6600 2.4 GHz, 3416											
Stock9 1800X    13,5-26,5  Booot6 1800X    27,5-12,5  Komo9.1 Q6600   28,5-11,5
Komo11 Q6600    21,5-18,5  Stockf6 Q6600   28,5-11,5  Baro343 Q6600   37,5-2,5 
Glaurung Q660     39-1     
 
 6 Booot 6.3.1 x64 1800X 3.6 GHz, 3347											
Stock9 1800X      12-28    Stock8 Q6600    12,5-27,5  Komo9.1 Q6600     19-21
Stockf6 Q6600   19,5-20,5  DHiar14 1800X   29,5-10,5  Wasp201 1800X   32,5-7,5 
Baro343 1800X     35-5     Spike14 Q6600   32,5-7,5   

 24 The Baron 3.43 x64 1800X 3.6 GHz, 3115											
Stock9 1800X     2,5-37,5  Komo11 1800X       7-33    Booot6 1800X       5-35
Stockf6 Q6600      3-37    Wasp201 1800X   16,5-23,5  Spike14 Q6600     19-21
Zap!Mx2 Q6600     24-16    King3.5 Q6600     35-5     

 33 The Baron 3.43 x64 Q6600 2.4 GHz, 3026											
Stock8 Q6600     2,5-37,5  DShre13 Q6600    5,5-34,5  Hiarc14 A1200   17,5-22,5
Hia13.2 Q6600     12-28    DShre11 Q6600   18,5-21,5  Naum 4  A1200     24-16
DFritz8 Q6600   24,5-15,5  Junio10 A1200   32,5-7,5   PDeo21 A1200    26,5-13,5
Hiarcs9 A1200     38-2     

For this October Rating list we can present five new Chess Computer programs.
First out is Stockfish 9 by Tord Romstad, Marco Costalba and Joona Kiiski. For
the testing of this program, we have used the updated free opening book from 
Fauzi Dabat, called "Aggressive 3.5 by Fauzi.abk". As you can see from the 
Rating list, this very strong combo has managed to break the 3500-barrier for 
the first time in our Rating list! The rating of 3502 after 482 played games
is a whopping 72 point stronger than it's former version which we introduced 
in the list back in January this year. 

The next new version we have in this list, is the Stockfish 8, which 
we now have enough games with on our older Q6600-platform. After 280 played 
games it has reached a very strong rating of 3416, trailing it's 8-sibling on 
our fastest 1800X-hardware by only 14 points! More games will be needed to 
see if this difference will hold steady. We have of course used the same 
opening book for the testing of Stockfish 8 Q6600, as we have used when we
tested Stockfish 8 on the 1800X, that is the "Aggressive 3.2 by Fauzi.abk".

The next new entrant was one of the contenders in the ICGA World Chess
Championship, which was held here in Sweden/Stockholm in July this year. 
This program is called Booot 6.3.1, is made by Alex Morozov and 
became runner-up behind Komodo in the Unified Hardware category of the 
Championship! Its rating of 3347 after 320 games are indeed very strong and
especially considering it hasn't support for Endgame Tablebases like the 
other programs which we have tested on our Ryzen 1800X-hardware.
Alex wanted us to use the same book in our testing, as he used in the 
championship, that is the free "perfect2017.abk" opening book by Sedat Canbaz. 

The last entrant on our ratinglist was also a contender in the ICGA
Championship, and it is Richard Pijl's - The Baron. On our fastest hardware - 
the 1800X, The Baron 3.43 has reached a rating of 3115 after 320 games. 
We have also tested it on our Q6600-hardware and there it has reached a 
rating of 3026 after 400 played games.

It uses its own opening book and tablebases on our Q6600 and 1800X machines,
but has had some tablebase issues with 5 piece Endgame Tablebases like the 
standard we have on our Q6600 machines. This has affected its performance  
somewhat. According to Richard, this issue is corrected for future releases 
of The Baron, so we hope to be able to test an updated version in an upcoming
Rating list. This issue hasn't affected the testing on the 1800X-machines, as
it hasn't any issues with the 6 piece Endgame Tablebases we have as standard 
on this hardware.

Compared to our former Rating list, Komodo 11.01 Q6600 gained 7 points, Pro
Deo 2.1 YAT A1200 gained 6, while Spike 1.4 Q6600 and the Android version
of Chess Genius 3 gained 4 points. Komodo 9.1 Q6600 lost 10 points, Wasp 2.01
on the A1200 lost 8, Revelation Ruffian lost 6 and Hiarcs 14 A1200 lost 5 
points. 

We have begun testing of John Stanback's latest Wasp version for our next 
Rating list, and we hope to also begin testing of a more recent version of 
both the ordinary Komodo and its Monte Carlo Tree Search (MCTS) version. 
We will also hopefully be able to add both Stockfish 9 and Booot to our 
testing on the Q6600 hardware level. 

The next list will be out approximately in December/January depending 
on how many new games we will have until then. 
 
Lars Sandin 
Lars Sandin, SSDF
User avatar
Lars Sandin
SSDF
Posts: 2234
Joined: Sun Nov 18, 2007 4:24 pm
Location: Sundsvall, Sweden

The SSDF RATING LIST 2019-02-28

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2019-02-28    148673 games played by  377 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Stockfish 9 x64 1800X 3.6 GHz           3494   32   -30   642   74%  3308
   2 Komodo 12.3 x64 1800X 3.6 GHz           3456   30   -28   640   68%  3321
   3 Stockfish 9 x64 Q6600 2.4 GHz           3446   50   -48   200   57%  3396
   4 Stockfish 8 x64 1800X 3.6 GHz           3432   26   -24  1059   77%  3217
   5 Stockfish 8 x64 Q6600 2.4 GHz           3418   38   -35   440   72%  3251
   6 Komodo 11.01 x64 1800X 3.6 GHz          3397   23   -22  1134   72%  3229
   7 Deep Shredder 13 x64 1800X 3.6 GHz      3360   25   -24   830   66%  3246
   8 Booot 6.3.1 x64 1800X 3.6 GHz           3352   29   -29   560   54%  3319
   9 Komodo 9.1 x64 Q6600 2.4 GHz            3340   21   -20  1435   72%  3175
  10 Komodo 11.01 x64 Q6600 2.4 GHz          3333   32   -31   482   55%  3300
  11 Stockfish 6 x64 Q6600 2.4 GHz           3326   22   -21  1216   68%  3192
  12 Deep Shredder 13 x64 Q6600 2.4 GHz      3296   24   -23   884   64%  3193
  13 Booot 6.3.1 x64 Q6600 2.4 GHz           3280   41   -39   320   64%  3179
  14 Komodo 7 x64 Q6600 2.4 GHz              3270   23   -23   974   65%  3160
  15 Arasan 21.2 x64 1800X 3.6 GHz           3269   61   -68   127   35%  3375
  16 Komodo 5.1 x64 Q6600 2.4 GHz            3245   22   -22  1038   64%  3145
  17 Deep Hiarcs 14 1800X 3.6 GHz            3219   26   -27   680   41%  3280
  18 Wasp 3 x64 1800X 3.6 GHz                3218   27   -28   642   43%  3266
  19 Stockfish 3 x64 Q6600 2.4 GHz           3203   19   -18  1420   61%  3127
  20 Deep Rybka 4 x64 Q6600 2.4 GHz          3201   21   -20  1288   67%  3080
  21 Deep Rybka 3 x64 Q6600 2.4 GHz          3194   22   -21  1371   75%  3003
  22 Deep Hiarcs 14 Q6600 2.4 GHz            3189   19   -18  1450   61%  3112
  23 Chiron 3.01 x64 Q6600 2.4 GHz           3180   27   -27   656   45%  3217
  24 Wasp 2.01 x64 1800X 3.6 GHz             3159   26   -28   726   34%  3276
  25 Naum 4.2 x64 Q6600 2.4 GHz              3146   21   -21  1123   60%  3078
  26 Deep Junior Yokohama x64 Q6600 2.4 GHz  3126   22   -22  1010   42%  3184
  27 Naum 4 x64 Q6600 2.4 GHz                3121   19   -18  1436   61%  3040
  28 Deep Junior 13.3 x64 Q6600 2.4 GHz      3116   19   -19  1290   50%  3119
  29 Spike 1.4 Q6600 2.4 GHz                 3108   15   -15  1951   52%  3092
  30 Deep Shredder 12 x64 Q6600 2.4 GHz      3104   18   -18  1507   62%  3016
  31 Hiarcs 14 Athlon 1.2 GHz                3100   29   -29   560   55%  3065
  32 Deep Fritz 13 Q6600 2.4 GHz             3097   24   -24   826   55%  3064
  33 The Baron 3.43 x64 1800X 3.6 GHz        3095   32   -35   538   27%  3265
  34 Deep Rybka 3 Athlon 1.2 GHz             3071   36   -35   372   53%  3048
  35 Wasp 2.01 x64 Q6600 2.4 GHz             3065   40   -46   404   20%  3302
  36 Crafty 25 x64 Q6600 2.4 GHz             3028   25   -26   804   35%  3134
  37 The Baron 3.43 x64 Q6600 2.4 GHz        3023   33   -33   440   51%  3019
  38 Arasan 17.2 x64 Q6600 2.4 GHz           3000   26   -26   686   46%  3029
  39 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2924   47   -46   220   55%  2889
  40 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2861   24   -25   932   30%  3009
  41 Revelation Hiarcs 13.3 PXA255 500 MHz   2772   57   -52   177   66%  2661
  42 Revelation Shredder 12 PXA255 500 MHz   2703   60   -58   140   56%  2663
  43 Revelation Rybka 2.2 PXA255 500 MHz     2628   47   -44   240   62%  2545
  44 Revelation Deep Sjeng 3 PXA255 500 MHz  2599   68   -76   100   37%  2692
  45 ChessGenius 3 ZTE Apex3 ARM A53 1.3 GHz 2457   75   -68   100   62%  2376
  46 Revelation Ruffian 2.1 PXA255 500 MHz   2353   68   -71   100   45%  2390
  47 TASC R30 v. 2.5 ARM6 30 MHz             2273   42   -38   343   69%  2136
  48 Millenium ChessGenius Pro M4 120 MHz    2176   67   -59   140   68%  2048
  49 Millenium ChessGenius ARM M4 48 MHz     2078   51   -47   210   62%  1990
  50 Mephisto London 68000 12 MHz            2035   69   -70   100   49%  2043

 2 Komodo 12.3 x64 1800X 3.6 GHz, 3456											
Stock9 1800X    18,5-21,5  Stock9 Q6600      20-20    Stock8 1800X    22,5-17,5
Stock8 Q6600      20-20    Komo11 1800X      22-18    DShre13 1800X     28-12
Booot6 1800X      24-16    Komo9.1 Q6600     27-13    Komo11 Q6600    56,5-23,5
Booot6 Q6600      31-9     Arasa21 1800X   30,5-9,5   DHiar14 1800X   34,5-5,5 
Wasp3 1800X     30,5-9,5   Wasp201 1800X     35-5     Baro343 1800X   36,5-3,5 

 3 Stockfish 9 x64 Q6600 2.4 GHz, 3446											
Stock9 1800X    16,5-23,5  Komo12 1800X      20-20    Komo11 1800X    21,5-18,5
Booot6 1800X    26,5-13,5  Booot6 Q6600    29,5-10,5  

 13 Booot 6.3.1 x64 Q6600 2.4 GHz, 3280											
Komo12 1800X       9-31    Stock9 Q6600    10,5-29,5  Stockf6 Q6600   20,5-19,5
DjunYok Q6600   27,5-12,5  Hiarc14 A1200     33-7     DRybka3 A1200   34,5-5,5 
Shred12 A1200     35-5     Rybk231 A1200   35,5-4,5   

 15 Arasan 21.2 x64 1800X 3.6 GHz, 3269											
Komo12 1800X     9,5-30,5  Stock8 1800X     7,5-31,5  DShre13 1800X   11,5-18,5
Baro343 1800X   15,5-2,5   

 18 Wasp 3 x64 1800X 3.6 GHz, 3218											
Stock9 1800X     6,5-33,5  Komo12 1800X     9,5-30,5  Stock8 1800X     5,5-34,5
Stock8 Q6600     7,5-32,5  Komo11 1800X     6,5-33,5  DShre13 1800X   14,5-25,5
Booot6 1800X      11-29    Komo7.0 Q6600   13,5-26,5  DHiar14 1800X   19,5-20,5
Stockf3 Q6600   17,5-22,5  Chiro3 Q6600      23-17    Wasp201 1800X     25-15
Spike14 Q6600     27-13    Baro343 1800X   29,5-10,5  Zap!Mx2 Q6600   30,5-9,5 
Wasp201 Q6600     29-13    

 50 Mephisto London 68000 12 MHz, 2035											
MCG Pro          6,5-13,5  MCG               10-10    Star Sapphire    6,5-13,5
Milano Pro      12,5-7,5   Nigel Short       13-7     

On our latest February rating list we can present six new Chess Computer 
programs. First out is the winner of all three classes at the ICGA World
Championship that was played in Stockholm/Sweden last summer - namely Komodo.
Komodo is written by Mark Lefler, Larry Kaufman and the late Don Dailey.
The version we have tested is named Komodo 12.3 and it has achieved a very 
strong rating of 3456 after 640 games played on our 1800X hardware level. This
is 59 points stronger than the 11.01 version we tested last time. We have used
Komodo's opening book by Erdogan Guenes for the testing.

The next new version we have on this list is Stockfish 9, which now have 
sufficient amount of games on our Q6600-hardware level. After the 
first 200 games it has reached the rating of 3446. This is 28 points stronger
than Stockfish 8 on the same platform, and is 48 points lower than the same
version on our 1800X hardware. We have of course used the same opening book 
as we previously used on our 1800X hardware, when we tested Stockfish 9; that
is the free "Aggressive 3.5 by Fauzi.abk" opening book by Fauzi Dabat.

We have also got enough games with Booot 6.3.1 on our Q6600 hardware to be
able to introduce it on the list. The rating is 3280 after the first 320 games.
This is 72 points lower than the 1800X version which we introduced on the
last rating list.

Just in time for this rating list, we could also present an early rating of 
the latest Arasan program by Jon Dart. We have tested it on our 1800X hardware,
with it's own included opening book and it has reached a rating of 3269 after 
the first 127 games. More games will be needed to get a more reliable rating, 
but the rating of 3269 is still 269 points stronger than the last Arasan
version we have tested! Even though some of the difference are due to 
the fact that we tested the 17.2 version on our Q6600-hardware, the 
performance gain from improvements made in the software is impressive.

Next out is the Wasp 3.0 program by John Stanback. We have played 642 games
with Wasp 3.0 on our 1800X hardware, and it has reached the rating of 3218. 
This is 59 points stronger than the 2.01 version which we introduced in our
rating list in January 2018. We have used the free opening book by Sedat
Canbaz, called "Perfect2017.abk" for the testing of Wasp 3.0. 

Last out in this rating list is the manually tested "oldie" - the dedicated
Mephisto London 68000 chess computer. This is a computer which we never got
to test back in the days, but now are able to finally introduce in the 
rating list, 23 years after it was introduced back in 1996! 
The Mephisto London is the program of Richard Lang and uses the module 
hardware for the old Modular/Exclusive/München boards. It features an 
Motorola 68000 processor at 12 MHz and uses 512 kB RAM for hash-tables.
The rating after the first 100 games is 2035 and this is 18 points stronger
than the Berlin 68000, which previously was the strongest Lang program on 
the 68000 hardware in our rating list.

Compared to the last rating list, Deep Hiarcs 14 1800X gained 8 points and
Novag Star Sapphire gained 6 points. Meanwhile The Baron 3.43 1800X lost 
20 points, Millenium ChessGenius lost 9 points and Stockfish 9 1800X lost 
8 points. 

For our next list we will focus on getting more games with Komodo 12.3 on 
our Q6600 hardware and also Arasan 21.2 on both the 1800X and Q6600 level. 
We will also begin testing of Stockfish 10, Wasp 3.5 and hopefully also 
the Monte Carlo Tree Search (MCTS) version of Komodo. 
We are also manually testing both the Millenium ChessGenius Exclusive and 
the latest Millenium The King Exclusive now.

Our next rating list will probably be out before summer. 
           
Lars Sandin
Lars Sandin, SSDF
User avatar
Lars Sandin
SSDF
Posts: 2234
Joined: Sun Nov 18, 2007 4:24 pm
Location: Sundsvall, Sweden

THE SSDF RATING LIST 2019-07-08

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2019-07-08    150612 games played by  384 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Stockfish 10 x64 1800X 3.6 GHz          3529   33   -31   577   72%  3365
   2 Stockfish 9 x64 1800X 3.6 GHz           3493   30   -28   722   73%  3315
   3 Komodo 13.02 x64 1800X 3.6 GHz          3482   52   -48   200   61%  3402
   4 Komodo 12.3 x64 1800X 3.6 GHz           3454   28   -26   720   67%  3328
   5 Stockfish 9 x64 Q6600 2.4 GHz           3445   34   -33   431   57%  3399
   6 Komodo 12.3 x64 Q6600 2.4 GHz           3443   43   -41   280   59%  3382
   7 Stockfish 8 x64 1800X 3.6 GHz           3432   26   -24  1100   77%  3217
   8 Komodo 13.02 MCTS x64 1800X 3.6 GHz     3424   51   -48   205   62%  3334
   9 Stockfish 8 x64 Q6600 2.4 GHz           3413   35   -33   480   69%  3274
  10 Komodo 11.01 x64 1800X 3.6 GHz          3394   22   -21  1214   71%  3240
  11 Deep Shredder 13 x64 1800X 3.6 GHz      3358   25   -24   840   65%  3246
  12 Booot 6.3.1 x64 1800X 3.6 GHz           3357   24   -24   795   52%  3341
  13 Komodo 9.1 x64 Q6600 2.4 GHz            3339   20   -19  1475   72%  3177
  14 Komodo 11.01 x64 Q6600 2.4 GHz          3333   30   -30   524   52%  3316
  15 Stockfish 6 x64 Q6600 2.4 GHz           3327   21   -20  1256   69%  3191
  16 Deep Shredder 13 x64 Q6600 2.4 GHz      3296   24   -23   884   64%  3193
  17 Booot 6.3.1 x64 Q6600 2.4 GHz           3288   36   -34   400   60%  3219
  18 Arasan 21.2 x64 1800X 3.6 GHz           3280   31   -32   480   42%  3333
  19 Komodo 7 x64 Q6600 2.4 GHz              3270   23   -23   974   65%  3160
  20 Arasan 21.2 x64 Q6600 2.4 GHz           3250   55   -58   152   43%  3290
  21 Komodo 5.1 x64 Q6600 2.4 GHz            3245   22   -22  1038   64%  3145
  22 Wasp 3.5 x64 1800X 3.6 GHz              3235   32   -34   480   34%  3351
  23 Deep Hiarcs 14 1800X 3.6 GHz            3217   26   -27   680   41%  3279
  24 Wasp 3 x64 1800X 3.6 GHz                3213   24   -25   802   40%  3285
  25 Stockfish 3 x64 Q6600 2.4 GHz           3203   19   -18  1420   61%  3127
  26 Deep Rybka 4 x64 Q6600 2.4 GHz          3199   20   -19  1328   65%  3091
  27 Deep Rybka 3 x64 Q6600 2.4 GHz          3194   22   -21  1371   75%  3003
  28 Deep Hiarcs 14 Q6600 2.4 GHz            3188   19   -18  1450   61%  3112
  29 Chiron 3.01 x64 Q6600 2.4 GHz           3180   27   -27   656   45%  3215
  30 Wasp 3.5 x64 Q6600 2.4 GHz              3174   64   -68   112   43%  3226
  31 Wasp 2.01 x64 1800X 3.6 GHz             3156   24   -26   846   33%  3280
  32 Naum 4.2 x64 Q6600 2.4 GHz              3147   21   -21  1123   60%  3078
  33 Deep Junior Yokohama x64 Q6600 2.4 GHz  3126   22   -22  1010   42%  3184
  34 Hiarcs 14 Athlon 1.2 GHz                3100   29   -29   560   55%  3065
  35 Deep Fritz 13 Q6600 2.4 GHz             3097   24   -24   826   55%  3064
  36 The Baron 3.43 x64 1800X 3.6 GHz        3088   30   -33   600   27%  3263
  37 Wasp 2.01 x64 Q6600 2.4 GHz             3065   40   -46   404   20%  3301
  38 Arasan 17.2 x64 Q6600 2.4 GHz           3001   26   -26   686   46%  3029
  39 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2924   47   -46   220   55%  2889
  40 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2860   24   -25   932   30%  3009
  41 Revelation Hiarcs 13.3 PXA255 500 MHz   2772   57   -52   177   66%  2661
  42 Revelation Shredder 12 PXA255 500 MHz   2703   60   -58   140   56%  2663
  43 Revelation Rybka 2.2 PXA255 500 MHz     2628   47   -44   240   62%  2545
  44 Revelation Deep Sjeng 3 PXA255 500 MHz  2599   68   -76   100   37%  2691
  45 ChessGenius 3 ZTE Apex3 ARM A53 1.3 GHz 2457   75   -68   100   62%  2376
  46 Revelation Ruffian 2.1 PXA255 500 MHz   2352   68   -71   100   45%  2391
  47 TASC R30 v. 2.5 ARM6 30 MHz             2274   42   -38   343   69%  2137
  48 Millenium ChessGenius Pro M4 120 MHz    2175   67   -59   140   68%  2045
  49 Millenium ChessGenius ARM M4 48 MHz     2079   51   -47   211   63%  1987
  50 Mephisto London 68000 12 MHz            2012   62   -61   128   52%  1996

 1 Stockfish 10 x64 1800X 3.6 GHz, 3529											
Stock9 1800X      22-18    Ko13 1800X      22,5-17,5  Komo12 1800X    24,5-15,5
Stock9 Q6600      26-14    Komo12 Q6600    24,5-15,5  Ko13MC 1800X       9-8 
Stock8 Q6600    26,5-13,5  Komo11 1800X    28,5-11,5  Booot6 1800X      30-10
Komo11 Q6600    30,5-9,5   Booot6 Q6600      32-8     Arasa21 1800X     35-5 
Arasa21 Q6600     36-4     Was35 1800X       35-5     Wasp3 1800X       35-5 

 3 Komodo 13.02 x64 1800X 3.6 GHz, 3482											
Stoc10 1800X    17,5-22,5  Stock9 Q6600    22,5-17,5  Komo12 Q6600    22,5-17,5
Booot6 1800X      27-13    Was35 1800X       33-7     

 5 Stockfish 9 x64 Q6600 2.4 GHz, 3445											
Stoc10 1800X      14-26    Stock9 1800X    16,5-23,5  Ko13 1800X      17,5-22,5
Komo12 1800X      20-20    Komo12 Q6600      20-20    Ko13MC 1800X      16-15
Komo11 1800X    21,5-18,5  Booot6 1800X    26,5-13,5  Booot6 Q6600    29,5-10,5
Arasa21 1800X   31,5-8,5   Arasa21 Q6600     33-7     

 6 Komodo 12.3 x64 Q6600 2.4 GHz, 3443											
Stoc10 1800X    15,5-24,5  Ko13 1800X      17,5-22,5  Stock9 Q6600      20-20
Ko13MC 1800X    20,5-19,5  Booot6 1800X    24,5-15,5  Was35 1800X     32,5-7,5 
DRybka4 Q6600   34,5-5,5   

 8 Komodo 13.02 MCTS x64 1800X 3.6 GHz, 3424											
Stoc10 1800X       8-9     Stock9 Q6600      15-16    Komo12 Q6600    19,5-20,5
Booot6 1800X    20,5-14,5  Komo11 Q6600     1,5-0,5   Wasp3 1800X       31-9 
Wasp201 1800X   32,5-7,5   

 20 Arasan 21.2 x64 Q6600 2.4 GHz, 3250											
Stoc10 1800X       4-36    Stock9 Q6600       7-33    Was35 Q6600     20,5-11,5
Arasa16 Q6600   34,5-5,5   

 22 Wasp 3.5 x64 1800X 3.6 GHz, 3235											
Stoc10 1800X       5-35    Stock9 1800X       5-35    Ko13 1800X         7-33
Komo12 1800X     7,5-32,5  Komo12 Q6600     7,5-32,5  Stock8 1800X     9,5-30,5
Booot6 1800X     9,5-30,5  Booot6 Q6600    14,5-25,5  Arasa21 1800X   15,5-24,5
Wasp3 1800X     24,5-15,5  Wasp201 1800X   25,5-14,5  Baro343 1800X   31,5-8,5 

 30 Wasp 3.5 x64 Q6600 2.4 GHz, 3174											
Stockf6 Q6600   10,5-29,5  Arasa21 Q6600   11,5-20,5  Spike14 Q6600   26,5-13,5

On this July ratinglist of 2019, we can present eight new entrants.

First out is the new leader in the rating list, and the first to break the 3500-
barrier in our rating list. It's Stockfish 10 by Marco Costalba, Tord Romstad 
and Joona Kiiski. As with the former versions, we have used the free opening book
from Sedat Canbaz for the testing, and this time it has been the 
"Aggressive 4.0 by Fauzi.abk". After 577 games it now leads the list by a margin
of 36 points in front of its older version, and with the rating of 3529!

Second out and still early on in the testing, is the latest program by Mark Lefler
and Larry Kaufman. It has placed itself third in this list with the rating of 3482. 
This is 28 points stronger than the last Komodo-version we have tested. As in the
testing of the 12.3-version, we have used Erdogan Guenes opening book. This version
is the "normal" version which can be compared to the older versions we have tested.

We have also tested the Monte Carlo Tree Search-version of Komodo, named MCTS, for 
the first time. We have used the same opening book for this testing. Even though
it's also early on in the testing, it has achieved a strong rating of 3424 after 
205 games played. It trails the normal 13.02-version by 58 points, but are stronger 
than most other programs outside the latest Stockfish/Komodo range and places 
itself on the eight spot in the ratinglist.

Last one out of the programs which we have tested on our 1800X-platform, is
John Stanback's - Wasp 3.5 program. It has achieved a rating of 3235 after the 
first 480 games played, and this is 22 points stronger than Wasp 3. 
Contrary to the other two Wasp-versions we have tested (2.01 and 3),
Wasp 3.5 now includes an own opening book, which we have used for the testing. 

As can be seen from the rating list, we now also have enough games to be able to
present four new additions to the Q6600 hardware level. First one is Stockfish 9,
which has gotten a rating of 3445 after 431 games played. This is 48 points lower
than the version we have tested on the AMD Ryzen 7 1800X hardware level, but is
also the strongest program we have ever tested on the Q6600 platform! 

With a slim margin of only 2 points lower than Stockfish 9, we have now the 
Komodo 12.3 on our Q6600 hardware. It has managed to get a rating of 3443 after 
the first 280 games. This is only 11 points lower than the same version on the 
1800X and 110 points in front of the 11.01 version on the Q6600!

Next up is the program of Jon Dart - Arasan 21.2, which we now have 152 games
with. It's also an early bird which barely made it to this list, but its rating
after the first couple of matches are 3250. This rating is 30 points lower than
the same version on our 1800X platform, but a whopping 249 points stronger than 
the 17.2 version which we also tested on our Q6600 level!

Last one out and extremely in time for this list, was Wasp 3.5 on our Q6600. 
It has achieved a rating of 3174 after the first 112 games, which is
61 points behind the 1800X version, and 109 points stronger than the last 
Wasp-version (2.01) we have tested on the Q6600. 

Notable gains/losses from the last list was: Arasan 21.2 1800X, which gained 11
points, Booot 6.3.1 Q6600 gained 8 points and Booot 6.3.1 1800X gained 5 points.
The programs which lost most points was: Mephisto London 68000 which lost 23
points, The Baron 3.43 1800X lost 7 points and Stockfish 8 Q6600/Wasp 3 1800X 
lost 5 points each. 

For the moment we are manually testing both the Millenium ChessGenius Exclusive, 
the Millenium The King Exclusive and also the previously untested oldie Mephisto 
London 68020. We will be able to introduce the ChessGenius Exclusive on our next 
rating list which we plan to have out in the end of summer or as soon as this 
computer have enough games.    
    
Lars Sandin
Lars Sandin, SSDF
User avatar
Lars Sandin
SSDF
Posts: 2234
Joined: Sun Nov 18, 2007 4:24 pm
Location: Sundsvall, Sweden

THE SSDF RATING LIST 2019-12-10

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2019-12-10    152211 games played by  387 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Stockfish 10 x64 1800X 3.6 GHz          3529   30   -28   680   72%  3366
   2 Stockfish 9 x64 1800X 3.6 GHz           3486   28   -26   802   71%  3327
   3 Komodo 13.1 x64 1800X 3.6 GHz           3470   32   -30   520   64%  3374
   4 Komodo 13.02 x64 1800X 3.6 GHz          3465   30   -29   600   65%  3354
   5 Komodo 12.3 x64 1800X 3.6 GHz           3454   27   -26   760   66%  3336
   6 Stockfish 9 x64 Q6600 2.4 GHz           3449   32   -31   480   56%  3401
   7 Komodo 12.3 x64 Q6600 2.4 GHz           3441   38   -36   360   60%  3364
   8 Stockfish 8 x64 1800X 3.6 GHz           3431   23   -21  1260   75%  3241
   9 Stockfish 8 x64 Q6600 2.4 GHz           3412   31   -30   560   65%  3302
  10 Komodo 13.02 MCTS x64 1800X 3.6 GHz     3401   31   -30   520   57%  3349
  11 Komodo 11.01 x64 1800X 3.6 GHz          3394   22   -21  1254   70%  3247
  12 Deep Shredder 13 x64 1800X 3.6 GHz      3358   24   -24   880   64%  3256
  13 Booot 6.3.1 x64 1800X 3.6 GHz           3354   24   -23   843   51%  3345
  14 Komodo 11.01 x64 Q6600 2.4 GHz          3343   27   -27   642   50%  3339
  15 Komodo 9.1 x64 Q6600 2.4 GHz            3338   20   -19  1475   72%  3177
  16 Stockfish 6 x64 Q6600 2.4 GHz           3326   21   -20  1256   69%  3191
  17 Vajolet2 2.8 x64 1800X 3.6 GHz          3301   61   -65   123   43%  3351
  18 Booot 6.3.1 x64 Q6600 2.4 GHz           3299   30   -30   520   53%  3271
  19 Deep Shredder 13 x64 Q6600 2.4 GHz      3295   24   -23   884   64%  3192
  20 Arasan 21.2 x64 1800X 3.6 GHz           3279   29   -30   560   40%  3348
  21 Komodo 7 x64 Q6600 2.4 GHz              3269   23   -23   974   65%  3159
  22 Komodo 5.1 x64 Q6600 2.4 GHz            3245   22   -22  1038   64%  3145
  23 Arasan 21.2 x64 Q6600 2.4 GHz           3235   48   -52   200   38%  3322
  24 Wasp 3.5 x64 1800X 3.6 GHz              3230   31   -33   520   32%  3359
  25 Deep Hiarcs 14 1800X 3.6 GHz            3217   26   -26   720   40%  3290
  26 Wasp 3 x64 1800X 3.6 GHz                3214   24   -25   842   39%  3292
  27 Stockfish 3 x64 Q6600 2.4 GHz           3202   19   -18  1420   61%  3127
  28 Deep Rybka 4 x64 Q6600 2.4 GHz          3199   20   -19  1368   65%  3093
  29 Deep Rybka 3 x64 Q6600 2.4 GHz          3194   22   -21  1371   75%  3003
  30 Deep Hiarcs 14 Q6600 2.4 GHz            3188   19   -18  1450   61%  3112
  31 Chiron 3.01 x64 Q6600 2.4 GHz           3178   27   -27   656   45%  3215
  32 Wasp 3.5 x64 Q6600 2.4 GHz              3176   41   -42   280   45%  3205
  33 Naum 4.2 x64 Q6600 2.4 GHz              3146   21   -21  1123   60%  3078
  34 Deep Junior Yokohama x64 Q6600 2.4 GHz  3126   22   -22  1010   42%  3184
  35 Hiarcs 14 Athlon 1.2 GHz                3100   29   -29   560   55%  3065
  36 Deep Fritz 13 Q6600 2.4 GHz             3097   24   -24   826   55%  3064
  37 The Baron 3.43 x64 1800X 3.6 GHz        3091   29   -31   680   26%  3272
  38 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2924   47   -46   220   55%  2889
  39 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2860   24   -25   932   30%  3009
  40 Revelation Hiarcs 13.3 PXA255 500 MHz   2772   57   -52   177   66%  2661
  41 Revelation Shredder 12 PXA255 500 MHz   2703   60   -58   140   56%  2663
  42 Revelation Rybka 2.2 PXA255 500 MHz     2628   47   -44   240   62%  2545
  43 Revelation Deep Sjeng 3 PXA255 500 MHz  2599   68   -76   100   37%  2691
  44 ChessGenius 3 ZTE Apex3 ARM A53 1.3 GHz 2457   75   -68   100   62%  2376
  45 Revelation Ruffian 2.1 PXA255 500 MHz   2352   68   -71   100   45%  2388
  46 TASC R30 v. 2.5 ARM6 30 MHz             2274   42   -38   343   69%  2137
  47 Millenium ChessGenius Excl. M7 300 MHz  2251   71   -68   101   55%  2211
  48 Millenium ChessGenius Pro M4 120 MHz    2166   59   -54   160   63%  2070
  49 Millenium ChessGenius ARM M4 48 MHz     2076   51   -47   211   63%  1986
  50 Mephisto London 68000 12 MHz            2008   59   -58   140   53%  1983

 3 Komodo 13.1 x64 1800X 3.6 GHz, 3470											
Stoc10 1800X      18-22    Stock9 1800X      20-20    Stock9 Q6600      22-18
Komo12 Q6600    22,5-18    Stock8 1800X      20-20    Stock8 Q6600    23,5-16,5
Komo11 1800X      22-18    Booot6 1800X    28,5-12    Komo11 Q6600    27,5-12,5
Booot6 Q6600      29-11    Arasa21 1800X   29,5-11    Was35 1800X     35,5-4,5 
DHiar14 1800X   32,5-8     

 17 Vajolet2 2.8 x64 1800X 3.6 GHz, 3301											
Stoc10 1800X       7-33    Stock8 1800X      12-28    Booot6 1800X       1-2 
Baro343 1800X     33-7     

 47 Millenium ChessGenius Excl. M7 300 MHz, 2251											
Rebel 9.0 P90    6,5-14    Nimzo 3.0 P90      8-12    PTiger09 Tung     12-8 
MCG Pro           13-7     Star Sapphire   15,5-5     Meph. MM 5         1-0 

On this wintry December rating list of 2019, we can present three new entrants.

First out is the Komodo-version which won the ICGA World Computer Chess 
Championship (WCCC) and World Software Chess Championship (WSCC) in Macau this
summer. Komodo is programmed by Mark Lefler and Larry Kaufman, and we have used
Erdogan Guenes opening book for the testing. After 520 games it has placed 
itself third in the rating list with a rating of 3470 on our 1800X platform. 
This is 5 points ahead of the 13.02 version and 16 points behind Stockfish 9. 

Next out is a newcomer on our rating list, namely Vajolet2 2.8 by Marco Belli. 
So far we have only played 123 games, but after those first couple of matches, 
it has performed admirably with a rating of 3301. More games will be needed 
to get a more reliable rating figure and lower the error bars, but the start 
has been very good. We have used Sedat Canbaz free opening book "Perfect2019.abk"
for the testing of Vajolet2 2.8.

Last out this time is the manually tested dedicated chess computer from the 
Millenium GmbH company, named Millenium ChessGenius Exclusive. It has an 
ARM Cortex M7 processor which is clocked at 300 MHz, and has the famous 
ChessGenius program by Richard Lang. Similar to the testing of 
ChessGenius Pro, we have used the opening book by Mark Uniacke for the 
testing. After the first 101 games it has achieved a rating of 2251, which 
is 85 points higher than the ChessGenius Pro.

Some notable losses/gains from the previous list was: Komodo 11.01 Q6600 and 
Booot 6.3.1 Q6600 which gained 10 points each. The rating of Komodo 13.02 1800X
and Komodo 13.02 MCTS 1800X fell after more games was played, and they lost 17
and 23 points. Arasan 21.2 Q6600 also lost 15 points from the last list.

Our upcoming plan is to get more games with Vajolet2 2.8 on the 1800X level and 
also to be able to present enough games with it on our Q6600 hardware. 
The Q6600-version missed the mark for this list, but will be introduced in the 
upcoming rating list instead. We will hopefully also be able to introduce 
some other new programs for that list.

For all those that celebrate Christmas and/or New Year, I will take the 
opportunity to wish you all a Merry Christmas and a Happy New Year from us in
the SSDF. 

Lars Sandin

P.S. Minor correction from the last list: It was Fauzi Dabat's opening book 
which we have used for the testing of Stockfish 10, and not Sedat's. D.S.
Lars Sandin, SSDF
User avatar
Lars Sandin
SSDF
Posts: 2234
Joined: Sun Nov 18, 2007 4:24 pm
Location: Sundsvall, Sweden

THE SSDF RATING LIST 2020-07-11

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2020-07-11    153481 games played by  391 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Stockfish 11 x64 1800X 3.6 GHz          3558   48   -42   330   76%  3354
   2 Stockfish 10 x64 1800X 3.6 GHz          3525   29   -27   720   71%  3369
   3 Stockfish 9 x64 1800X 3.6 GHz           3484   27   -25   842   71%  3325
   4 Komodo 13.1 x64 1800X 3.6 GHz           3471   32   -30   520   64%  3372
   5 Komodo 13.02 x64 1800X 3.6 GHz          3464   30   -29   600   65%  3352
   6 Komodo 12.3 x64 1800X 3.6 GHz           3454   27   -26   760   66%  3334
   7 Stockfish 9 x64 Q6600 2.4 GHz           3444   32   -31   480   56%  3401
   8 Komodo 12.3 x64 Q6600 2.4 GHz           3436   38   -36   360   60%  3361
   9 Stockfish 8 x64 1800X 3.6 GHz           3427   22   -21  1320   73%  3255
  10 Komodo 13.2.5 MCTS x64 1800X 3.6 GHz    3423   50   -48   200   56%  3381
  11 Stockfish 8 x64 Q6600 2.4 GHz           3411   31   -30   560   65%  3301
  12 Komodo 13.02 MCTS x64 1800X 3.6 GHz     3401   31   -30   520   57%  3346
  13 Komodo 11.01 x64 1800X 3.6 GHz          3397   20   -19  1394   69%  3259
  14 Deep Shredder 13 x64 1800X 3.6 GHz      3357   24   -24   880   64%  3256
  15 Booot 6.3.1 x64 1800X 3.6 GHz           3356   22   -22   960   51%  3349
  16 Komodo 11.01 x64 Q6600 2.4 GHz          3340   27   -27   642   50%  3339
  17 Komodo 9.1 x64 Q6600 2.4 GHz            3338   20   -19  1475   72%  3176
  18 Stockfish 6 x64 Q6600 2.4 GHz           3326   21   -20  1256   69%  3190
  19 Vajolet2 2.8 x64 1800X 3.6 GHz          3299   27   -28   650   38%  3382
  20 Booot 6.3.1 x64 Q6600 2.4 GHz           3295   30   -30   520   53%  3270
  21 Deep Shredder 13 x64 Q6600 2.4 GHz      3295   24   -23   884   64%  3192
  22 Vajolet2 2.8 x64 Q6600 2.4 GHz          3280   46   -41   320   73%  3104
  23 Arasan 21.2 x64 1800X 3.6 GHz           3279   28   -29   600   38%  3360
  24 Komodo 7 x64 Q6600 2.4 GHz              3269   23   -23   974   65%  3159
  25 Arasan 21.2 x64 Q6600 2.4 GHz           3251   44   -46   240   41%  3312
  26 Komodo 5.1 x64 Q6600 2.4 GHz            3245   22   -22  1038   64%  3144
  27 Wasp 3.5 x64 1800X 3.6 GHz              3223   29   -31   600   32%  3349
  28 Deep Hiarcs 14 1800X 3.6 GHz            3222   25   -26   760   39%  3296
  29 Deep Rybka 4 x64 Q6600 2.4 GHz          3198   19   -19  1408   64%  3098
  30 Deep Hiarcs 14 Q6600 2.4 GHz            3188   19   -18  1450   61%  3112
  31 Chiron 3.01 x64 Q6600 2.4 GHz           3178   27   -27   656   45%  3214
  32 Wasp 3.5 x64 Q6600 2.4 GHz              3170   38   -39   320   44%  3216
  33 Deep Junior Yokohama x64 Q6600 2.4 GHz  3126   22   -22  1010   42%  3183
  34 Hiarcs 14 Athlon 1.2 GHz                3100   29   -29   560   55%  3065
  35 Deep Fritz 13 Q6600 2.4 GHz             3097   24   -24   826   55%  3064
  36 The Baron 3.43 x64 1800X 3.6 GHz        3088   29   -31   680   26%  3272
  37 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2924   47   -46   220   55%  2889
  38 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2860   24   -25   932   30%  3008
  39 Revelation Hiarcs 13.3 PXA255 500 MHz   2772   57   -52   177   66%  2660
  40 Revelation Shredder 12 PXA255 500 MHz   2703   60   -58   140   56%  2665
  41 Revelation Rybka 2.2 PXA255 500 MHz     2628   47   -44   240   62%  2546
  42 Revelation Deep Sjeng 3 PXA255 500 MHz  2593   67   -74   104   37%  2684
  43 Millennium The King Exclusive 300 MHz   2543   70   -67   104   57%  2495
  44 ChessGenius 3 ZTE Apex3 ARM A53 1.3 GHz 2447   65   -62   120   56%  2402
  45 Revelation Ruffian 2.1 PXA255 500 MHz   2349   68   -71   100   45%  2386
  46 TASC R30 v. 2.5 ARM6 30 MHz             2274   42   -38   343   69%  2137
  47 Millennium ChessGenius Excl. M7 300 MHz 2244   68   -62   120   62%  2159
  48 Millennium ChessGenius Pro M4 120 MHz   2165   59   -54   160   63%  2068
  49 Millennium ChessGenius ARM M4 48 MHz    2075   51   -47   211   63%  1986
  50 Mephisto London 68000 12 MHz            2006   59   -58   140   53%  1983

 1 Stockfish 11 x64 1800X 3.6 GHz, 3558											
Stock8 1800X    39,5-20,5  Ko132M 1800X      27-13    Komo11 1800X      31-9 
Booot6 1800X    27,5-12,5  Vaj28 1800X     92,5-17,5  Arasa21 1800X   34,5-5,5 

 10 Komodo 13.2.5 MCTS x64 1800X 3.6 GHz, 3423											
Stoc11 1800X      13-27    Stoc10 1800X      15-25    Vaj28 1800X     57,5-22,5
DHiar14 1800X     26-14    

 22 Vajolet2 2.8 x64 Q6600 2.4 GHz, 3280											
Arasa21 Q6600     17-23    DRybka4 Q6600     25-15    Was35 Q6600     27,5-12,5
DFrit12 Q6600     60-20    DFrit11 Q6600     33-7     Arasa16 Q6600   72,5-7,5 

 164 Millennium The King Exclusive 300 MHz, 2543											
Pock Fritz 3H    5,5-14,5  Revelat DSj3     2,5-1,5   PF3 Glaurung2    7,5-12,5
PF4 Craft 23    12,5-7,5   ChGen3 ZTE        14-6     PTiger09 Tung     17-3 

This first list of 2020 will be dedicated in honor of the late Tony Hedlund. *

For this new rating list we can present four new entrants. Three PC-programs
and one dedicated chess computer.

First out is the new leader on our rating list, namely Stockfish 11. For the
testing we have used the free opening book by Fauzi Dabat, named:
"Aggressive 4.5 by Fauzi.abk". This strong combo has achieved a very impressive
rating of 3558 after 330 games played and this is 33 points ahead of its older 
version.

We have also got enough games to be able to present a later version of the 
Monte Carlo Tree Search-version of Komodo, by Mark Lefler and Larry Kaufman.
The version tested this time is 13.2.5. After the first 200 games the 
rating are 22 points stronger than the last version tested (13.02). As before
we have used the Komodo opening book by Erdogan Gunes for the testing.

We are also able to present the formerly tested Vajolet2 2.8 by Marco Belli on
our Q6600-hardware this time. After 320 games played on this hardware, it has 
reached a rating of 3280. A rating which is just 19 points shy from the version
we have tested on our 1800X platform. More games against stronger opponents will
be needed to see if this margin will hold.

Last but not least is the manually tested chess computer which goes by the name:
Millennium The King Exclusive. A dedicated chess computer which is manufactured
by the company Millennium 2000 GmbH. Similar to the ChessGenius Exclusive, it 
has an ARM Cortex M7 processor which is clocked at 300 MHz. The program used in 
this chess computer is the highly regarded King-program by Johan De Koning. 
We have tested versions of his programs before, both in dedicated chess computers
and as engines in the well known Chessmaster-series. After the first 104 games 
it has recieved a very strong rating of 2543! A rating which is 22 points 
stronger than the Chessmaster 8000 which we tested on the K6-2 450 MHz back in 
the days, and 345 points ahead of the King 2.0 version which we tested in form
of the dedicated Chessmachine-card for PC. 

Most points gained since last list was +15 for Arasan 21.2 1800X, PF 3 Glaurung
gained 11 points and Deep Hiarcs 14 1800X gained 5 points. ChessGenius 3 on our 
mobile Android-platform lost 10 points and Wasp 3.5 1800X lost 8 points.

We have begun testing of the new Komodo-version, the latest versions of Booot
and Wasp. We will also soon begin the manual testing of DGT/Ruud Martins:
Revelation II Anniversary Edition. We hope to have the next list out sometime in
the beginning of autumn, depending on how the testing goes until then. 

Stay safe out there and hope to meet you all in autumn again.

Lars Sandin
* https://hiarcs.net/forums/viewtopic.php?p=99064#99064
Lars Sandin, SSDF
TracySMiller
Full Member
Posts: 865
Joined: Sun Mar 13, 2016 2:24 am
Location: Kingsport, TN

Post by TracySMiller »

Thank you so much for all that you do, and so sorry for the passing of Tony. He did amazing things with the SSDF for so long.

Quick question. I noticed that Revelation 2 Stockfish is not on the list. I understand that Stockfish 6 is a native engine on the Revelation 2, and I'm understandably curious as to how it performs. For that matter, I suppose the rest of the Revelation 2 engines (except for HIARCS, which is on the list). Are you planning to test them?
User avatar
Lars Sandin
SSDF
Posts: 2234
Joined: Sun Nov 18, 2007 4:24 pm
Location: Sundsvall, Sweden

Post by Lars Sandin »

TracySMiller wrote:Thank you so much for all that you do, and so sorry for the passing of Tony. He did amazing things with the SSDF for so long.

Quick question. I noticed that Revelation 2 Stockfish is not on the list. I understand that Stockfish 6 is a native engine on the Revelation 2, and I'm understandably curious as to how it performs. For that matter, I suppose the rest of the Revelation 2 engines (except for HIARCS, which is on the list). Are you planning to test them?
Thanks for the kind words! Yes, Tony was a great guy and he will be missed dearly.

The meeting I recently started (and will publish the games from today) will be the last meeting with the Rev II in the original form before the upgrade to the Anniversary Edition. It won't be a full 20-game match, as I will prioritize testing the A.E. when it arrives. This will mean that the Rev II Hiarcs 14.1 will be the only engine tested on the original 800 MHz.

I have tested most of the other engines on the Rev I though. My last project was to test the Toga 1.2, but I had to interrupt this testing because of some strange bug in Toga which made it hard for me to continue. So just now I am playing with the Rev I Deep Sjeng 3.0 against the Millennium The King Exclusive, and the games will follow shortly.
Lars Sandin, SSDF
User avatar
Lars Sandin
SSDF
Posts: 2234
Joined: Sun Nov 18, 2007 4:24 pm
Location: Sundsvall, Sweden

THE SSDF RATING LIST 2020-12-31

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2020-12-31    155019 games played by  397 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Stockfish 12 NNUE x64 1800X 3.6 GHz     3573   47   -43   257   65%  3466
   2 Dragon by Komodo x64 1800X 3.6 GHz      3564   50   -45   250   70%  3413
   3 Stockfish 11 x64 1800X 3.6 GHz          3547   38   -35   423   71%  3391
   4 Stockfish 10 x64 1800X 3.6 GHz          3521   25   -24   880   68%  3385
   5 Stockfish 9 x64 1800X 3.6 GHz           3482   27   -25   842   71%  3324
   6 Komodo 13.1 x64 1800X 3.6 GHz           3469   30   -29   560   62%  3386
   7 Komodo 14 x64 1800X 3.6 GHz             3466   38   -38   320   52%  3452
   8 Komodo 13.02 x64 1800X 3.6 GHz          3462   30   -29   600   65%  3351
   9 Komodo 12.3 x64 1800X 3.6 GHz           3452   27   -26   760   66%  3334
  10 Stockfish 9 x64 Q6600 2.4 GHz           3445   32   -31   480   56%  3400
  11 Komodo 12.3 x64 Q6600 2.4 GHz           3434   38   -36   360   60%  3360
  12 Stockfish 8 x64 1800X 3.6 GHz           3426   21   -20  1400   72%  3263
  13 Komodo 13.2.5 MCTS x64 1800X 3.6 GHz    3421   50   -48   200   56%  3376
  14 Stockfish 8 x64 Q6600 2.4 GHz           3410   31   -30   560   65%  3300
  15 Komodo 13.02 MCTS x64 1800X 3.6 GHz     3398   31   -30   520   57%  3346
  16 Komodo 11.01 x64 1800X 3.6 GHz          3394   19   -19  1474   67%  3270
  17 Booot 6.4 x64 1800X 3.6 GHz             3370   41   -41   280   53%  3344
  18 Booot 6.3.1 x64 1800X 3.6 GHz           3357   19   -19  1260   47%  3374
  19 Deep Shredder 13 x64 1800X 3.6 GHz      3356   24   -24   880   64%  3255
  20 Komodo 11.01 x64 Q6600 2.4 GHz          3340   27   -27   642   50%  3338
  21 Stockfish 6 x64 Q6600 2.4 GHz           3325   21   -20  1256   69%  3190
  22 Vajolet2 2.8 x64 1800X 3.6 GHz          3297   27   -28   650   38%  3379
  23 Arasan 21.2 x64 1800X 3.6 GHz           3282   26   -27   680   38%  3364
  24 Vajolet2 2.8 x64 Q6600 2.4 GHz          3281   46   -41   320   73%  3103
  25 Wasp 4 x64 1800X 3.6 GHz                3257   45   -49   240   35%  3369
  26 Arasan 21.2 x64 Q6600 2.4 GHz           3250   37   -38   340   45%  3281
  27 Wasp 3.5 x64 1800X 3.6 GHz              3220   29   -31   600   32%  3348
  28 Deep Hiarcs 14 1800X 3.6 GHz            3220   24   -25   800   39%  3293
  29 Wasp 4 x64 Q6600 2.4 GHz                3209   38   -37   340   59%  3147
  30 Deep Rybka 4 x64 Q6600 2.4 GHz          3199   19   -18  1448   64%  3101
  31 Deep Hiarcs 14 Q6600 2.4 GHz            3188   19   -18  1450   61%  3112
  32 Chiron 3.01 x64 Q6600 2.4 GHz           3177   27   -27   656   45%  3214
  33 Wasp 3.5 x64 Q6600 2.4 GHz              3169   36   -37   360   43%  3215
  34 Deep Junior Yokohama x64 Q6600 2.4 GHz  3125   22   -22  1010   42%  3183
  35 Hiarcs 14 Athlon 1.2 GHz                3100   29   -29   560   55%  3064
  36 Deep Fritz 13 Q6600 2.4 GHz             3097   24   -24   826   55%  3064
  37 The Baron 3.43 x64 Q6600 2.4 GHz        3022   33   -33   440   51%  3018
  38 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2925   47   -45   228   56%  2882
  39 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2860   24   -25   932   30%  3008
  40 Revelation Hiarcs 13.3 PXA255 500 MHz   2771   57   -52   177   66%  2660
  41 Revelation Shredder 12 PXA255 500 MHz   2705   60   -58   140   56%  2665
  42 Revelation Rybka 2.2 PXA255 500 MHz     2635   45   -43   260   63%  2545
  43 Revelation Deep Sjeng 3 PXA255 500 MHz  2601   62   -67   120   41%  2663
  44 Millennium The King Exclusive 300 MHz   2527   58   -57   144   51%  2519
  45 ChessGenius 3 ZTE Apex3 ARM A53 1.3 GHz 2445   65   -62   120   56%  2399
  46 Revelation Ruffian 2.1 PXA255 500 MHz   2348   68   -71   100   45%  2385
  47 Millennium ChessGenius Excl. M7 300 MHz 2244   62   -57   144   62%  2157
  48 Millennium ChessGenius Pro M4 120 MHz   2163   59   -54   160   63%  2067
  49 Millennium ChessGenius ARM M4 48 MHz    2073   47   -45   231   59%  2008
  50 Mephisto London 68000 12 MHz            2005   59   -58   140   53%  1982

 1 Stockfish 12 NNUE x64 1800X 3.6 GHz, 3573											
Dragon 1800X       8-9     Stoc11 1800X      21-19    Stoc10 1800X    23,5-16,5
Ko131 1800X       25-15    Ko14 1800X      27,5-12,5  Komo11 1800X    31,5-8,5 
Booot6 1800X    29,5-10,5  

 2 Dragon by Komodo x64 1800X 3.6 GHz, 3564											
SF12NU 1800X       9-8     Stoc11 1800X     6,5-6,5   Stoc10 1800X    22,5-17,5
Ko14 1800X      26,5-13,5  Booot6 1800X    78,5-21,5  Arasa21 1800X     33-7 

 7 Komodo 14 x64 1800X 3.6 GHz, 3466											
SF12NU 1800X    12,5-27,5  Dragon 1800X    13,5-26,5  Stoc11 1800X      17-23
Stoc10 1800X      17-23    Stock8 1800X    20,5-19,5  Boo64 1800X       26-14
Booot6 1800X    24,5-15,5  Wasp4 1800X       34-6     

 17 Booot 6.4 x64 1800X 3.6 GHz, 3370											
Ko14 1800X        14-26    Stock8 1800X      16-24    Komo11 1800X    17,5-22,5
Booot6 1800X      43-37    Wasp4 1800X     28,5-11,5  Wasp201 1800X     30-10

 25 Wasp 4 x64 1800X 3.6 GHz, 3257											
Stoc10 1800X     6,5-33,5  Ko14 1800X         6-34    Boo64 1800X     11,5-28,5
Booot6 1800X      15-25    Arasa21 1800X   18,5-21,5  DHiar14 1800X   25,5-14,5

 29 Wasp 4 x64 Q6600 2.4 GHz, 3209											
Arasa21 Q6600   43,5-56,5  DRybka4 Q6600     19-21    Was35 Q6600     23,5-16,5
Spike14 Q6600     24-16    DFrit12 Q6600     29-11    DJuni12 Q6600   26,5-13,5
Arasa16 Q6600   34,5-5,5   

This is the last list of the pandemic year 2020 and features some new and
interesting entrants.

First out is team Stockfish with their latest edition of the Stockfish engine,
namely Stockfish 12. This version uses a neural network architecture (NNUE), 
which now can be run on ordinary processors instead of Graphic cards. It has 
been tested with the latest free opening-book of Fauzi Akram Dabat, named:
"Aggressive 4.7 by fauzi.abk". After the first 257 games, this strong combo, 
has achieved an impressive rating of 3573, an improvement of 26 points over 
the previous version, and it keeps the leader spot in our list!

Next one out is the Komodo version from Mark Lefler and Larry Kaufman, named
Komodo 14. This version was tested with the opening book of Erdogan Günes: 
"out5-35.bin", a book which we also have used previously when testing earlier 
Komodo-versions. Komodo 14 has achieved a rating of 3466 after 320 games.
It doesn't show a clear improvement over the earlier 13-versions we have
tested and positions itself between the 13.1 and 13.02 versions at the moment.
More testing will be needed to see if this will hold, or if it will gain some 
rating when more games are played.

We can also present another version of Komodo in this rating list, namely
the latest Komodo-version, called: Dragon by Komodo. This is the first Komodo
version which uses the NNUE-technique, and the gain in strength from the 
previous version is huge. After the first 250 games, its rating is 3564! 
This is 95 points over the 13.1 version and it now trails Stockfish with a 
margin of only 9 points. Dragon by Komodo has been tested with Erdogan 
Günes opening book: "out10-35.bin".

For this rating list we can also present the latest release of the Booot
engine by Alex Morozov, named Booot 6.4. We have been testing this engine 
with Sedat Canbaz opening book: "perfect2019.abk". After the first 280
games, the increase over the 6.3.1 version is 13 points, and the rating 
is now 3370.

We have also tested the engine: Wasp 4 by John Stanback for this rating 
list. We have tested it on both our hardware levels. We have used its own 
opening book for the testing. On our 1800X-platform it has achieved a 
rating of 3257 after the first 240 games. This is an improvement of 37 points
from the earlier 3.5-version. On our Q6600-platform it has gained a rating 
of 3209, and this is 40 points stronger than the Wasp 3.5-version which we 
tested on the same Q6600-hardware. 

Since last time, Revelation Deep Sjeng 3.0 gained 7 points. Notable losses 
was Millennium The King, which lost 16 points and Stockfish 11 which lost 
11 points.

We are at the moment testing the MCTS-version of Komodo, Fabio Gobbato's 
engine: Pedone, and we will hopefully also be able to present a rating 
of the old dedicated chess computer London 68020 on our next rating list.
 
Lars Sandin 
Lars Sandin, SSDF
User avatar
Lars Sandin
SSDF
Posts: 2234
Joined: Sun Nov 18, 2007 4:24 pm
Location: Sundsvall, Sweden

THE SSDF RATING LIST 2020-07-28

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2021-07-28    156884 games played by  406 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Lc0 0.26.3 Cuda(67362) 3060Ti           3581   41   -39   320   64%  3479
   2 Stockfish 13 x64 1800X 3.6 GHz          3573   44   -40   320   70%  3428
   3 Stockfish 12 NNUE x64 1800X 3.6 GHz     3568   32   -30   520   64%  3468
   4 Dragon by Komodo x64 1800X 3.6 GHz      3557   34   -32   460   63%  3457
   5 Stockfish 11 x64 1800X 3.6 GHz          3545   36   -34   450   70%  3399
   6 Stockfish 10 x64 1800X 3.6 GHz          3520   25   -24   880   68%  3384
   7 Dragon Komodo 2 MCTS x64 1800X 3.6 GHz  3503   54   -55   160   49%  3499
   8 Stockfish 9 x64 1800X 3.6 GHz           3480   26   -24   882   70%  3334
   9 Komodo 13.1 x64 1800X 3.6 GHz           3468   30   -29   560   62%  3385
  10 Komodo 13.02 x64 1800X 3.6 GHz          3461   30   -29   600   65%  3350
  11 Komodo 14 x64 1800X 3.6 GHz             3461   34   -34   400   52%  3449
  12 Komodo 12.3 x64 1800X 3.6 GHz           3451   27   -26   760   66%  3333
  13 Stockfish 9 x64 Q6600 2.4 GHz           3443   32   -31   480   56%  3399
  14 Komodo 12.3 x64 Q6600 2.4 GHz           3431   36   -34   400   61%  3355
  15 Stockfish 8 x64 1800X 3.6 GHz           3425   20   -19  1440   71%  3269
  16 Dragon Komodo MCTS x64 1800X 3.6 GHz    3420   41   -41   280   52%  3413
  17 Komodo 13.2.5 MCTS x64 1800X 3.6 GHz    3417   50   -48   200   56%  3374
  18 Stockfish 8 x64 Q6600 2.4 GHz           3409   31   -30   560   65%  3299
  19 Pedone 3 x64 1800X 3.6 GHz              3399   44   -45   240   43%  3442
  20 Komodo 13.02 MCTS x64 1800X 3.6 GHz     3397   31   -30   520   57%  3345
  21 Booot 6.4 x64 1800X 3.6 GHz             3368   36   -36   360   51%  3365
  22 Deep Shredder 13 x64 1800X 3.6 GHz      3356   24   -24   880   64%  3255
  23 Pedone 3 x64 Q6600 2.4 GHz              3317   51   -48   200   60%  3248
  24 Pedone 2.1 x64 1800X 3.6 GHz            3305   42   -46   280   32%  3420
  25 Vajolet2 2.8 x64 1800X 3.6 GHz          3294   27   -28   650   38%  3377
  26 Arasan 21.2 x64 1800X 3.6 GHz           3291   25   -26   800   36%  3388
  27 Wasp 4 x64 1800X 3.6 GHz                3265   42   -45   280   33%  3376
  28 Pedone 2.1 x64 Q6600 2.4 GHz            3222   46   -44   240   59%  3159
  29 Deep Hiarcs 14 1800X 3.6 GHz            3218   24   -25   840   38%  3298
  30 Deep Rybka 4 x64 Q6600 2.4 GHz          3198   19   -18  1448   64%  3100
  31 Chiron 3.01 x64 Q6600 2.4 GHz           3177   27   -27   656   45%  3214
  32 Naum 4.2 x64 Q6600 2.4 GHz              3146   21   -21  1123   60%  3078
  33 Deep Junior Yokohama x64 Q6600 2.4 GHz  3125   22   -22  1010   42%  3183
  34 Spike 1.4 Q6600 2.4 GHz                 3106   15   -15  2031   52%  3094
  35 Hiarcs 14 Athlon 1.2 GHz                3099   29   -29   560   55%  3064
  36 Deep Fritz 13 Q6600 2.4 GHz             3097   24   -24   826   55%  3064
  37 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2925   47   -45   228   56%  2883
  38 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2860   24   -25   932   30%  3008
  39 Revelation Hiarcs 13.3 PXA255 500 MHz   2771   57   -52   177   66%  2660
  40 Revelation Shredder 12 PXA255 500 MHz   2705   60   -58   140   56%  2665
  41 Revelation Rybka 2.2 PXA255 500 MHz     2633   45   -43   260   63%  2545
  42 Revelation Deep Sjeng 3 PXA255 500 MHz  2598   62   -67   120   41%  2662
  43 Millennium The King Exclusive 300 MHz   2524   55   -53   164   55%  2492
  44 Revelation Ruffian 2.1 PXA255 500 MHz   2347   68   -71   100   45%  2384
  45 Millennium ChessGenius Excl. M7 300 MHz 2249   54   -51   180   59%  2183
  46 Mephisto London 68030 33 MHz            2194   31   -31   482   50%  2191
  47 Millennium ChessGenius Pro M4 120 MHz   2163   59   -54   160   63%  2067
  48 Mephisto London 68020 12 MHz            2103   73   -64   115   67%  1984
  49 Millennium ChessGenius ARM M4 48 MHz    2070   45   -43   251   58%  2016
  50 Mephisto London 68000 12 MHz            2005   59   -58   140   53%  1981

 1 Lc0 0.26.3 Cuda(67362) 3060Ti, 3581											
Stoc13 1800X      20-20    SF12NU 1800X    20,5-19,5  Dragon 1800X      21-19
Dra2MC 1800X      25-15    Stock9 1800X      25-15    Ko14 1800X        27-13
Ped3 1800X        33-7     Arasa21 1800X     33-7     

 2 Stockfish 13 x64 1800X 3.6 GHz, 3573											
LC0 3060Ti        20-20    SF12NU 1800X      20-20    Dragon 1800X      22-18
Komo11 1800X    29,5-10,5  Boo64 1800X     33,5-6,5   Booot6 1800X      31-9 
Ped21 1800X       35-5     Arasa21 1800X   34,5-5,5   

 7 Dragon Komodo 2 MCTS x64 1800X 3.6 GHz, 3503											
LC0 3060Ti        15-25    SF12NU 1800X    15,5-24,5  Stock8 1800X      23-17
Dra MC 1800X    24,5-15,5  

 16 Dragon Komodo MCTS x64 1800X 3.6 GHz, 3420											
SF12NU 1800X    14,5-25,5  Dragon 1800X      16-24    Dra2MC 1800X    15,5-24,5
Ped3 1800X        20-20    Ped21 1800X     26,5-13,5  Arasa21 1800X     23-17
Wasp4 1800X     29,5-10,5  

 19 Pedone 3 x64 1800X 3.6 GHz, 3399											
LC0 3060Ti         7-33    SF12NU 1800X      11-29    Dragon 1800X    12,5-27,5
Dra MC 1800X      20-20    Ped21 1800X       22-18    DHiar14 1800X   31,5-8,5 

 23 Pedone 3 x64 Q6600 2.4 GHz, 3317											
Komo12 Q6600      15-25    DShre13 Q6600     17-23    Vaj28 Q6600       27-13
Ped21 Q6000       24-16    DShre11 Q6600   36,5-3,5   

 24 Pedone 2.1 x64 1800X 3.6 GHz, 3305											
Stoc13 1800X       5-35    SF12NU 1800X       5-35    Ko14 1800X         9-31
Dra MC 1800X    13,5-26,5  Ped3 1800X        18-22    Boo64 1800X     12,5-27,5
Wasp201 1800X     27-13    

 28 Pedone 2.1 x64 Q6600 2.4 GHz, 3222											
Ped3 Q6600        16-24    DShre13 Q6600    9,5-30,5  Wasp4 Q6600       24-16
Hia13.2 Q6600     28-12    Craf25 Q6600    33,5-6,5   DShre11 Q6600     30-10

 48 Mephisto London 68020 12 MHz, 2103											
MCG Ex           5,5-14,5  MCG               12-8     Star Sapphire   13,5-6,5 
Sapphire II      1,5-2,5   Diablo 68000       9-2     Polgar 5 MHz      17-3 
Rebell 5 MHz      18-2     

For this summer rating list we are able to present 9 new entrants.

First one out is also the first chess program we have ever tested for the 
rating list which have utilized a graphic card. The new number one on this
rating list is Leela Chess Zero, which have recieved an impressive rating of
3581 after 320 games played. We have tested Leela Chess Zero with a  
Nvidia RTX 3060 Ti graphic card. We have used the Lc0 0.26.3 version and have
used the 30 blocks x 384 filter net with the number 67362. As opening book we
have used the free "Perfect2021.abk" opening book by Sedat Canbaz.

Trailing just 8 points below, with a rating of 3573 after 320 played games,
is the 13th version of Stockfish. Like its former version, it uses 
neural network architecture (NNUE). We have chosen to omit 
the NNUE-nomenclature from the name, since NNUE is the default and strongest
setting. We have used the latest free opening book by Fauzi Akram Dabat for 
the testing of Stockfish 13 and it is named "Aggressive 4.9 by Fauzi.abk". 

In this rating list we can also present two new MCTS-versions of Komodo, both
utilizing the NNUE-technology. The first one which we tested was 
Dragon Komodo (1) MCTS, and due to some difficulties with the AVX2 version, 
we had to test the non-AVX2 version of Dragon Komodo (1) MCTS. 
After 280 played games and with a rating of 3420, it has positioned itself 
3 points ahead of its 13.2.5-version, which was non-NNUE, and also 137 points 
below its non-MCTS version of Dragon Komodo (1). The gap between the two 
(non-MCTS/MCTS) was not as significant when we tested the 13.02 version of 
Komodo, and back then it was 64 points between the two versions.

We have also tested the new Dragon Komodo 2 MCTS-version from Mark Lefler and
Larry Kaufman. This version seems to perform better and we have also have had
no problems in getting the AVX2 version to work this time. It is relatively 
early on in the testing, but Dragon Komodo 2 MCTS has recieved a rating of 3503
after the first 160 games played. This makes it 83 points stronger than the 
first version and also just 54 points shy of its non-MCTS version of Dragon
Komodo (1). We have used the same opening book for the testing of both
Dragon Komodo MCTS-versions, namely Erdogan Günes opening book "out10-35.bin".

On this rating list we can also present four new entrants from Fabio Gobbato,
tested on both the 1800X and Q6600 hardware levels. First one we tested was the
Pedone 2.1 version. This version was non-NNUE and has managed to get a rating 
of 3222 after 240 games on our Q6600 level. On our 1800X level, it has recieved
a rating of 3305 after 280 played games. The difference between the two hardware
levels is 83 points. 

Next one out was the Pedone 3.0 version, which uses NNUE in its search. Likewise 
with other NNUE-programs on the list, we have chosen to omit the NNUE-nomenclature, 
since this is the strongest setting for their respective versions. Pedone 3.0 has
recieved a rating of 3399 after 240 games played on our 1800X level, and a rating
of 3317 after 200 games played on the Q6600 level. The difference between the two 
hardware levels are nearly the same as the 2.1 version and it is 82 points.
The gap between the non-NNUE version of 2.1 and the NNUE-version of 3.0, is 
95 points for the Q6600-level and 94 points for the 1800X-level! We have used 
Pedones own opening book for the testing of version 2.1 and 3.0.  

Last one out is an oldie which at last has managed to get on the rating list 
with some manual testing. The dedicated chess computer Mephisto London 68020 
at 12 MHz, is a module which can be used in Mephistos modular boards. The modular
boards included the Modular/Exclusive/München and Bavaria wooden chess boards.
The software in the London 68020 is the Genius 3.0 program by Richard Lang, which
on a PC (Pentium 90 MHz) managed to beat Garry Kasparov in a rapid game 1994 in 
London. After the first 115 games, London 68020 has managed to get a rating 
of 2103. This is nearly 100 points stronger than the 68000-version and also 91
points weaker than the London 68030 version at 33 MHz. It trails the Mephisto
Berlin Pro 68020 at 24 MHz, with 25 points, but it is the second strongest 68020
program we have ever tested, 39 points ahead of its Vancouver 68020-version. 

We are at the moment testing several different programs which barely missed
this rating list, but will feature in the upcoming rating list which we plan
to release as soon as they have enough games to be presented. Hopefully our
next list will be out sometime in the autumn. 

Lars Sandin
Lars Sandin, SSDF
User avatar
paulwise3
Senior Member
Posts: 1508
Joined: Tue Jan 06, 2015 10:56 am
Location: Eindhoven, Netherlands

Re: SSDF Rating list - Last Updated 28th of July 2021

Post by paulwise3 »

Hi Lars,

I do not see the DGT Centaur in the list. Are you planning rating games for the Centaur at Expert level?

Best regards, Paul
2024 Special thread: viewtopic.php?f=3&t=12741
2024 Special results and standings: https://schaakcomputers.nl/paul_w/Tourn ... 25_06.html
If I am mistaken, it must be caused by a horizon effect...
User avatar
Lars Sandin
SSDF
Posts: 2234
Joined: Sun Nov 18, 2007 4:24 pm
Location: Sundsvall, Sweden

Re: SSDF Rating list - Last Updated 28th of July 2021

Post by Lars Sandin »

paulwise3 wrote: Sun Oct 10, 2021 11:09 am Hi Lars,

I do not see the DGT Centaur in the list. Are you planning rating games for the Centaur at Expert level?

Best regards, Paul
Hi Paul,

I don't believe that the DGT Centaur has a tournament level suitable for our test conditions, that is a time setting for 2h/40 moves and then 1h for each 20 moves. I also think it would be hard to correctly rate a computer like the DGT Centaur, which to my knowledge, is adapting its strength to the opposition. No doubt that it is a strong computer, but it would be hard for us to test it because of these two factors.

Best regards
Lars
Lars Sandin, SSDF
User avatar
paulwise3
Senior Member
Posts: 1508
Joined: Tue Jan 06, 2015 10:56 am
Location: Eindhoven, Netherlands

Re: SSDF Rating list - Last Updated 28th of July 2021

Post by paulwise3 »

Hi Lars,

Yes the Centaur seems to have only "game in xx minutes" levels, from 2 to 90 minutes. Very strange.
But in Expert mode it does not adapt its strength, plays at full power.
Anyway indeed hard to test for you.
2024 Special thread: viewtopic.php?f=3&t=12741
2024 Special results and standings: https://schaakcomputers.nl/paul_w/Tourn ... 25_06.html
If I am mistaken, it must be caused by a horizon effect...
User avatar
Lars Sandin
SSDF
Posts: 2234
Joined: Sun Nov 18, 2007 4:24 pm
Location: Sundsvall, Sweden

Re: SSDF Rating list - Last Updated 28th of July 2021

Post by Lars Sandin »

Hi Paul,

How does the Centaur handle the openings when playing on Expert mode? I guess it has an internal opening book which it is following on all modes (even though it seemingly "thinks" and takes some time when playing the moves)? How does it handle variety on Expert Mode? Similar to other chess computers with an opening book or does it play more or less the best move (from book) all the time? Just curious as I haven't seen the computer IRL.

Yes, it will be tough to test it if it doesn't include the level which we need.

Best regards
Lars Sandin, SSDF
User avatar
paulwise3
Senior Member
Posts: 1508
Joined: Tue Jan 06, 2015 10:56 am
Location: Eindhoven, Netherlands

Re: SSDF Rating list - Last Updated 28th of July 2021

Post by paulwise3 »

Hi Lars,

Yes, it seems to deliberately take some time for each move, so not to "frighten" the human opponent with an immediate response ;-).
I do not have the Centaur myself, I get the info from a chess-friend who owns it.
But I will ask him for more info about the opening book.

Regards, Paul
2024 Special thread: viewtopic.php?f=3&t=12741
2024 Special results and standings: https://schaakcomputers.nl/paul_w/Tourn ... 25_06.html
If I am mistaken, it must be caused by a horizon effect...
User avatar
Lars Sandin
SSDF
Posts: 2234
Joined: Sun Nov 18, 2007 4:24 pm
Location: Sundsvall, Sweden

THE SSDF RATING LIST 2022-01-06 - In memory of Guy Haworth

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2022-01-06    158725 games played by  418 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Stockfish 13 x64 1800X 3.6 GHz          3578   42   -38   360   71%  3424
   2 Lc0 0.26.3 Cuda(67362) 3060Ti           3573   29   -27   680   68%  3445
   3 Dragon Komodo 2.51 x64 1800X 3.6 GHz    3569   49   -45   240   66%  3436
   4 Stockfish 12 NNUE x64 1800X 3.6 GHz     3558   30   -29   560   62%  3471
   5 Stockfish 14 x64 1800X 3.6 GHz          3554   51   -48   202   59%  3502
   6 Dragon by Komodo x64 1800X 3.6 GHz      3547   34   -32   460   63%  3456
   7 Stockfish 11 x64 1800X 3.6 GHz          3540   36   -34   450   70%  3398
   8 Stockfish 10 x64 1800X 3.6 GHz          3516   25   -24   880   68%  3383
   9 Dragon Komodo 2 MCTS x64 1800X 3.6 GHz  3482   45   -44   240   55%  3453
  10 Stockfish 9 x64 1800X 3.6 GHz           3477   26   -24   882   70%  3333
  11 Komodo 13.1 x64 1800X 3.6 GHz           3465   30   -29   560   62%  3383
  12 Komodo 14 x64 1800X 3.6 GHz             3464   33   -32   440   55%  3434
  13 Komodo 13.02 x64 1800X 3.6 GHz          3458   30   -29   600   65%  3349
  14 Komodo 12.3 x64 1800X 3.6 GHz           3449   27   -26   760   66%  3332
  15 Stockfish 9 x64 Q6600 2.4 GHz           3441   32   -31   480   56%  3398
  16 Arasan 23.01 x64 1800X 3.6 GHz          3437   45   -44   240   53%  3428
  17 Booot 6.5 x64 1800X 3.6 GHz             3432   48   -50   200   44%  3486
  18 Pedone 3.1 x64 1800X 3.6 GHz            3423   46   -47   220   48%  3420
  19 Dragon Komodo MCTS x64 1800X 3.6 GHz    3415   41   -41   280   52%  3404
  20 Pedone 3 x64 1800X 3.6 GHz              3386   44   -45   240   43%  3436
  21 Wasp 5 x64 1800X 3.6 GHz                3378   63   -73   120   32%  3526
  22 Pedone 3.1 x64 Q6600 2.4 GHZ            3376   45   -43   260   62%  3285
  23 Booot 6.4 x64 1800X 3.6 GHz             3368   36   -36   360   51%  3364
  24 Arasan 22.3 x64 1800X 3.6 GHz           3363   45   -49   240   35%  3467
  25 Booot 6.5 x64 Q6600 2.4 GHz             3359   48   -44   240   63%  3267
  26 Deep Shredder 13 x64 1800X 3.6 GHz      3355   24   -24   880   64%  3255
  27 Marvin 5.1.0 x64 1800X 3.6 GHz          3324   44   -47   240   37%  3416
  28 Pedone 3 x64 Q6600 2.4 GHz              3315   45   -43   247   57%  3263
  29 Booot 6.3.1 x64 Q6600 2.4 GHz           3291   30   -30   520   53%  3268
  30 Vajolet2 2.8 x64 1800X 3.6 GHz          3291   27   -28   650   38%  3376
  31 Arasan 21.2 x64 1800X 3.6 GHz           3285   25   -26   800   36%  3387
  32 Wasp 4.5 x64 1800X 3.6 GHz              3264   64   -83   140   21%  3512
  33 Wasp 4 x64 1800X 3.6 GHz                3255   42   -45   280   33%  3377
  34 Marvin 5.1.0 x64 Q6600 2.4 GHz          3225   56   -58   147   47%  3254
  35 Deep Hiarcs 14 1800X 3.6 GHz            3213   23   -24   880   38%  3298
  36 Deep Rybka 4 x64 Q6600 2.4 GHz          3195   19   -18  1488   63%  3103
  37 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2925   47   -45   228   56%  2882
  38 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2859   24   -25   932   30%  3008
  39 Revelation Hiarcs 13.3 PXA255 500 MHz   2772   57   -52   177   66%  2660
  40 Revelation Shredder 12 PXA255 500 MHz   2705   60   -58   140   56%  2665
  41 Revelation Rybka 2.2 PXA255 500 MHz     2634   45   -43   260   63%  2546
  42 Revelation Deep Sjeng 3 PXA255 500 MHz  2600   62   -67   120   41%  2664
  43 Millennium The King Exclusive 300 MHz   2535   52   -51   180   56%  2495
  44 Revelation Ruffian 2.1 PXA255 500 MHz   2346   68   -71   100   45%  2384
  45 Millennium ChessGenius Excl. M7 300 MHz 2247   54   -51   180   59%  2183
  46 Mephisto London 68030 33 MHz            2194   31   -31   482   50%  2191
  47 Millennium ChessGenius Pro M4 120 MHz   2162   59   -54   160   63%  2066
  48 Mephisto London 68020 12 MHz            2094   67   -60   131   65%  1987
  49 Millennium ChessGenius ARM M4 48 MHz    2069   45   -43   251   58%  2015
  50 Mephisto London 68000 12 MHz            2004   59   -58   140   53%  1981

 3 Dragon Komodo 2.51 x64 1800X 3.6 GHz, 3569											
LC0 3060Ti      19,5-20,5  Stoc14 1800X      20-20    Arasa23 1800X   25,5-14,5
Boo65 1800X       28-12    Wasp5 1800X       31-9     Wasp45 1800X    35,5-4,5 

 5 Stockfish 14 x64 1800X 3.6 GHz, 3554											
LC0 3060Ti        19-21    Dra251 1800X      20-20    SF12NU 1800X    21,5-18,5
Ped31 1800X       26-14    Komo11 1800X       2-0     Arasa22 1800X     31-9 

 16 Arasan 23.01 x64 1800X 3.6 GHz, 3437											
LC0 3060Ti      14,5-25,5  Dra251 1800X    14,5-25,5  Ped31 1800X       19-21
Arasa22 1800X   23,5-16,5  Mar51 1800X     24,5-15,5  Ped21 1800X       31-9 

 17 Booot 6.5 x64 1800X 3.6 GHz, 3432											
Stoc13 1800X    10,5-29,5  LC0 3060Ti        13-27    Dra251 1800X      12-28
Arasa22 1800X     25-15    Mar51 1800X     26,5-13,5  

 18 Pedone 3.1 x64 1800X 3.6 GHz, 3423											
LC0 3060Ti         9-31    Stoc14 1800X      14-26    Arasa23 1800X     21-19
Wasp5 1800X       21-19    Wasp45 1800X      41-19    

 21 Wasp 5 x64 1800X 3.6 GHz, 3378											
LC0 3060Ti        10-30    Dra251 1800X       9-31    Ped31 1800X       19-21

 22 Pedone 3.1 x64 Q6600 2.4 GHZ, 3376											
Komo12 Q6600      18-22    Boo65 Q6600       22-18    DShre13 Q6600     22-18
Arasa21 Q6600   26,5-13,5  Mar51 Q6600     45,5-14,5  DRybka3 Q6600     28-12

 24 Arasan 22.3 x64 1800X 3.6 GHz, 3363											
LC0 3060Ti         8-32    Stoc14 1800X       9-31    Dra2MC 1800X    11,5-28,5
Arasa23 1800X   16,5-23,5  Boo65 1800X       15-25    Mar51 1800X       23-17

 25 Booot 6.5 x64 Q6600 2.4 GHz, 3359											
Ped31 Q6600       18-22    Ped3 Q6600      22,5-17,5  DShre13 Q6600     25-15
Arasa21 Q6600     26-14    Chiro3 Q6600    60,5-19,5  

 27 Marvin 5.1.0 x64 1800X 3.6 GHz, 3324											
LC0 3060Ti         6-34    Ko14 1800X         9-31    Arasa23 1800X   15,5-24,5
Boo65 1800X     13,5-26,5  Arasa22 1800X     17-23    DHiar14 1800X     28-12

 33 Wasp 4.5 x64 1800X 3.6 GHz, 3264											
LC0 3060Ti       5,5-34,5  Dra251 1800X     4,5-35,5  Ped31 1800X       19-41

 35 Marvin 5.1.0 x64 Q6600 2.4 GHz, 3225											
Ped31 Q6600     14,5-45,5  Ped3 Q6600       2,5-4,5   DRybka4 Q6600     24-16
Spike14 Q6600   27,5-12,5  

This last list of 2021 and first list of 2022, will be dedicated in honor of the
late Guy Haworth.
 
On this new years list, we can present seven new programs on our two hardware
levels. 

First one out is Mark Lefler and Larry Kaufman's latest version of Dragon  
Komodo, named 2.51. We have initially tested the non-MCTS version and after 
the first 240 games it has reached a rating of 3569, that is 22 points stronger
than the last non-MCTS Dragon Komodo we tested. It is now just four points 
behind the leader from the last rating list - Lc0. It is also nine points below
Stockfish 13 - which now has taken over the leader spot in the rating list. 
Dragon Komodo 2.51 is now more than 100 points stronger than the best non-NNUE 
version of Komodo we have tested! As before we have used the opening book 
"out10-35.bin" of Erdogan Gunes for the testing of Dragon Komodo.  

Next one out is the latest creation from team Stockfish, namely Stockfish 14. 
After the first 202 games it has reached a rating of 3554, which is 24 points
behind Stockfish 13 in first place, and 4 points behind Stockfish 12.
For the testing of Stockfish 14 we have used the opening book by Fauzi Dabat 
named "Aggressive 5.0 by Fauzi.abk". More games will probably be needed to
stabilise the rating against the other engines in the top, lower the error 
bars and see if it will be able to supersede the older version as more games
are played.

We have also tested two new engines from Jon Dart, named Arasan 22.3 and the 
neural network architecture (NNUE) version named 23.01. For the testing of 
these two engines, we have used Arasan's own opening book. Arasan 22.3 has 
reached the rating of 3363 after the 240 games. This is 78 points stronger 
than the last Arasan 21.2 version we have tested. The NNUE version: 
Arasan 23.01, has then gained a further 74 points on that, resulting in the
rating of 3437 after the first 240 games.

We also have the latest (and last) free Pedone-version in this rating list. 
It is Pedone 3.1 by Fabio Gobbato. Like the 3.0-version of the same program,
it uses NNUE in the search. We have tested it on both our hardware levels. 
On the 1800X - Pedone 3.1 has reached a rating of 3423 after 220 games 
played. On the Q6600 hardware, Pedone 3.1 has achieved a rating of 3376 after
260 games. The difference between the two hardware is 47 points, and 
Pedone 3.1 on the 1800X is 37 points stronger than Pedone 3.0 1800X. 
On the Q6600, the difference between Pedone 3.1 and 3.0 is 53 points. 
We have used Pedone's own opening book for the testing of Pedone 3.1.    

We can also present a rating of Alex Morozov's latest Booot program, named 
Booot 6.5. We have tested this program on two of our hardware levels. On
our 1800X hardware, Booot 6.5 has received a rating of 3432 after 200 games. 
On our Q6600 hardware, Booot 6.5 has reached a rating of 3359 after 240 
games. The difference between the two different hardware is 73 points. 
The 6.5-version is 64 points ahead of the formerly tested Booot 6.4 
on the 1800X and on the Q6600, the difference between Booot 6.5 and 
Booot 6.3.1 is 68 points. We have used Sedat Canbaz's "Perfect2021.abk"
for the testing of Booot 6.5.

We are also able to welcome a Swedish newcomer in this rating list! 
Probably the first Swedish program in the list after Per Ola Valfridsson's - 
Ruffian, I guess?  
It is Martin Danielsson's engine: Marvin 5.1.0, which we have tested on both 
our hardware levels. We have used Marvin's own opening book for the testing. 
Marvin is from the 5.0.0-version a neural network architecture (NNUE)-program.
On our 1800X hardware, Marvin 5.1.0 has reached a rating of 3324 after 
240 games. On the Q6600 hardware, Marvin 5.1.0 has gotten a rating of 
3225 after the first 147 games. The difference between the two hardware is 
just shy of 100 points. 

Last, but not least, is the two Wasp-programs from John Stanback. The first one 
is Wasp 4.5, which uses ordinary search, and has received a rating of 3264 
after the first 140 games. This is nine points ahead of the formerly tested 
Wasp 4. Wasp 5.0 has introduced NNUE in its search. This has proven to be 
valuable for Wasp (as for other NNUE engines), and Wasp 5.0 1800X has 
received a rating of 3378 after the first 120 games. Albeit it's early in 
the testing, the difference between the two versions is now 114 points at 
least!

Lars Sandin        
Lars Sandin, SSDF
Post Reply