mirror of
https://github.com/sockspls/badfish
synced 2025-04-29 16:23:09 +00:00
102 lines
3.3 KiB
Text
102 lines
3.3 KiB
Text
0. Instructions
|
|
===============
|
|
|
|
After test has been completed, replace "TODO" in "Test Data" section with "PASS (Tester name)".
|
|
Tester needs to be someone known by community.
|
|
|
|
1. SF6-rc1:
|
|
===========
|
|
|
|
Bench Signature: 8080602
|
|
Fishtest Regression Test 60+0.05 (1 Threads): +51.71 (Joona Kiiski)
|
|
Fishtest Regression Test 60+0.05 (3 Threads): +48.10 (Joona Kiiski)
|
|
|
|
2.Test Definitions:
|
|
===================
|
|
|
|
2.1. Benchmark test:
|
|
====================
|
|
|
|
"./stockfish bench" returns expected result
|
|
|
|
2.2. Syzygy Analysis test:
|
|
==========================
|
|
|
|
Manual test (using a GUI of your choice) to verify that syzygybases are probed and return expected result.
|
|
FIXME: test positions
|
|
|
|
2.3. Games test:
|
|
================
|
|
|
|
At minimum 5000 games at minimum 15+0.05 time control. SF6-rc1 vs. SF5:
|
|
|
|
Games Completed = 5000 of 5000 (Avg game length = 53.020 sec)
|
|
Settings = Gauntlet/64MB/30000ms+30ms/M 2000cp for 500 moves, D 500 moves/EPD:C:\Little Blitzer2\LittleBlitzer-2.74\double-o.txt(716)
|
|
Time = 34893 sec elapsed, 0 sec remaining
|
|
1. Stockfish 5 2094.5/5000 578-1389-3033 (L: m=1389 t=0 i=0 a=0) (D: r=2305 i=510 f=173 s=45 a=0) (tpm=377.1 d=20.32 nps=1893491)
|
|
2. Stockfish 6 rc1 2905.5/5000 1389-578-3033 (L: m=578 t=0 i=0 a=0) (D: r=2305 i=510 f=173 s=45 a=0) (tpm=379.5 d=19.73 nps=2140936)
|
|
|
|
PASS (Mindbreaker)
|
|
|
|
|
|
3. Test Data:
|
|
=============
|
|
|
|
3.1. Compilers (Benchmark test):
|
|
===============================
|
|
|
|
gcc 4.7, 64-bit: PASS (Joona Kiiski)
|
|
gcc 4.8, 64-bit: PASS (Joona Kiiski)
|
|
gcc 4.9, 64-bit: PASS (Joona Kiiski)
|
|
gcc 4.7, 32-bit: PASS (Eelco de Groot)
|
|
clang 3.5, 64-bit, Ubuntu 14.04.1: PASS (Marco Costalba)
|
|
clang 3.5, 32-bit, Ubuntu 14.04.1: PASS (Marco Costalba)
|
|
icc 14.0.1, 64-bit, Ubuntu 14.04.1: PASS (Marco Costalba)
|
|
icc 14.0.1, 32-bit, Ubuntu 14.04.1: PASS (Marco Costalba)
|
|
MSVC 2013 64-bit: PASS (Marco Costalba)
|
|
MSVC 2013 32-bit: PASS (Marco Costalba)
|
|
MSVC 2010 64-bit: PASS (Marco Costalba)
|
|
MSVC 2010 32-bit: PASS (Marco Costalba)
|
|
mingw 4.8.3 64-bit: (make build debug=yes ARCH=x86-64-modern COMP=mingw): PASS (Marco Costalba)
|
|
mingw 4.8.3 64-bit: (make build debug=yes ARCH=x86-64 COMP=mingw): PASS (Marco Costalba)
|
|
mingw 4.8.3 32-bit: (make build debug=yes ARCH=x86-32 COMP=mingw): PASS (Marco Costalba)
|
|
|
|
3.2 OSes/Architectures (Benchmark test, assume gcc):
|
|
====================================================
|
|
|
|
Mac OSX: Mac OS X 10.10.1 with clang (Daylen Yang)
|
|
Android: TODO
|
|
PPC (or other big-endian): PPC 32-bit on OS X 10.6.8, compiled with gcc 4.2.1 (Daylen Yang)
|
|
Armv8: iOS (Ted Wong)
|
|
|
|
3.3. OSes/Architectures (Syzygy analysis test, assume gcc/mingw):
|
|
=================================================================
|
|
|
|
Windows 64-bit: TODO
|
|
Windows 32-bit: TODO
|
|
Linux 64-bit: PASS (Gary Linscott)
|
|
Linux 32-bit: TODO
|
|
Mac OSX: TODO
|
|
Android: TODO
|
|
Armv8: TODO
|
|
PPC: TODO
|
|
|
|
3.4 Other (Games Testing):
|
|
==========================
|
|
|
|
* Ponder On: TODO
|
|
|
|
* Chess960: SF 6-RC1 vs SF 5: 641 - 349 - 1010 +51 ELO No time losses, no crashes: PASS (Jörg Oster)
|
|
|
|
* Syzygy 5-men: PASS (Dariusz Orzechowski)
|
|
No crashes, no time losses. TC 60+0.05, book 2moves_v1, no adjudication rules, x64-modern compile.
|
|
Stockfish 6 RC1 SYZ 5 - Stockfish 6 RC1 1589.5/3100 580-501-2019
|
|
|
|
* Syzygy 6-men: TODO
|
|
|
|
|
|
|
|
3.5 Perft:
|
|
==========
|
|
|
|
perft7 (starting pos): PASS (Dariusz Orzechowski)
|