OpenBench

OpenBench Testing Framework

Finished
Swedis	Pawnocchio	rfp_deeper4	diff	8.0+0.08	LLR: -0.96 (-2.25, 2.89) [0.00, 4.00] Games: 18810 W: 4767 L: 4753 D: 9290 Ptnml(0-2): 154, 2339, 4399, 2365, 148
Swedis	Pawnocchio	no_recapture_pruning_qs	diff	8.0+0.08	LLR: -0.06 (-2.25, 2.89) [-3.00, 1.00] Games: 5000 W: 1285 L: 1296 D: 2419 Ptnml(0-2): 40, 618, 1197, 603, 42
Swedis	Pawnocchio	new_bucket_layout	diff	8.0+0.08	LLR: -1.98 (-2.25, 2.89) [0.00, 4.00] Games: 1496 W: 351 L: 449 D: 696 Ptnml(0-2): 23, 227, 339, 143, 16
Swedis	Pawnocchio	new_bucket_layout	diff	8.0+0.08	LLR: -1.10 (-2.25, 2.89) [0.00, 4.00] Games: 966 W: 235 L: 287 D: 444 Ptnml(0-2): 12, 144, 218, 102, 7
Swedis	Pawnocchio	no_recapture_pruning_qs	diff	8.0+0.08	LLR: -1.15 (-2.25, 2.89) [0.00, 4.00] Games: 8660 W: 2170 L: 2198 D: 4292 Ptnml(0-2): 78, 1064, 2079, 1026, 83
Swedis	Pawnocchio	find_the_crash	diff	N=200000	Elo: -0.00 +- 0.00 (95%) [N=40000] Games: 5184 W: 1309 L: 1309 D: 2566 Ptnml(0-2): 0, 0, 2592, 0, 0
Swedis	Pawnocchio	find_the_crash	diff	N=5000	Elo: -0.00 +- 0.00 (95%) [N=40000] Games: 17522 W: 6031 L: 6031 D: 5460 Ptnml(0-2): 0, 0, 8761, 0, 0
Swedis	Pawnocchio	find_the_crash	diff	N=25000	Elo: -0.00 +- 0.00 (95%) [N=40000] Games: 17990 W: 4199 L: 4199 D: 9592 Ptnml(0-2): 0, 0, 8995, 0, 0
Swedis	Pawnocchio	hp_deeper	diff	8.0+0.08	LLR: -2.31 (-2.25, 2.89) [0.00, 3.00] Games: 21656 W: 5371 L: 5468 D: 10817 Ptnml(0-2): 187, 2667, 5204, 2596, 174
Swedis	Pawnocchio	rfp_deeper3	diff	40.0+0.40	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 8118 W: 1952 L: 2066 D: 4100 Ptnml(0-2): 24, 998, 2122, 898, 17
Swedis	Pawnocchio	bnfp3	diff	8.0+0.08	LLR: -2.25 (-2.25, 2.89) [0.00, 4.00] Games: 26182 W: 6567 L: 6592 D: 13023 Ptnml(0-2): 229, 3167, 6319, 3152, 224
Swedis	Pawnocchio	dev	diff	8.0+0.08 *	Elo: 158.69 +- 11.25 (95%) [N=1000] Games: 1006 W: 485 L: 55 D: 466 Ptnml(0-2): 0, 6, 113, 332, 52
Swedis	Pawnocchio	[Stormphrax] v5.0.0	diff	40.0+0.40	Elo: 33.67 +- 12.33 (95%) [N=1000] Games: 1004 W: 307 L: 210 D: 487 Ptnml(0-2): 6, 88, 226, 167, 15
Swedis	Pawnocchio	dev	diff	8.0+0.08 *	Elo: 91.70 +- 12.07 (95%) [N=1000] Games: 1004 W: 376 L: 117 D: 511 Ptnml(0-2): 4, 32, 195, 243, 28
Swedis	Pawnocchio	pre_release_changes	diff	8.0+0.08	LLR: 2.93 (-2.25, 2.89) [-5.00, 0.00] Games: 8488 W: 2178 L: 2103 D: 4207 Ptnml(0-2): 56, 904, 2262, 953, 69
Swedis	Pawnocchio	limits_fix	diff	8.0+0.08	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 4954 W: 1394 L: 1201 D: 2359 Ptnml(0-2): 20, 532, 1198, 689, 38
Swedis	Pawnocchio	dev	diff	8.0+0.08 *	Elo: 75.88 +- 11.82 (95%) [N=1000] Games: 1000 W: 364 L: 149 D: 487 Ptnml(0-2): 2, 51, 193, 238, 16
Swedis	Pawnocchio	dev	diff	40.0+0.40	Elo: 53.31 +- 5.52 (95%) [N=4000] Games: 4000 W: 1379 L: 770 D: 1851 Ptnml(0-2): 5, 239, 930, 794, 32
Swedis	Pawnocchio	lmr_ttmove_noisy	diff	8.0+0.08	LLR: -0.32 (-2.25, 2.89) [0.00, 3.00] Games: 3200 W: 866 L: 879 D: 1455 Ptnml(0-2): 30, 379, 792, 372, 27
Swedis	Pawnocchio	net21_1280_take8.nnue	diff	8.0+0.08	LLR: -0.39 (-2.25, 2.89) [0.00, 3.00] Games: 109316 W: 29406 L: 29167 D: 50743 Ptnml(0-2): 892, 13340, 26068, 13353, 1005
Swedis	Pawnocchio	dev	diff	8.0+0.08	Elo: 51.98 +- 7.42 (95%) [N=3000] Games: 3010 W: 1086 L: 639 D: 1285 Ptnml(0-2): 18, 217, 652, 536, 82
Swedis	Pawnocchio	lmrd_see_quiets	diff	8.0+0.08	LLR: 0.07 (-2.25, 2.89) [0.00, 3.00] Games: 12548 W: 3429 L: 3394 D: 5725 Ptnml(0-2): 127, 1480, 3030, 1505, 132
Swedis	Pawnocchio	lmr_shallower	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 4.00] Games: 32358 W: 8573 L: 8579 D: 15206 Ptnml(0-2): 275, 3888, 7854, 3892, 270
Swedis	Pawnocchio	lmrd_see_quiets	diff	40.0+0.40	LLR: -0.63 (-2.25, 2.89) [0.00, 3.00] Games: 1920 W: 454 L: 486 D: 980 Ptnml(0-2): 7, 226, 523, 200, 4
Swedis	Pawnocchio	16_input_buckets	diff	8.0+0.08	LLR: -2.09 (-2.25, 2.89) [0.00, 5.00] Games: 3310 W: 896 L: 968 D: 1446 Ptnml(0-2): 55, 416, 770, 374, 40

1 2 3 4 5 35 36 37