Navers lab
← SWE Refactor Bench

Runs

Every graded run, one row each, nothing aggregated away. The filters compose, the column headers sort, and the last column is the full session log as the harness recorded it.

Graded runs
520

26 configurations

Log records
543,132

messages and tool calls

Tool calls
247,991

across both harnesses

Tokens
28.4B

agent-side, all runs

Trajectories
333 MB

JSONL, one file per run

Model
Effort
Outcome
Category

520 runs · 28 accepted · mean composite 13.44 · 28.39B tokens

Shape
build01 Autotools → CMake claude-opus-5 low partial 6/6 99.6% — 0 26 16.7M 146
build01 Autotools → CMake claude-opus-5 medium partial 6/6 99.7% — 0 51 21.3M 207
build01 Autotools → CMake claude-opus-5 high partial 6/6 99.6% — 0 45 23.2M 202
build01 Autotools → CMake claude-opus-5 xhigh partial 6/6 99.6% — 0 63 28.5M 269
build01 Autotools → CMake claude-opus-5 max partial 6/6 99.5% — 0 78 32.1M 308
build01 Autotools → CMake claude-sonnet-5 low partial 6/6 96.7% — 0 15 10.8M 115
build01 Autotools → CMake claude-sonnet-5 medium partial 6/6 98.9% — 0 36 24.7M 239
build01 Autotools → CMake claude-sonnet-5 high partial 6/6 96.4% — 0 90 41.4M 371
build01 Autotools → CMake claude-sonnet-5 xhigh partial 6/6 95.1% — 0 155 69.6M 599
build01 Autotools → CMake claude-sonnet-5 max partial 6/6 98.7% — 0 87 8.9M 151
build01 Autotools → CMake dsv4-flash max failed 4/6 98.1% — 0 42 33.5M 203
build01 Autotools → CMake glm-5.2 max failed 5/6 99.7% — 0 79 35.3M 271
build01 Autotools → CMake gpt-5.6-luna none partial 6/6 92.8% — 0 10 3.7M 38
build01 Autotools → CMake gpt-5.6-luna low failed 4/6 76.6% — 0 9 1.1M 29
build01 Autotools → CMake gpt-5.6-luna medium failed 5/6 78.1% — 0 22 7.0M 73
build01 Autotools → CMake gpt-5.6-luna high partial 6/6 99.8% — 0 42 16.4M 128
build01 Autotools → CMake gpt-5.6-luna xhigh partial 6/6 99.9% — 0 72 27.0M 184
build01 Autotools → CMake gpt-5.6-luna max partial 6/6 100.0% — 0 87 40.0M 295
build01 Autotools → CMake gpt-5.6-sol none partial 6/6 97.3% — 0 11 6.7M 64
build01 Autotools → CMake gpt-5.6-sol low partial 6/6 98.3% — 0 11 4.3M 52
build01 Autotools → CMake gpt-5.6-sol medium failed 4/6 68.3% — 0 8 2.7M 57
build01 Autotools → CMake gpt-5.6-sol high failed 4/6 97.1% — 0 19 11.0M 128
build01 Autotools → CMake gpt-5.6-sol xhigh partial 6/6 99.6% — 0 82 60.5M 409
build01 Autotools → CMake gpt-5.6-sol max broken 6/6 100.0% 1/6 50 360 292.0M 1936
build01 Autotools → CMake kimi-k3 max broken 6/6 100.0% 2/6 60 27 2.6M 144
build01 Autotools → CMake qwen3.8-max max failed 5/6 0.4% — 0 223 1.1M 61
build02 Maven → Gradle claude-opus-5 low broken 6/6 100.0% 1/6 50 37 16.0M 152
build02 Maven → Gradle claude-opus-5 medium broken 6/6 100.0% 1/6 50 29 11.4M 126
build02 Maven → Gradle claude-opus-5 high broken 6/6 100.0% 1/6 50 50 18.5M 212
build02 Maven → Gradle claude-opus-5 xhigh broken 6/6 100.0% 2/6 60 107 31.9M 314
build02 Maven → Gradle claude-opus-5 max partial 6/6 100.0% — 0 110 21.3M 235
build02 Maven → Gradle claude-sonnet-5 low partial 6/6 99.9% — 0 19 13.6M 135
build02 Maven → Gradle claude-sonnet-5 medium broken 6/6 100.0% 2/6 60 53 17.6M 327
build02 Maven → Gradle claude-sonnet-5 high broken 6/6 100.0% 0/6 40 41 26.9M 257
build02 Maven → Gradle claude-sonnet-5 xhigh partial 6/6 99.9% — 0 69 15.3M 334
build02 Maven → Gradle claude-sonnet-5 max partial 6/6 99.9% — 0 101 27.2M 331
build02 Maven → Gradle dsv4-flash max failed 5/6 95.4% — 0 14 8.0M 83
build02 Maven → Gradle glm-5.2 max broken 6/6 100.0% 2/6 60 89 30.7M 210
build02 Maven → Gradle gpt-5.6-luna none partial 6/6 98.2% — 0 12 4.4M 77
build02 Maven → Gradle gpt-5.6-luna low failed 5/6 99.4% — 0 16 2.9M 73
build02 Maven → Gradle gpt-5.6-luna medium partial 6/6 99.9% — 0 15 10.5M 118
build02 Maven → Gradle gpt-5.6-luna high failed 5/6 99.9% — 0 34 18.6M 147
build02 Maven → Gradle gpt-5.6-luna xhigh broken 6/6 100.0% 0/6 40 30 14.2M 100
build02 Maven → Gradle gpt-5.6-luna max partial 6/6 100.0% — 0 29 14.5M 99
build02 Maven → Gradle gpt-5.6-sol none failed 5/6 99.9% — 0 7 2.9M 55
build02 Maven → Gradle gpt-5.6-sol low failed 5/6 93.7% — 0 4 0.7M 26
build02 Maven → Gradle gpt-5.6-sol medium broken 6/6 100.0% 0/6 40 16 5.1M 106
build02 Maven → Gradle gpt-5.6-sol high broken 6/6 100.0% 3/6 70 23 12.0M 135
build02 Maven → Gradle gpt-5.6-sol xhigh broken 6/6 100.0% 2/6 60 25 9.3M 77
build02 Maven → Gradle gpt-5.6-sol max broken 6/6 100.0% 0/6 40 21 10.1M 88
build02 Maven → Gradle kimi-k3 max broken 6/6 100.0% 0/6 40 240 12.4M 235
build02 Maven → Gradle qwen3.8-max max failed 5/6 0.4% — 0 345 4.5M 113
build03 setuptools → Meson claude-opus-5 low broken 6/6 100.0% 5/6 90 10 7.5M 78
build03 setuptools → Meson claude-opus-5 medium broken 6/6 100.0% 4/6 80 12 6.3M 77
build03 setuptools → Meson claude-opus-5 high accepted 6/6 100.0% 6/6 100 25 11.1M 119
build03 setuptools → Meson claude-opus-5 xhigh accepted 6/6 100.0% 6/6 100 53 23.7M 253
build03 setuptools → Meson claude-opus-5 max accepted 6/6 100.0% 6/6 100 24 5.1M 87
build03 setuptools → Meson claude-sonnet-5 low partial 6/6 99.7% — 0 7 0.6M 14
build03 setuptools → Meson claude-sonnet-5 medium broken 6/6 100.0% 5/6 90 18 8.8M 110
build03 setuptools → Meson claude-sonnet-5 high partial 6/6 99.7% — 0 40 23.4M 225
build03 setuptools → Meson claude-sonnet-5 xhigh accepted 6/6 100.0% 6/6 100 23 19.0M 318
build03 setuptools → Meson claude-sonnet-5 max accepted 6/6 100.0% 6/6 100 10 1.2M 103
build03 setuptools → Meson dsv4-flash max partial 6/6 99.7% — 0 23 9.3M 111
build03 setuptools → Meson glm-5.2 max partial 6/6 99.7% — 0 38 7.9M 97
build03 setuptools → Meson gpt-5.6-luna none broken 6/6 100.0% 4/6 80 7 1.6M 29
build03 setuptools → Meson gpt-5.6-luna low broken 6/6 100.0% 4/6 80 8 0.9M 24
build03 setuptools → Meson gpt-5.6-luna medium blind 4/6 100.0% — 0 10 2.2M 40
build03 setuptools → Meson gpt-5.6-luna high broken 6/6 100.0% 4/6 80 19 4.5M 40
build03 setuptools → Meson gpt-5.6-luna xhigh blind 5/6 100.0% — 0 30 8.4M 73
build03 setuptools → Meson gpt-5.6-luna max broken 6/6 100.0% 4/6 80 38 12.7M 84
build03 setuptools → Meson gpt-5.6-sol none broken 6/6 100.0% 4/6 80 4 1.6M 31
build03 setuptools → Meson gpt-5.6-sol low broken 6/6 100.0% 4/6 80 7 1.7M 34
build03 setuptools → Meson gpt-5.6-sol medium broken 6/6 100.0% 5/6 90 7 2.5M 55
build03 setuptools → Meson gpt-5.6-sol high broken 6/6 100.0% 5/6 90 16 6.0M 71
build03 setuptools → Meson gpt-5.6-sol xhigh broken 6/6 100.0% 4/6 80 28 21.2M 164
build03 setuptools → Meson gpt-5.6-sol max broken 6/6 100.0% 4/6 80 20 9.0M 69
build03 setuptools → Meson kimi-k3 max partial 6/6 99.7% — 0 209 3.8M 102
build03 setuptools → Meson qwen3.8-max max accepted 6/6 100.0% 6/6 100 205 14.5M 195
fw01 Flask → Starlette claude-opus-5 low partial 5/5 99.4% — 0 14 8.1M 217
fw01 Flask → Starlette claude-opus-5 medium partial 5/5 99.4% — 0 38 16.5M 376
fw01 Flask → Starlette claude-opus-5 high partial 5/5 99.9% — 0 130 73.0M 656
fw01 Flask → Starlette claude-opus-5 xhigh partial 5/5 99.2% — 0 144 83.8M 748
fw01 Flask → Starlette claude-opus-5 max partial 5/5 99.9% — 0 142 68.2M 617
fw01 Flask → Starlette claude-sonnet-5 low partial 5/5 90.3% — 0 2 1.8M 180
fw01 Flask → Starlette claude-sonnet-5 medium partial 5/5 90.9% — 0 25 21.5M 417
fw01 Flask → Starlette claude-sonnet-5 high partial 5/5 87.2% — 0 101 48.6M 580
fw01 Flask → Starlette claude-sonnet-5 xhigh partial 5/5 96.7% — 0 236 117.4M 1081
fw01 Flask → Starlette claude-sonnet-5 max partial 5/5 82.5% — 0 40 4.3M 317
fw01 Flask → Starlette dsv4-flash max partial 5/5 99.1% — 0 114 53.0M 390
fw01 Flask → Starlette glm-5.2 max partial 5/5 99.1% — 0 81 69.6M 381
fw01 Flask → Starlette gpt-5.6-luna none partial 5/5 53.7% — 0 9 0.7M 15
fw01 Flask → Starlette gpt-5.6-luna low failed 4/5 68.2% — 0 10 5.9M 104
fw01 Flask → Starlette gpt-5.6-luna medium partial 5/5 76.3% — 0 12 3.9M 52
fw01 Flask → Starlette gpt-5.6-luna high partial 5/5 93.3% — 0 18 20.4M 142
fw01 Flask → Starlette gpt-5.6-luna xhigh partial 5/5 97.5% — 0 45 27.4M 193
fw01 Flask → Starlette gpt-5.6-luna max partial 5/5 99.8% — 0 245 102.4M 748
fw01 Flask → Starlette gpt-5.6-sol none partial 5/5 93.9% — 0 10 5.0M 55
fw01 Flask → Starlette gpt-5.6-sol low partial 5/5 94.9% — 0 15 7.2M 85
fw01 Flask → Starlette gpt-5.6-sol medium partial 5/5 98.5% — 0 24 15.5M 135
fw01 Flask → Starlette gpt-5.6-sol high partial 5/5 98.4% — 0 27 20.0M 153
fw01 Flask → Starlette gpt-5.6-sol xhigh partial 5/5 98.8% — 0 58 33.0M 239
fw01 Flask → Starlette gpt-5.6-sol max partial 5/5 99.2% — 0 69 36.5M 269
fw01 Flask → Starlette kimi-k3 max partial 5/5 99.7% — 0 331 38.3M 285
fw01 Flask → Starlette qwen3.8-max max blind 2/5 100.0% — 0 453 22.4M 190
fw02 Express → Fastify claude-opus-5 low failed 4/5 99.3% — 0 67 43.0M 552
fw02 Express → Fastify claude-opus-5 medium failed 4/5 99.8% — 0 119 79.3M 793
fw02 Express → Fastify claude-opus-5 high partial 5/5 99.3% — 0 183 60.4M 763
fw02 Express → Fastify claude-opus-5 xhigh partial 5/5 100.0% — 0 393 131.2M 1242
fw02 Express → Fastify claude-opus-5 max failed 4/5 99.5% — 0 145 56.6M 593
fw02 Express → Fastify claude-sonnet-5 low partial 5/5 90.5% — 0 48 29.8M 319
fw02 Express → Fastify claude-sonnet-5 medium failed 3/5 87.0% — 0 123 51.6M 657
fw02 Express → Fastify claude-sonnet-5 high failed 4/5 92.1% — 0 235 74.0M 746
fw02 Express → Fastify claude-sonnet-5 xhigh failed 2/5 0.2% — 0 358 83.8M 1140
fw02 Express → Fastify claude-sonnet-5 max failed 4/5 92.9% — 0 174 17.7M 455
fw02 Express → Fastify dsv4-flash max failed 4/5 97.7% — 0 61 52.2M 389
fw02 Express → Fastify glm-5.2 max failed 4/5 97.4% — 0 96 50.9M 326
fw02 Express → Fastify gpt-5.6-luna none failed 4/5 36.6% — 0 4 2.1M 41
fw02 Express → Fastify gpt-5.6-luna low failed 4/5 0.1% — 0 32 6.8M 102
fw02 Express → Fastify gpt-5.6-luna medium partial 5/5 88.7% — 0 21 12.4M 140
fw02 Express → Fastify gpt-5.6-luna high partial 5/5 94.8% — 0 41 14.7M 115
fw02 Express → Fastify gpt-5.6-luna xhigh partial 5/5 98.8% — 0 111 51.5M 423
fw02 Express → Fastify gpt-5.6-luna max partial 5/5 99.4% — 0 177 55.8M 399
fw02 Express → Fastify gpt-5.6-sol none partial 5/5 95.2% — 0 10 3.0M 52
fw02 Express → Fastify gpt-5.6-sol low partial 5/5 95.0% — 0 9 2.1M 43
fw02 Express → Fastify gpt-5.6-sol medium partial 5/5 96.9% — 0 16 6.6M 84
fw02 Express → Fastify gpt-5.6-sol high partial 5/5 97.9% — 0 27 13.0M 102
fw02 Express → Fastify gpt-5.6-sol xhigh partial 5/5 99.6% — 0 33 17.9M 140
fw02 Express → Fastify gpt-5.6-sol max partial 5/5 99.9% — 0 105 53.6M 450
fw02 Express → Fastify kimi-k3 max failed 4/5 98.9% — 0 391 35.0M 243
fw02 Express → Fastify qwen3.8-max max blind 3/5 100.0% — 0 413 7.8M 163
fw03 Vue → React claude-opus-5 low broken 5/5 100.0% 3/6 70 34 19.7M 209
fw03 Vue → React claude-opus-5 medium accepted 5/5 100.0% 6/6 100 66 31.7M 384
fw03 Vue → React claude-opus-5 high broken 5/5 100.0% 5/6 90 90 40.9M 411
fw03 Vue → React claude-opus-5 xhigh accepted 5/5 100.0% 6/6 100 132 39.3M 434
fw03 Vue → React claude-opus-5 max broken 5/5 100.0% 4/6 80 111 60.8M 595
fw03 Vue → React claude-sonnet-5 low partial 5/5 91.8% — 0 4 5.3M 268
fw03 Vue → React claude-sonnet-5 medium partial 5/5 98.1% — 0 48 37.2M 392
fw03 Vue → React claude-sonnet-5 high partial 5/5 99.8% — 0 104 51.2M 512
fw03 Vue → React claude-sonnet-5 xhigh partial 5/5 99.7% — 0 103 44.3M 510
fw03 Vue → React claude-sonnet-5 max partial 5/5 99.8% — 0 138 17.2M 439
fw03 Vue → React dsv4-flash max partial 5/5 98.7% — 0 111 36.6M 334
fw03 Vue → React glm-5.2 max partial 5/5 100.0% — 0 106 52.0M 310
fw03 Vue → React gpt-5.6-luna none partial 5/5 73.5% — 0 15 8.0M 95
fw03 Vue → React gpt-5.6-luna low partial 5/5 66.0% — 0 39 15.8M 192
fw03 Vue → React gpt-5.6-luna medium partial 5/5 93.6% — 0 15 5.6M 79
fw03 Vue → React gpt-5.6-luna high partial 5/5 99.9% — 0 34 9.0M 81
fw03 Vue → React gpt-5.6-luna xhigh partial 5/5 100.0% — 0 22 15.0M 115
fw03 Vue → React gpt-5.6-luna max partial 5/5 100.0% — 0 54 19.8M 137
fw03 Vue → React gpt-5.6-sol none partial 5/5 99.6% — 0 13 5.7M 70
fw03 Vue → React gpt-5.6-sol low partial 5/5 99.9% — 0 16 5.2M 86
fw03 Vue → React gpt-5.6-sol medium partial 5/5 99.9% — 0 20 6.6M 99
fw03 Vue → React gpt-5.6-sol high partial 5/5 100.0% — 0 23 9.6M 97
fw03 Vue → React gpt-5.6-sol xhigh partial 5/5 99.9% — 0 26 11.2M 98
fw03 Vue → React gpt-5.6-sol max partial 5/5 100.0% — 0 47 18.0M 154
fw03 Vue → React kimi-k3 max partial 5/5 100.0% — 0 238 24.2M 220
fw03 Vue → React qwen3.8-max max partial 5/5 0.0% — 0 546 15.0M 204
fw04 Gin → chi claude-opus-5 low partial 5/5 99.6% — 0 63 42.5M 395
fw04 Gin → chi claude-opus-5 medium broken 5/5 100.0% 5/6 90 71 29.7M 298
fw04 Gin → chi claude-opus-5 high accepted 5/5 100.0% 6/6 100 58 27.9M 413
fw04 Gin → chi claude-opus-5 xhigh accepted 5/5 100.0% 6/6 100 121 40.4M 406
fw04 Gin → chi claude-opus-5 max broken 5/5 100.0% 5/6 90 187 86.1M 937
fw04 Gin → chi claude-sonnet-5 low partial 5/5 99.4% — 0 36 22.6M 228
fw04 Gin → chi claude-sonnet-5 medium partial 5/5 99.4% — 0 53 23.7M 223
fw04 Gin → chi claude-sonnet-5 high partial 5/5 99.6% — 0 137 45.6M 413
fw04 Gin → chi claude-sonnet-5 xhigh partial 5/5 85.1% — 0 114 39.0M 519
fw04 Gin → chi claude-sonnet-5 max partial 5/5 99.6% — 0 46 7.1M 263
fw04 Gin → chi dsv4-flash max broken 5/5 100.0% 4/6 80 209 87.6M 692
fw04 Gin → chi glm-5.2 max partial 5/5 99.9% — 0 112 39.1M 267
fw04 Gin → chi gpt-5.6-luna none partial 5/5 99.2% — 0 97 101.7M 481
fw04 Gin → chi gpt-5.6-luna low partial 5/5 96.0% — 0 14 6.2M 81
fw04 Gin → chi gpt-5.6-luna medium partial 5/5 99.3% — 0 16 8.7M 99
fw04 Gin → chi gpt-5.6-luna high partial 5/5 99.5% — 0 24 15.6M 99
fw04 Gin → chi gpt-5.6-luna xhigh partial 5/5 99.5% — 0 30 20.8M 131
fw04 Gin → chi gpt-5.6-luna max partial 5/5 99.7% — 0 107 44.0M 318
fw04 Gin → chi gpt-5.6-sol none partial 5/5 96.8% — 0 7 3.9M 69
fw04 Gin → chi gpt-5.6-sol low partial 5/5 93.4% — 0 4 1.1M 29
fw04 Gin → chi gpt-5.6-sol medium partial 5/5 99.6% — 0 23 13.5M 119
fw04 Gin → chi gpt-5.6-sol high partial 5/5 99.6% — 0 21 10.3M 124
fw04 Gin → chi gpt-5.6-sol xhigh partial 5/5 99.6% — 0 51 34.7M 261
fw04 Gin → chi gpt-5.6-sol max accepted 5/5 100.0% 6/6 100 720 457.7M 3315
fw04 Gin → chi kimi-k3 max partial 5/5 99.6% — 0 400 34.2M 327
fw04 Gin → chi qwen3.8-max max blind 2/5 100.0% — 0 595 9.5M 152
fw05 actix-web → axum claude-opus-5 low partial 6/6 99.5% — 0 124 69.7M 633
fw05 actix-web → axum claude-opus-5 medium partial 6/6 99.6% — 0 156 87.5M 799
fw05 actix-web → axum claude-opus-5 high partial 6/6 99.6% — 0 245 114.2M 1125
fw05 actix-web → axum claude-opus-5 xhigh partial 6/6 99.9% — 0 206 65.4M 649
fw05 actix-web → axum claude-opus-5 max broken 6/6 100.0% 2/6 60 271 100.8M 1043
fw05 actix-web → axum claude-sonnet-5 low partial 6/6 98.4% — 0 59 46.2M 403
fw05 actix-web → axum claude-sonnet-5 medium partial 6/6 97.8% — 0 42 18.1M 572
fw05 actix-web → axum claude-sonnet-5 high failed 2/6 0.0% — 0 387 119.8M 1212
fw05 actix-web → axum claude-sonnet-5 xhigh failed 2/6 0.0% — 0 346 124.8M 1337
fw05 actix-web → axum claude-sonnet-5 max partial 6/6 99.1% — 0 258 40.3M 522
fw05 actix-web → axum dsv4-flash max partial 6/6 99.1% — 0 171 82.7M 629
fw05 actix-web → axum glm-5.2 max partial 6/6 98.3% — 0 129 74.8M 381
fw05 actix-web → axum gpt-5.6-luna none partial 6/6 90.1% — 0 56 35.2M 226
fw05 actix-web → axum gpt-5.6-luna low partial 6/6 75.1% — 0 119 70.0M 449
fw05 actix-web → axum gpt-5.6-luna medium partial 6/6 95.6% — 0 32 33.4M 260
fw05 actix-web → axum gpt-5.6-luna high partial 6/6 95.1% — 0 42 25.7M 189
fw05 actix-web → axum gpt-5.6-luna xhigh partial 6/6 98.3% — 0 47 18.1M 133
fw05 actix-web → axum gpt-5.6-luna max partial 6/6 99.0% — 0 85 61.5M 446
fw05 actix-web → axum gpt-5.6-sol none partial 6/6 95.9% — 0 11 5.1M 62
fw05 actix-web → axum gpt-5.6-sol low failed 5/6 9.9% — 0 3 1.6M 48
fw05 actix-web → axum gpt-5.6-sol medium partial 6/6 97.0% — 0 15 8.1M 94
fw05 actix-web → axum gpt-5.6-sol high partial 6/6 98.7% — 0 21 14.3M 125
fw05 actix-web → axum gpt-5.6-sol xhigh partial 6/6 98.5% — 0 94 67.8M 482
fw05 actix-web → axum gpt-5.6-sol max partial 6/6 99.8% — 0 112 48.0M 360
fw05 actix-web → axum kimi-k3 max partial 6/6 99.9% — 0 298 37.1M 237
fw05 actix-web → axum qwen3.8-max max blind 2/6 100.0% — 0 414 23.6M 207
fw06 gorilla/mux → net/http claude-opus-5 low accepted 6/6 100.0% 6/6 100 13 8.7M 97
fw06 gorilla/mux → net/http claude-opus-5 medium accepted 6/6 100.0% 6/6 100 19 10.6M 96
fw06 gorilla/mux → net/http claude-opus-5 high accepted 6/6 100.0% 6/6 100 1 1.3M 111
fw06 gorilla/mux → net/http claude-opus-5 xhigh accepted 6/6 100.0% 6/6 100 36 15.4M 141
fw06 gorilla/mux → net/http claude-opus-5 max accepted 6/6 100.0% 6/6 100 43 12.4M 125
fw06 gorilla/mux → net/http claude-sonnet-5 low blind 5/6 100.0% — 0 31 23.6M 215
fw06 gorilla/mux → net/http claude-sonnet-5 medium accepted 6/6 100.0% 6/6 100 54 17.0M 168
fw06 gorilla/mux → net/http claude-sonnet-5 high blind 5/6 100.0% — 0 98 28.1M 272
fw06 gorilla/mux → net/http claude-sonnet-5 xhigh blind 5/6 100.0% — 0 65 12.6M 138
fw06 gorilla/mux → net/http claude-sonnet-5 max blind 5/6 100.0% — 0 11 1.5M 88
fw06 gorilla/mux → net/http dsv4-flash max blind 5/6 100.0% — 0 17 5.3M 61
fw06 gorilla/mux → net/http glm-5.2 max blind 5/6 100.0% — 0 32 7.3M 80
fw06 gorilla/mux → net/http gpt-5.6-luna none failed 4/6 92.4% — 0 2 0.2M 10
fw06 gorilla/mux → net/http gpt-5.6-luna low failed 5/6 97.5% — 0 2 0.2M 10
fw06 gorilla/mux → net/http gpt-5.6-luna medium failed 5/6 98.4% — 0 7 0.8M 25
fw06 gorilla/mux → net/http gpt-5.6-luna high blind 5/6 100.0% — 0 17 1.7M 33
fw06 gorilla/mux → net/http gpt-5.6-luna xhigh broken 6/6 100.0% 3/6 70 10 2.3M 32
fw06 gorilla/mux → net/http gpt-5.6-luna max broken 6/6 100.0% 1/6 50 18 2.7M 32
fw06 gorilla/mux → net/http gpt-5.6-sol none failed 5/6 92.8% — 0 1 0.2M 8
fw06 gorilla/mux → net/http gpt-5.6-sol low broken 6/6 100.0% 2/6 60 3 0.5M 17
fw06 gorilla/mux → net/http gpt-5.6-sol medium blind 5/6 100.0% — 0 3 0.5M 14
fw06 gorilla/mux → net/http gpt-5.6-sol high broken 6/6 100.0% 0/6 40 5 1.2M 23
fw06 gorilla/mux → net/http gpt-5.6-sol xhigh blind 5/6 100.0% — 0 15 3.8M 71
fw06 gorilla/mux → net/http gpt-5.6-sol max accepted 6/6 100.0% 6/6 100 39 12.1M 130
fw06 gorilla/mux → net/http kimi-k3 max accepted 6/6 100.0% 6/6 100 32 2.1M 72
fw06 gorilla/mux → net/http qwen3.8-max max accepted 6/6 100.0% 6/6 100 180 10.7M 120
fw07 Dropwizard → Spring Boot claude-opus-5 low partial 7/7 7.1% — 0 117 62.2M 780
fw07 Dropwizard → Spring Boot claude-opus-5 medium partial 7/7 7.1% — 0 91 45.8M 566
fw07 Dropwizard → Spring Boot claude-opus-5 high partial 7/7 7.1% — 0 249 126.3M 1379
fw07 Dropwizard → Spring Boot claude-opus-5 xhigh partial 7/7 7.1% — 0 809 255.9M 2620
fw07 Dropwizard → Spring Boot claude-opus-5 max partial 7/7 7.1% — 0 238 83.0M 1031
fw07 Dropwizard → Spring Boot claude-sonnet-5 low failed 2/7 7.1% — 0 15 0.7M 20
fw07 Dropwizard → Spring Boot claude-sonnet-5 medium partial 7/7 7.1% — 0 201 85.4M 931
fw07 Dropwizard → Spring Boot claude-sonnet-5 high partial 7/7 7.1% — 0 452 123.2M 1955
fw07 Dropwizard → Spring Boot claude-sonnet-5 xhigh failed 2/7 7.1% — 0 669 116.2M 2289
fw07 Dropwizard → Spring Boot claude-sonnet-5 max failed 6/7 7.1% — 0 126 13.7M 475
fw07 Dropwizard → Spring Boot dsv4-flash max failed 6/7 7.1% — 0 114 108.1M 919
fw07 Dropwizard → Spring Boot glm-5.2 max partial 7/7 7.1% — 0 107 57.6M 348
fw07 Dropwizard → Spring Boot gpt-5.6-luna none blind 2/7 100.0% — 0 4 1.9M 31
fw07 Dropwizard → Spring Boot gpt-5.6-luna low blind 2/7 100.0% — 0 10 4.4M 59
fw07 Dropwizard → Spring Boot gpt-5.6-luna medium failed 5/7 29.2% — 0 103 51.5M 416
fw07 Dropwizard → Spring Boot gpt-5.6-luna high failed 6/7 18.6% — 0 149 62.8M 436
fw07 Dropwizard → Spring Boot gpt-5.6-luna xhigh failed 6/7 29.2% — 0 93 53.5M 373
fw07 Dropwizard → Spring Boot gpt-5.6-luna max failed 6/7 87.6% — 0 255 137.4M 1001
fw07 Dropwizard → Spring Boot gpt-5.6-sol none failed 6/7 16.8% — 0 48 46.6M 395
fw07 Dropwizard → Spring Boot gpt-5.6-sol low failed 6/7 26.5% — 0 54 48.5M 368
fw07 Dropwizard → Spring Boot gpt-5.6-sol medium failed 5/7 12.4% — 0 11 3.7M 91
fw07 Dropwizard → Spring Boot gpt-5.6-sol high failed 5/7 24.8% — 0 69 60.8M 476
fw07 Dropwizard → Spring Boot gpt-5.6-sol xhigh failed 5/7 57.5% — 0 159 162.1M 1091
fw07 Dropwizard → Spring Boot gpt-5.6-sol max partial 7/7 20.4% — 0 79 43.3M 332
fw07 Dropwizard → Spring Boot kimi-k3 max failed 6/7 68.1% — 0 251 42.5M 434
fw07 Dropwizard → Spring Boot qwen3.8-max max failed 2/7 11.5% — 0 757 33.0M 271
lang01 C → Rust claude-opus-5 low failed 7/8 100.0% — 0 102 66.5M 990
lang01 C → Rust claude-opus-5 medium blind 7/8 100.0% — 0 122 52.2M 488
lang01 C → Rust claude-opus-5 high blind 7/8 100.0% — 0 205 90.7M 892
lang01 C → Rust claude-opus-5 xhigh blind 7/8 100.0% — 0 245 94.2M 885
lang01 C → Rust claude-opus-5 max blind 7/8 100.0% — 0 193 98.2M 1205
lang01 C → Rust claude-sonnet-5 low failed 7/8 0.3% — 0 8 9.4M 324
lang01 C → Rust claude-sonnet-5 medium failed 7/8 0.2% — 0 199 75.0M 922
lang01 C → Rust claude-sonnet-5 high blind 7/8 100.0% — 0 378 82.3M 1040
lang01 C → Rust claude-sonnet-5 xhigh failed 7/8 100.0% — 0 401 117.3M 1349
lang01 C → Rust claude-sonnet-5 max failed 7/8 100.0% — 0 195 39.5M 690
lang01 C → Rust dsv4-flash max failed 7/8 99.9% — 0 186 94.9M 739
lang01 C → Rust glm-5.2 max failed 7/8 0.3% — 0 95 28.5M 310
lang01 C → Rust gpt-5.6-luna none failed 7/8 1.2% — 0 240 161.2M 562
lang01 C → Rust gpt-5.6-luna low failed 6/8 1.1% — 0 877 454.0M 2427
lang01 C → Rust gpt-5.6-luna medium partial 8/8 1.1% — 0 256 125.7M 660
lang01 C → Rust gpt-5.6-luna high failed 7/8 1.1% — 0 135 85.6M 651
lang01 C → Rust gpt-5.6-luna xhigh partial 8/8 94.6% — 0 709 339.9M 2491
lang01 C → Rust gpt-5.6-luna max partial 8/8 1.3% — 0 289 148.5M 1016
lang01 C → Rust gpt-5.6-sol none failed 4/8 0.5% — 0 4 0.9M 33
lang01 C → Rust gpt-5.6-sol low partial 8/8 59.1% — 0 111 67.7M 531
lang01 C → Rust gpt-5.6-sol medium failed 1/8 99.6% — 0 7 1.8M 69
lang01 C → Rust gpt-5.6-sol high failed 6/8 1.1% — 0 14 7.1M 131
lang01 C → Rust gpt-5.6-sol xhigh partial 8/8 0.3% — 0 47 26.8M 230
lang01 C → Rust gpt-5.6-sol max partial 8/8 99.9% — 0 86 34.5M 273
lang01 C → Rust kimi-k3 max failed 7/8 100.0% — 0 532 85.3M 406
lang01 C → Rust qwen3.8-max max failed 7/8 0.3% — 0 309 208.8M 562
lang02 C → Java claude-opus-5 low partial 10/10 99.1% — 0 68 31.5M 294
lang02 C → Java claude-opus-5 medium broken 10/10 100.0% 4/6 80 136 84.9M 1096
lang02 C → Java claude-opus-5 high broken 10/10 100.0% 3/6 70 120 57.7M 578
lang02 C → Java claude-opus-5 xhigh broken 10/10 100.0% 5/6 90 174 59.5M 585
lang02 C → Java claude-opus-5 max partial 10/10 98.2% — 0 148 57.3M 645
lang02 C → Java claude-sonnet-5 low partial 10/10 99.7% — 0 44 1.0M 20
lang02 C → Java claude-sonnet-5 medium partial 10/10 1.9% — 0 100 26.7M 428
lang02 C → Java claude-sonnet-5 high partial 10/10 97.6% — 0 268 63.6M 799
lang02 C → Java claude-sonnet-5 xhigh partial 10/10 99.9% — 0 404 83.4M 867
lang02 C → Java claude-sonnet-5 max partial 10/10 100.0% — 0 301 93.2M 719
lang02 C → Java dsv4-flash max partial 10/10 96.4% — 0 274 129.0M 930
lang02 C → Java glm-5.2 max failed 9/10 93.9% — 0 109 96.8M 412
lang02 C → Java gpt-5.6-luna none failed 8/10 3.4% — 0 328 202.5M 675
lang02 C → Java gpt-5.6-luna low failed 8/10 2.1% — 0 46 10.2M 115
lang02 C → Java gpt-5.6-luna medium partial 10/10 3.8% — 0 38 20.6M 162
lang02 C → Java gpt-5.6-luna high partial 10/10 42.4% — 0 78 49.3M 421
lang02 C → Java gpt-5.6-luna xhigh partial 10/10 0.5% — 0 266 160.3M 1122
lang02 C → Java gpt-5.6-luna max partial 10/10 99.5% — 0 333 162.4M 1113
lang02 C → Java gpt-5.6-sol none failed 8/10 1.7% — 0 2 0.2M 10
lang02 C → Java gpt-5.6-sol low failed 9/10 67.8% — 0 83 41.6M 344
lang02 C → Java gpt-5.6-sol medium failed 8/10 2.7% — 0 8 1.4M 41
lang02 C → Java gpt-5.6-sol high partial 10/10 66.7% — 0 37 17.8M 126
lang02 C → Java gpt-5.6-sol xhigh failed 9/10 9.2% — 0 45 26.6M 226
lang02 C → Java gpt-5.6-sol max failed 8/10 42.7% — 0 1176 661.3M 4600
lang02 C → Java kimi-k3 max broken 10/10 100.0% 5/6 90 524 86.0M 323
lang02 C → Java qwen3.8-max max partial 10/10 99.3% — 0 298 97.6M 273
lang03 Python → Go claude-opus-5 low partial 8/8 96.9% — 0 120 72.5M 655
lang03 Python → Go claude-opus-5 medium partial 8/8 96.1% — 0 132 62.3M 775
lang03 Python → Go claude-opus-5 high partial 8/8 95.3% — 0 144 76.0M 824
lang03 Python → Go claude-opus-5 xhigh partial 8/8 97.4% — 0 230 87.0M 807
lang03 Python → Go claude-opus-5 max failed 7/8 88.7% — 0 353 171.8M 1697
lang03 Python → Go claude-sonnet-5 low failed 6/8 84.3% — 0 60 52.1M 634
lang03 Python → Go claude-sonnet-5 medium failed 7/8 82.6% — 0 163 34.3M 611
lang03 Python → Go claude-sonnet-5 high failed 6/8 94.3% — 0 567 121.6M 1164
lang03 Python → Go claude-sonnet-5 xhigh failed 2/8 3.4% — 0 415 63.1M 612
lang03 Python → Go claude-sonnet-5 max partial 8/8 84.9% — 0 223 41.0M 743
lang03 Python → Go dsv4-flash max failed 7/8 76.9% — 0 166 95.3M 658
lang03 Python → Go glm-5.2 max failed 7/8 76.0% — 0 114 122.8M 459
lang03 Python → Go gpt-5.6-luna none failed 7/8 39.0% — 0 88 103.6M 544
lang03 Python → Go gpt-5.6-luna low failed 7/8 28.5% — 0 29 6.5M 112
lang03 Python → Go gpt-5.6-luna medium partial 8/8 53.1% — 0 40 34.2M 284
lang03 Python → Go gpt-5.6-luna high partial 8/8 72.5% — 0 187 76.6M 540
lang03 Python → Go gpt-5.6-luna xhigh partial 8/8 79.5% — 0 347 205.1M 1539
lang03 Python → Go gpt-5.6-luna max partial 8/8 84.9% — 0 183 99.3M 682
lang03 Python → Go gpt-5.6-sol none failed 7/8 25.2% — 0 6 0.7M 19
lang03 Python → Go gpt-5.6-sol low partial 8/8 66.5% — 0 41 22.8M 208
lang03 Python → Go gpt-5.6-sol medium partial 8/8 74.3% — 0 28 13.2M 118
lang03 Python → Go gpt-5.6-sol high failed 7/8 31.1% — 0 10 3.2M 72
lang03 Python → Go gpt-5.6-sol xhigh partial 8/8 55.5% — 0 57 42.7M 338
lang03 Python → Go gpt-5.6-sol max partial 8/8 85.8% — 0 479 383.6M 2694
lang03 Python → Go kimi-k3 max partial 8/8 78.0% — 0 466 69.5M 428
lang03 Python → Go qwen3.8-max max failed 7/8 83.0% — 0 769 75.9M 379
lang04 JavaScript → Rust claude-opus-5 low partial 7/7 93.3% — 0 161 82.2M 790
lang04 JavaScript → Rust claude-opus-5 medium partial 7/7 95.1% — 0 88 42.1M 557
lang04 JavaScript → Rust claude-opus-5 high partial 7/7 97.5% — 0 127 66.0M 788
lang04 JavaScript → Rust claude-opus-5 xhigh partial 7/7 95.8% — 0 640 295.4M 3363
lang04 JavaScript → Rust claude-opus-5 max partial 7/7 87.8% — 0 375 151.9M 1596
lang04 JavaScript → Rust claude-sonnet-5 low partial 7/7 0.3% — 0 88 7.9M 138
lang04 JavaScript → Rust claude-sonnet-5 medium partial 7/7 0.0% — 0 193 99.5M 1214
lang04 JavaScript → Rust claude-sonnet-5 high partial 7/7 96.7% — 0 798 212.7M 2549
lang04 JavaScript → Rust claude-sonnet-5 xhigh partial 7/7 90.7% — 0 1246 300.5M 3237
lang04 JavaScript → Rust claude-sonnet-5 max failed 4/7 0.0% — 0 1093 161.0M 4351
lang04 JavaScript → Rust dsv4-flash max partial 7/7 93.7% — 0 239 133.5M 1043
lang04 JavaScript → Rust glm-5.2 max partial 7/7 80.6% — 0 93 101.3M 354
lang04 JavaScript → Rust gpt-5.6-luna none partial 7/7 31.2% — 0 416 286.4M 1443
lang04 JavaScript → Rust gpt-5.6-luna low partial 7/7 0.8% — 0 47 15.2M 160
lang04 JavaScript → Rust gpt-5.6-luna medium partial 7/7 39.5% — 0 294 166.1M 763
lang04 JavaScript → Rust gpt-5.6-luna high partial 7/7 48.0% — 0 115 90.6M 670
lang04 JavaScript → Rust gpt-5.6-luna xhigh failed 6/7 79.4% — 0 467 501.9M 3150
lang04 JavaScript → Rust gpt-5.6-luna max partial 7/7 84.0% — 0 556 374.5M 2414
lang04 JavaScript → Rust gpt-5.6-sol none failed 4/7 0.1% — 0 2 0.3M 13
lang04 JavaScript → Rust gpt-5.6-sol low failed 6/7 0.1% — 0 3 0.4M 18
lang04 JavaScript → Rust gpt-5.6-sol medium failed 6/7 0.1% — 0 5 0.8M 33
lang04 JavaScript → Rust gpt-5.6-sol high partial 7/7 65.5% — 0 77 35.6M 272
lang04 JavaScript → Rust gpt-5.6-sol xhigh partial 7/7 36.1% — 0 51 41.8M 331
lang04 JavaScript → Rust gpt-5.6-sol max failed 6/7 87.8% — 0 1797 640.8M 4255
lang04 JavaScript → Rust kimi-k3 max partial 7/7 97.3% — 0 486 86.3M 327
lang04 JavaScript → Rust qwen3.8-max max partial 7/7 99.3% — 0 406 193.0M 484
lang05 Go → Zig claude-opus-5 low partial 8/8 100.0% — 0 45 24.6M 218
lang05 Go → Zig claude-opus-5 medium broken 8/8 100.0% 3/6 70 49 25.5M 364
lang05 Go → Zig claude-opus-5 high broken 8/8 100.0% 4/6 80 115 48.1M 552
lang05 Go → Zig claude-opus-5 xhigh broken 8/8 100.0% 4/6 80 105 40.1M 369
lang05 Go → Zig claude-opus-5 max accepted 8/8 100.0% 6/6 100 170 74.4M 734
lang05 Go → Zig claude-sonnet-5 low partial 8/8 78.0% — 0 102 20.6M 246
lang05 Go → Zig claude-sonnet-5 medium partial 8/8 86.6% — 0 87 32.6M 359
lang05 Go → Zig claude-sonnet-5 high partial 8/8 92.8% — 0 479 105.5M 1330
lang05 Go → Zig claude-sonnet-5 xhigh partial 8/8 99.1% — 0 494 90.1M 1026
lang05 Go → Zig claude-sonnet-5 max partial 8/8 93.0% — 0 273 40.4M 652
lang05 Go → Zig dsv4-flash max partial 8/8 99.9% — 0 126 48.3M 391
lang05 Go → Zig glm-5.2 max partial 8/8 99.8% — 0 54 37.6M 171
lang05 Go → Zig gpt-5.6-luna none partial 8/8 15.7% — 0 159 115.9M 495
lang05 Go → Zig gpt-5.6-luna low failed 7/8 0.2% — 0 24 5.8M 83
lang05 Go → Zig gpt-5.6-luna medium failed 7/8 0.1% — 0 13 3.0M 58
lang05 Go → Zig gpt-5.6-luna high failed 7/8 60.6% — 0 55 28.0M 201
lang05 Go → Zig gpt-5.6-luna xhigh partial 8/8 82.4% — 0 235 88.5M 706
lang05 Go → Zig gpt-5.6-luna max partial 8/8 84.4% — 0 123 104.0M 644
lang05 Go → Zig gpt-5.6-sol none failed 7/8 2.4% — 0 3 1.6M 71
lang05 Go → Zig gpt-5.6-sol low failed 7/8 0.3% — 0 3 0.5M 20
lang05 Go → Zig gpt-5.6-sol medium failed 7/8 11.1% — 0 8 2.0M 41
lang05 Go → Zig gpt-5.6-sol high failed 7/8 43.2% — 0 15 6.0M 89
lang05 Go → Zig gpt-5.6-sol xhigh partial 8/8 58.9% — 0 42 30.4M 269
lang05 Go → Zig gpt-5.6-sol max failed 7/8 90.7% — 0 1200 753.5M 5042
lang05 Go → Zig kimi-k3 max partial 8/8 100.0% — 0 272 38.2M 180
lang05 Go → Zig qwen3.8-max max partial 8/8 100.0% — 0 216 54.7M 217
lang06 C++ → C# claude-opus-5 low partial 9/9 99.8% — 0 113 53.8M 519
lang06 C++ → C# claude-opus-5 medium partial 9/9 99.9% — 0 148 76.7M 755
lang06 C++ → C# claude-opus-5 high blind 8/9 100.0% — 0 331 151.5M 1487
lang06 C++ → C# claude-opus-5 xhigh broken 9/9 100.0% 2/6 60 254 119.0M 1244
lang06 C++ → C# claude-opus-5 max blind 6/9 100.0% — 0 599 247.7M 2443
lang06 C++ → C# claude-sonnet-5 low partial 9/9 95.2% — 0 25 4.6M 56
lang06 C++ → C# claude-sonnet-5 medium failed 7/9 96.1% — 0 93 34.0M 1176
lang06 C++ → C# claude-sonnet-5 high partial 9/9 95.7% — 0 395 133.7M 1364
lang06 C++ → C# claude-sonnet-5 xhigh failed 7/9 97.0% — 0 771 229.6M 2631
lang06 C++ → C# claude-sonnet-5 max failed 8/9 97.1% — 0 196 28.8M 703
lang06 C++ → C# dsv4-flash max partial 9/9 96.6% — 0 212 88.8M 685
lang06 C++ → C# glm-5.2 max failed 8/9 95.9% — 0 97 141.6M 417
lang06 C++ → C# gpt-5.6-luna none failed 7/9 4.1% — 0 82 55.1M 317
lang06 C++ → C# gpt-5.6-luna low failed 7/9 7.3% — 0 35 7.7M 107
lang06 C++ → C# gpt-5.6-luna medium failed 8/9 27.1% — 0 430 176.3M 991
lang06 C++ → C# gpt-5.6-luna high partial 9/9 36.5% — 0 94 42.9M 349
lang06 C++ → C# gpt-5.6-luna xhigh failed 8/9 61.7% — 0 618 328.5M 2403
lang06 C++ → C# gpt-5.6-luna max partial 9/9 85.7% — 0 393 215.9M 1507
lang06 C++ → C# gpt-5.6-sol none failed 7/9 6.0% — 0 2 0.3M 12
lang06 C++ → C# gpt-5.6-sol low failed 6/9 6.1% — 0 2 0.4M 21
lang06 C++ → C# gpt-5.6-sol medium failed 7/9 6.2% — 0 6 1.0M 33
lang06 C++ → C# gpt-5.6-sol high failed 7/9 6.7% — 0 12 3.4M 81
lang06 C++ → C# gpt-5.6-sol xhigh failed 8/9 0.0% — 0 69 37.4M 315
lang06 C++ → C# gpt-5.6-sol max partial 9/9 0.0% — 0 804 531.6M 3792
lang06 C++ → C# kimi-k3 max failed 7/9 100.0% — 0 534 97.1M 407
lang06 C++ → C# qwen3.8-max max partial 9/9 99.7% — 0 287 132.2M 347
lang07 JavaScript → TypeScript claude-opus-5 low partial 10/10 99.8% — 0 70 37.2M 327
lang07 JavaScript → TypeScript claude-opus-5 medium partial 10/10 99.9% — 0 82 44.7M 402
lang07 JavaScript → TypeScript claude-opus-5 high partial 10/10 99.8% — 0 94 31.9M 313
lang07 JavaScript → TypeScript claude-opus-5 xhigh accepted 10/10 100.0% 6/6 100 131 59.7M 550
lang07 JavaScript → TypeScript claude-opus-5 max partial 10/10 99.9% — 0 97 42.0M 520
lang07 JavaScript → TypeScript claude-sonnet-5 low partial 10/10 99.9% — 0 38 4.0M 48
lang07 JavaScript → TypeScript claude-sonnet-5 medium failed 8/10 99.9% — 0 2 2.4M 155
lang07 JavaScript → TypeScript claude-sonnet-5 high partial 10/10 99.9% — 0 51 20.1M 228
lang07 JavaScript → TypeScript claude-sonnet-5 xhigh partial 10/10 99.9% — 0 98 32.6M 321
lang07 JavaScript → TypeScript claude-sonnet-5 max partial 10/10 90.8% — 0 208 47.9M 893
lang07 JavaScript → TypeScript dsv4-flash max partial 10/10 100.0% — 0 84 15.2M 180
lang07 JavaScript → TypeScript glm-5.2 max failed 8/10 99.9% — 0 40 15.2M 154
lang07 JavaScript → TypeScript gpt-5.6-luna none failed 8/10 99.9% — 0 7 1.3M 28
lang07 JavaScript → TypeScript gpt-5.6-luna low failed 7/10 99.9% — 0 10 1.2M 29
lang07 JavaScript → TypeScript gpt-5.6-luna medium failed 8/10 99.9% — 0 16 4.4M 64
lang07 JavaScript → TypeScript gpt-5.6-luna high failed 8/10 100.0% — 0 40 18.5M 127
lang07 JavaScript → TypeScript gpt-5.6-luna xhigh failed 8/10 100.0% — 0 9 7.2M 58
lang07 JavaScript → TypeScript gpt-5.6-luna max blind 8/10 100.0% — 0 14 11.9M 81
lang07 JavaScript → TypeScript gpt-5.6-sol none failed 7/10 99.8% — 0 2 0.8M 21
lang07 JavaScript → TypeScript gpt-5.6-sol low failed 8/10 0.0% — 0 2 1.2M 63
lang07 JavaScript → TypeScript gpt-5.6-sol medium blind 8/10 100.0% — 0 10 4.7M 53
lang07 JavaScript → TypeScript gpt-5.6-sol high accepted 10/10 100.0% 6/6 100 17 9.4M 82
lang07 JavaScript → TypeScript gpt-5.6-sol xhigh failed 8/10 100.0% — 0 20 15.3M 139
lang07 JavaScript → TypeScript gpt-5.6-sol max accepted 10/10 100.0% 6/6 100 98 84.9M 611
lang07 JavaScript → TypeScript kimi-k3 max partial 10/10 99.9% — 0 398 47.8M 195
lang07 JavaScript → TypeScript qwen3.8-max max partial 10/10 99.9% — 0 230 37.0M 198
pf01 POSIX → wasm32-wasi claude-opus-5 low partial 6/6 99.8% — 0 37 15.5M 235
pf01 POSIX → wasm32-wasi claude-opus-5 medium partial 6/6 99.7% — 0 92 37.8M 349
pf01 POSIX → wasm32-wasi claude-opus-5 high partial 6/6 99.5% — 0 123 55.0M 572
pf01 POSIX → wasm32-wasi claude-opus-5 xhigh broken 6/6 100.0% 2/6 60 121 35.3M 509
pf01 POSIX → wasm32-wasi claude-opus-5 max partial 6/6 99.9% — 0 189 73.6M 886
pf01 POSIX → wasm32-wasi claude-sonnet-5 low failed 5/6 98.9% — 0 19 10.7M 98
pf01 POSIX → wasm32-wasi claude-sonnet-5 medium failed 5/6 98.8% — 0 24 14.6M 169
pf01 POSIX → wasm32-wasi claude-sonnet-5 high partial 6/6 98.8% — 0 79 49.8M 546
pf01 POSIX → wasm32-wasi claude-sonnet-5 xhigh failed 5/6 99.9% — 0 93 20.9M 385
pf01 POSIX → wasm32-wasi claude-sonnet-5 max partial 6/6 99.9% — 0 129 13.6M 327
pf01 POSIX → wasm32-wasi dsv4-flash max partial 6/6 99.0% — 0 108 39.5M 301
pf01 POSIX → wasm32-wasi glm-5.2 max failed 5/6 99.0% — 0 50 15.9M 135
pf01 POSIX → wasm32-wasi gpt-5.6-luna none failed 5/6 99.0% — 0 16 5.7M 66
pf01 POSIX → wasm32-wasi gpt-5.6-luna low failed 5/6 98.3% — 0 17 2.8M 56
pf01 POSIX → wasm32-wasi gpt-5.6-luna medium partial 6/6 98.9% — 0 13 3.7M 51
pf01 POSIX → wasm32-wasi gpt-5.6-luna high partial 6/6 99.0% — 0 18 12.9M 82
pf01 POSIX → wasm32-wasi gpt-5.6-luna xhigh partial 6/6 98.7% — 0 35 21.6M 160
pf01 POSIX → wasm32-wasi gpt-5.6-luna max failed 4/6 99.7% — 0 93 35.9M 235
pf01 POSIX → wasm32-wasi gpt-5.6-sol none partial 6/6 99.0% — 0 8 2.3M 53
pf01 POSIX → wasm32-wasi gpt-5.6-sol low failed 4/6 87.8% — 0 5 1.3M 42
pf01 POSIX → wasm32-wasi gpt-5.6-sol medium partial 6/6 99.0% — 0 15 4.7M 73
pf01 POSIX → wasm32-wasi gpt-5.6-sol high failed 5/6 99.0% — 0 15 6.3M 111
pf01 POSIX → wasm32-wasi gpt-5.6-sol xhigh partial 6/6 99.6% — 0 54 35.9M 279
pf01 POSIX → wasm32-wasi gpt-5.6-sol max failed 5/6 99.2% — 0 594 404.2M 3009
pf01 POSIX → wasm32-wasi kimi-k3 max partial 6/6 99.9% — 0 344 46.4M 299
pf01 POSIX → wasm32-wasi qwen3.8-max max failed 3/6 99.7% — 0 482 17.4M 184
pf02 CommonJS → V8 realm claude-opus-5 low partial 7/7 57.2% — 0 91 64.2M 676
pf02 CommonJS → V8 realm claude-opus-5 medium partial 7/7 57.5% — 0 151 85.8M 1101
pf02 CommonJS → V8 realm claude-opus-5 high partial 7/7 57.5% — 0 279 163.9M 1743
pf02 CommonJS → V8 realm claude-opus-5 xhigh partial 7/7 57.5% — 0 357 160.8M 1819
pf02 CommonJS → V8 realm claude-opus-5 max partial 7/7 57.5% — 0 242 112.5M 1095
pf02 CommonJS → V8 realm claude-sonnet-5 low failed 6/7 53.4% — 0 39 1.4M 143
pf02 CommonJS → V8 realm claude-sonnet-5 medium partial 7/7 33.6% — 0 106 65.8M 770
pf02 CommonJS → V8 realm claude-sonnet-5 high partial 7/7 54.0% — 0 212 67.0M 1099
pf02 CommonJS → V8 realm claude-sonnet-5 xhigh partial 7/7 57.2% — 0 266 76.8M 1102
pf02 CommonJS → V8 realm claude-sonnet-5 max partial 7/7 40.2% — 0 188 28.5M 712
pf02 CommonJS → V8 realm dsv4-flash max partial 7/7 57.3% — 0 170 86.8M 886
pf02 CommonJS → V8 realm glm-5.2 max failed 6/7 57.4% — 0 96 73.3M 405
pf02 CommonJS → V8 realm gpt-5.6-luna none failed 3/7 99.9% — 0 222 155.4M 715
pf02 CommonJS → V8 realm gpt-5.6-luna low failed 4/7 50.7% — 0 7 2.8M 54
pf02 CommonJS → V8 realm gpt-5.6-luna medium failed 6/7 50.2% — 0 47 29.1M 257
pf02 CommonJS → V8 realm gpt-5.6-luna high failed 6/7 50.4% — 0 86 43.7M 350
pf02 CommonJS → V8 realm gpt-5.6-luna xhigh partial 7/7 55.4% — 0 65 34.1M 260
pf02 CommonJS → V8 realm gpt-5.6-luna max partial 7/7 56.4% — 0 170 54.3M 390
pf02 CommonJS → V8 realm gpt-5.6-sol none failed 6/7 50.0% — 0 26 16.1M 168
pf02 CommonJS → V8 realm gpt-5.6-sol low failed 4/7 41.4% — 0 7 0.4M 18
pf02 CommonJS → V8 realm gpt-5.6-sol medium failed 5/7 50.0% — 0 5 1.1M 37
pf02 CommonJS → V8 realm gpt-5.6-sol high failed 6/7 49.8% — 0 30 20.4M 235
pf02 CommonJS → V8 realm gpt-5.6-sol xhigh failed 5/7 56.3% — 0 59 35.6M 289
pf02 CommonJS → V8 realm gpt-5.6-sol max failed 6/7 57.4% — 0 600 498.3M 3355
pf02 CommonJS → V8 realm kimi-k3 max failed 5/7 36.0% — 0 507 65.9M 255
pf02 CommonJS → V8 realm qwen3.8-max max failed 3/7 99.9% — 0 494 14.0M 179
pf03 x86-64 → tri-arch claude-opus-5 low accepted 6/6 100.0% 6/6 100 24 14.5M 158
pf03 x86-64 → tri-arch claude-opus-5 medium blind 5/6 100.0% — 0 6 4.1M 153
pf03 x86-64 → tri-arch claude-opus-5 high accepted 6/6 100.0% 6/6 100 68 26.7M 265
pf03 x86-64 → tri-arch claude-opus-5 xhigh broken 6/6 100.0% 5/6 90 103 45.6M 464
pf03 x86-64 → tri-arch claude-opus-5 max broken 6/6 100.0% 5/6 90 71 27.2M 282
pf03 x86-64 → tri-arch claude-sonnet-5 low broken 6/6 100.0% 4/6 80 20 7.8M 95
pf03 x86-64 → tri-arch claude-sonnet-5 medium broken 6/6 100.0% 1/6 50 36 15.7M 139
pf03 x86-64 → tri-arch claude-sonnet-5 high broken 6/6 100.0% 4/6 80 57 15.5M 143
pf03 x86-64 → tri-arch claude-sonnet-5 xhigh broken 6/6 100.0% 4/6 80 77 13.8M 145
pf03 x86-64 → tri-arch claude-sonnet-5 max broken 6/6 100.0% 3/6 70 19 2.1M 92
pf03 x86-64 → tri-arch dsv4-flash max broken 6/6 100.0% 2/6 60 24 8.0M 100
pf03 x86-64 → tri-arch glm-5.2 max broken 6/6 100.0% 3/6 70 50 9.2M 101
pf03 x86-64 → tri-arch gpt-5.6-luna none failed 4/6 98.6% — 0 4 1.1M 29
pf03 x86-64 → tri-arch gpt-5.6-luna low failed 4/6 99.0% — 0 3 0.7M 24
pf03 x86-64 → tri-arch gpt-5.6-luna medium partial 6/6 98.9% — 0 6 2.0M 37
pf03 x86-64 → tri-arch gpt-5.6-luna high blind 5/6 100.0% — 0 18 6.4M 67
pf03 x86-64 → tri-arch gpt-5.6-luna xhigh blind 5/6 100.0% — 0 14 12.8M 102
pf03 x86-64 → tri-arch gpt-5.6-luna max broken 6/6 100.0% 4/6 80 27 10.9M 99
pf03 x86-64 → tri-arch gpt-5.6-sol none partial 6/6 99.7% — 0 3 0.7M 22
pf03 x86-64 → tri-arch gpt-5.6-sol low failed 5/6 99.0% — 0 3 0.8M 29
pf03 x86-64 → tri-arch gpt-5.6-sol medium blind 5/6 100.0% — 0 7 2.2M 53
pf03 x86-64 → tri-arch gpt-5.6-sol high broken 6/6 100.0% 4/6 80 9 4.0M 58
pf03 x86-64 → tri-arch gpt-5.6-sol xhigh broken 6/6 100.0% 1/6 50 20 15.7M 134
pf03 x86-64 → tri-arch gpt-5.6-sol max accepted 6/6 100.0% 6/6 100 131 102.6M 721
pf03 x86-64 → tri-arch kimi-k3 max accepted 6/6 100.0% 6/6 100 199 10.9M 168
pf03 x86-64 → tri-arch qwen3.8-max max failed 5/6 99.7% — 0 301 4.7M 120
← SWE Refactor Bench Leaderboard → Tasks →