Metric vs Passage Length

Generated: 2026-09-20 11:23:15 UTC

Back to translation prompt evaluation.

Metric vs Passage Length Patterns

Passage length is measured as the source Greek token count when source text is available, falling back to human translation word count only when a source passage has no Greek tokens. Each row regresses one metric against passage length for one prompt version.

Evaluable regressions605
Positive42
Negative563
Significant positive0
Significant negative478

Across 605 evaluable metric/prompt regressions, negative correlations are more common: 42 positive, 563 negative, and 0 flat. Using p < 0.05, 0 are significantly positive and 478 are significantly negative.

Prompt Metric Rows Pattern Pearson r R^2 P-value Slope Status
claude_fable_5 v1 BLEU-4 100 negative -0.091 0.008 0.3692 -0.00039 ok
chrF++ 100 negative -0.101 0.010 0.3197 -0.00030 ok
METEOR 100 significant negative -0.210 0.044 0.0358 -0.00090 ok
ROUGE-L 100 significant negative -0.258 0.067 0.0095 -0.00087 ok
BERTScore 100 significant negative -0.481 0.231 4.10e-07 -0.00032 ok
COMET 100 negative -0.168 0.028 0.0938 -0.00032 ok
BLEURT 100 significant negative -0.678 0.459 9.64e-15 -0.00175 ok
Trigram precision 100 negative -0.013 1.62e-04 0.9000 -0.00006 ok
Trigram recall 100 negative -0.009 7.57e-05 0.9315 -0.00004 ok
Trigram F1 100 negative -0.009 8.91e-05 0.9257 -0.00005 ok
Trigram Jaccard 100 negative -0.033 0.001 0.7421 -0.00011 ok
claude_fable_5 v2 BLEU-4 100 significant negative -0.410 0.168 2.29e-05 -0.00254 ok
chrF++ 100 significant negative -0.456 0.208 1.88e-06 -0.00167 ok
METEOR 100 significant negative -0.465 0.217 1.07e-06 -0.00191 ok
ROUGE-L 100 significant negative -0.456 0.208 1.84e-06 -0.00165 ok
BERTScore 100 significant negative -0.612 0.374 1.37e-11 -0.00043 ok
COMET 100 significant negative -0.484 0.234 3.45e-07 -0.00087 ok
BLEURT 100 significant negative -0.719 0.516 3.85e-17 -0.00238 ok
Trigram precision 100 significant negative -0.334 0.111 0.0007 -0.00233 ok
Trigram recall 100 significant negative -0.359 0.129 0.0002 -0.00248 ok
Trigram F1 100 significant negative -0.347 0.121 0.0004 -0.00240 ok
Trigram Jaccard 100 significant negative -0.345 0.119 0.0004 -0.00235 ok
claude_fable_5 v3 BLEU-4 100 significant negative -0.429 0.184 8.27e-06 -0.00273 ok
chrF++ 100 significant negative -0.481 0.231 4.05e-07 -0.00181 ok
METEOR 100 significant negative -0.452 0.204 2.41e-06 -0.00179 ok
ROUGE-L 100 significant negative -0.461 0.213 1.37e-06 -0.00171 ok
BERTScore 100 significant negative -0.656 0.431 1.22e-13 -0.00041 ok
COMET 100 significant negative -0.504 0.254 8.78e-08 -0.00090 ok
BLEURT 100 significant negative -0.764 0.583 2.41e-20 -0.00262 ok
Trigram precision 100 significant negative -0.330 0.109 0.0008 -0.00253 ok
Trigram recall 100 significant negative -0.347 0.120 0.0004 -0.00258 ok
Trigram F1 100 significant negative -0.338 0.114 0.0006 -0.00255 ok
Trigram Jaccard 100 significant negative -0.339 0.115 0.0006 -0.00282 ok
claude_opus_4_8 v1 BLEU-4 100 negative -0.008 6.92e-05 0.9345 -0.00003 ok
chrF++ 100 negative -7.12e-05 5.07e-09 0.9994 -2.02e-07 ok
METEOR 100 negative -0.172 0.029 0.0876 -0.00077 ok
ROUGE-L 100 negative -0.190 0.036 0.0580 -0.00065 ok
BERTScore 100 significant negative -0.283 0.080 0.0043 -0.00020 ok
COMET 100 positive 0.027 7.11e-04 0.7923 0.00004 ok
BLEURT 100 significant negative -0.588 0.346 1.28e-10 -0.00154 ok
Trigram precision 100 negative -0.014 1.94e-04 0.8907 -0.00005 ok
Trigram recall 100 negative -0.043 0.002 0.6741 -0.00017 ok
Trigram F1 100 negative -0.024 5.63e-04 0.8147 -0.00009 ok
Trigram Jaccard 100 negative -0.038 0.001 0.7041 -0.00009 ok
claude_opus_4_8 v2 BLEU-4 100 significant negative -0.454 0.206 2.05e-06 -0.00281 ok
chrF++ 100 significant negative -0.475 0.226 5.84e-07 -0.00182 ok
METEOR 100 significant negative -0.514 0.264 4.60e-08 -0.00213 ok
ROUGE-L 100 significant negative -0.530 0.281 1.45e-08 -0.00202 ok
BERTScore 100 significant negative -0.628 0.394 2.66e-12 -0.00047 ok
COMET 100 significant negative -0.467 0.218 9.49e-07 -0.00089 ok
BLEURT 100 significant negative -0.727 0.529 1.07e-17 -0.00248 ok
Trigram precision 100 significant negative -0.398 0.158 4.18e-05 -0.00285 ok
Trigram recall 100 significant negative -0.406 0.165 2.76e-05 -0.00287 ok
Trigram F1 100 significant negative -0.403 0.163 3.18e-05 -0.00286 ok
Trigram Jaccard 100 significant negative -0.384 0.147 8.07e-05 -0.00270 ok
claude_opus_4_8 v3 BLEU-4 100 significant negative -0.414 0.172 1.82e-05 -0.00281 ok
chrF++ 100 significant negative -0.456 0.208 1.82e-06 -0.00180 ok
METEOR 100 significant negative -0.491 0.241 2.12e-07 -0.00221 ok
ROUGE-L 100 significant negative -0.521 0.271 2.77e-08 -0.00208 ok
BERTScore 100 significant negative -0.654 0.428 1.57e-13 -0.00044 ok
COMET 100 significant negative -0.493 0.243 1.94e-07 -0.00091 ok
BLEURT 100 significant negative -0.730 0.534 6.41e-18 -0.00257 ok
Trigram precision 100 significant negative -0.397 0.157 4.39e-05 -0.00321 ok
Trigram recall 100 significant negative -0.405 0.164 2.87e-05 -0.00327 ok
Trigram F1 100 significant negative -0.402 0.162 3.40e-05 -0.00324 ok
Trigram Jaccard 100 significant negative -0.389 0.152 6.25e-05 -0.00344 ok
claude_sonnet_5 v1 BLEU-4 100 positive 0.051 0.003 0.6145 0.00021 ok
chrF++ 100 positive 0.022 4.92e-04 0.8266 0.00007 ok
METEOR 100 negative -0.151 0.023 0.1332 -0.00067 ok
ROUGE-L 100 negative -0.189 0.036 0.0599 -0.00071 ok
BERTScore 100 significant negative -0.349 0.122 0.0004 -0.00028 ok
COMET 100 negative -0.100 0.010 0.3239 -0.00018 ok
BLEURT 100 significant negative -0.603 0.364 3.16e-11 -0.00172 ok
Trigram precision 100 positive 0.002 2.77e-06 0.9869 7.62e-06 ok
Trigram recall 100 negative -0.023 5.40e-04 0.8185 -0.00011 ok
Trigram F1 100 negative -0.009 7.34e-05 0.9326 -0.00004 ok
Trigram Jaccard 100 negative -0.024 5.66e-04 0.8142 -0.00007 ok
claude_sonnet_5 v2 BLEU-4 100 significant negative -0.335 0.112 0.0007 -0.00201 ok
chrF++ 100 significant negative -0.360 0.129 0.0002 -0.00127 ok
METEOR 100 significant negative -0.504 0.254 8.82e-08 -0.00221 ok
ROUGE-L 100 significant negative -0.494 0.244 1.78e-07 -0.00186 ok
BERTScore 100 significant negative -0.536 0.288 8.82e-09 -0.00040 ok
COMET 100 significant negative -0.412 0.170 2.03e-05 -0.00071 ok
BLEURT 100 significant negative -0.722 0.521 2.45e-17 -0.00222 ok
Trigram precision 100 significant negative -0.360 0.129 0.0002 -0.00252 ok
Trigram recall 100 significant negative -0.364 0.133 0.0002 -0.00251 ok
Trigram F1 100 significant negative -0.363 0.132 0.0002 -0.00251 ok
Trigram Jaccard 100 significant negative -0.363 0.132 0.0002 -0.00229 ok
claude_sonnet_5 v3 BLEU-4 100 significant negative -0.416 0.173 1.67e-05 -0.00281 ok
chrF++ 100 significant negative -0.455 0.207 2.01e-06 -0.00177 ok
METEOR 100 significant negative -0.520 0.270 3.04e-08 -0.00213 ok
ROUGE-L 100 significant negative -0.527 0.277 1.81e-08 -0.00212 ok
BERTScore 100 significant negative -0.640 0.409 7.91e-13 -0.00043 ok
COMET 100 significant negative -0.517 0.267 3.75e-08 -0.00090 ok
BLEURT 100 significant negative -0.740 0.548 1.35e-18 -0.00246 ok
Trigram precision 100 significant negative -0.404 0.163 3.13e-05 -0.00345 ok
Trigram recall 100 significant negative -0.406 0.165 2.80e-05 -0.00341 ok
Trigram F1 100 significant negative -0.405 0.164 2.92e-05 -0.00342 ok
Trigram Jaccard 100 significant negative -0.407 0.165 2.70e-05 -0.00383 ok
gpt-4-turbo-2024-04-09 v1 BLEU-4 100 positive 0.047 0.002 0.6420 0.00018 ok
chrF++ 100 positive 0.065 0.004 0.5211 0.00020 ok
METEOR 100 negative -0.180 0.032 0.0737 -0.00093 ok
ROUGE-L 100 negative -0.104 0.011 0.3022 -0.00041 ok
BERTScore 100 significant negative -0.236 0.056 0.0179 -0.00019 ok
COMET 100 negative -0.135 0.018 0.1807 -0.00023 ok
BLEURT 100 significant negative -0.690 0.476 2.04e-15 -0.00207 ok
Trigram precision 100 negative -0.012 1.45e-04 0.9054 -0.00005 ok
Trigram recall 100 negative -0.073 0.005 0.4724 -0.00034 ok
Trigram F1 100 negative -0.041 0.002 0.6861 -0.00018 ok
Trigram Jaccard 100 negative -0.059 0.003 0.5623 -0.00017 ok
gpt-4-turbo-2024-04-09 v2 BLEU-4 100 significant negative -0.460 0.211 1.50e-06 -0.00306 ok
chrF++ 100 significant negative -0.445 0.198 3.49e-06 -0.00195 ok
METEOR 100 significant negative -0.502 0.252 1.03e-07 -0.00282 ok
ROUGE-L 100 significant negative -0.501 0.251 1.09e-07 -0.00247 ok
BERTScore 100 significant negative -0.617 0.380 8.38e-12 -0.00055 ok
COMET 100 significant negative -0.464 0.215 1.19e-06 -0.00090 ok
BLEURT 100 significant negative -0.758 0.575 6.48e-20 -0.00300 ok
Trigram precision 100 significant negative -0.410 0.168 2.25e-05 -0.00324 ok
Trigram recall 100 significant negative -0.421 0.178 1.26e-05 -0.00332 ok
Trigram F1 100 significant negative -0.417 0.174 1.61e-05 -0.00327 ok
Trigram Jaccard 100 significant negative -0.397 0.158 4.35e-05 -0.00286 ok
gpt-4-turbo-2024-04-09 v3 BLEU-4 100 significant negative -0.353 0.125 0.0003 -0.00202 ok
chrF++ 100 significant negative -0.345 0.119 0.0004 -0.00133 ok
METEOR 100 significant negative -0.462 0.213 1.31e-06 -0.00227 ok
ROUGE-L 100 significant negative -0.440 0.194 4.55e-06 -0.00195 ok
BERTScore 100 significant negative -0.506 0.256 7.82e-08 -0.00043 ok
COMET 100 significant negative -0.339 0.115 0.0006 -0.00063 ok
BLEURT 100 significant negative -0.743 0.552 8.73e-19 -0.00244 ok
Trigram precision 100 significant negative -0.316 0.100 0.0014 -0.00207 ok
Trigram recall 100 significant negative -0.345 0.119 0.0004 -0.00221 ok
Trigram F1 100 significant negative -0.330 0.109 0.0008 -0.00213 ok
Trigram Jaccard 100 significant negative -0.329 0.108 0.0008 -0.00172 ok
gpt-4.1-2025-04-14 v1 BLEU-4 100 positive 0.063 0.004 0.5363 0.00025 ok
chrF++ 100 positive 0.118 0.014 0.2436 0.00037 ok
METEOR 100 negative -0.124 0.015 0.2207 -0.00059 ok
ROUGE-L 100 negative -0.133 0.018 0.1856 -0.00053 ok
BERTScore 100 significant negative -0.265 0.070 0.0077 -0.00023 ok
COMET 100 negative -0.043 0.002 0.6744 -0.00007 ok
BLEURT 100 significant negative -0.638 0.407 9.53e-13 -0.00182 ok
Trigram precision 100 positive 0.057 0.003 0.5764 0.00025 ok
Trigram recall 100 positive 0.023 5.52e-04 0.8165 0.00011 ok
Trigram F1 100 positive 0.042 0.002 0.6795 0.00019 ok
Trigram Jaccard 100 positive 0.009 7.75e-05 0.9307 0.00003 ok
gpt-4.1-2025-04-14 v2 BLEU-4 100 significant negative -0.288 0.083 0.0036 -0.00178 ok
chrF++ 100 significant negative -0.289 0.084 0.0035 -0.00116 ok
METEOR 100 significant negative -0.370 0.137 0.0002 -0.00190 ok
ROUGE-L 100 significant negative -0.386 0.149 7.36e-05 -0.00172 ok
BERTScore 100 significant negative -0.562 0.316 1.15e-09 -0.00044 ok
COMET 100 significant negative -0.391 0.153 5.68e-05 -0.00072 ok
BLEURT 100 significant negative -0.701 0.492 4.59e-16 -0.00231 ok
Trigram precision 100 significant negative -0.272 0.074 0.0061 -0.00197 ok
Trigram recall 100 significant negative -0.287 0.082 0.0038 -0.00205 ok
Trigram F1 100 significant negative -0.279 0.078 0.0049 -0.00200 ok
Trigram Jaccard 100 significant negative -0.285 0.081 0.0040 -0.00181 ok
gpt-4.1-2025-04-14 v3 BLEU-4 100 significant negative -0.327 0.107 0.0009 -0.00206 ok
chrF++ 100 significant negative -0.373 0.139 0.0001 -0.00143 ok
METEOR 100 significant negative -0.481 0.232 4.03e-07 -0.00215 ok
ROUGE-L 100 significant negative -0.488 0.238 2.62e-07 -0.00206 ok
BERTScore 100 significant negative -0.633 0.401 1.54e-12 -0.00049 ok
COMET 100 significant negative -0.424 0.180 1.09e-05 -0.00082 ok
BLEURT 100 significant negative -0.754 0.569 1.35e-19 -0.00258 ok
Trigram precision 100 significant negative -0.366 0.134 0.0002 -0.00290 ok
Trigram recall 100 significant negative -0.362 0.131 0.0002 -0.00285 ok
Trigram F1 100 significant negative -0.364 0.132 0.0002 -0.00286 ok
Trigram Jaccard 100 significant negative -0.352 0.124 0.0003 -0.00290 ok
gpt-4o-2024-05-13 v1 BLEU-4 100 negative -0.069 0.005 0.4960 -0.00029 ok
chrF++ 100 significant negative -0.228 0.052 0.0223 -0.00079 ok
METEOR 100 significant negative -0.321 0.103 0.0011 -0.00161 ok
ROUGE-L 100 significant negative -0.334 0.111 0.0007 -0.00148 ok
BERTScore 100 significant negative -0.439 0.193 4.91e-06 -0.00038 ok
COMET 100 significant negative -0.408 0.166 2.52e-05 -0.00083 ok
BLEURT 100 significant negative -0.644 0.414 5.02e-13 -0.00211 ok
Trigram precision 100 negative -0.048 0.002 0.6362 -0.00022 ok
Trigram recall 100 negative -0.107 0.011 0.2901 -0.00052 ok
Trigram F1 100 negative -0.094 0.009 0.3533 -0.00045 ok
Trigram Jaccard 100 negative -0.107 0.012 0.2882 -0.00034 ok
gpt-4o-2024-05-13 v2 BLEU-4 100 significant negative -0.344 0.119 0.0004 -0.00203 ok
chrF++ 100 significant negative -0.371 0.138 0.0001 -0.00156 ok
METEOR 100 significant negative -0.440 0.194 4.64e-06 -0.00230 ok
ROUGE-L 100 significant negative -0.446 0.199 3.37e-06 -0.00212 ok
BERTScore 100 significant negative -0.560 0.313 1.40e-09 -0.00051 ok
COMET 100 significant negative -0.389 0.152 6.20e-05 -0.00084 ok
BLEURT 100 significant negative -0.709 0.502 1.57e-16 -0.00260 ok
Trigram precision 100 significant negative -0.295 0.087 0.0028 -0.00204 ok
Trigram recall 100 significant negative -0.320 0.102 0.0012 -0.00208 ok
Trigram F1 100 significant negative -0.312 0.097 0.0016 -0.00208 ok
Trigram Jaccard 100 significant negative -0.310 0.096 0.0017 -0.00176 ok
gpt-4o-2024-05-13 v3 BLEU-4 100 significant negative -0.318 0.101 0.0013 -0.00223 ok
chrF++ 100 significant negative -0.381 0.145 9.16e-05 -0.00175 ok
METEOR 100 significant negative -0.458 0.210 1.65e-06 -0.00256 ok
ROUGE-L 100 significant negative -0.452 0.204 2.38e-06 -0.00229 ok
BERTScore 100 significant negative -0.529 0.280 1.48e-08 -0.00047 ok
COMET 100 significant negative -0.410 0.168 2.26e-05 -0.00091 ok
BLEURT 100 significant negative -0.713 0.508 9.16e-17 -0.00274 ok
Trigram precision 100 significant negative -0.307 0.094 0.0019 -0.00280 ok
Trigram recall 100 significant negative -0.329 0.108 0.0008 -0.00295 ok
Trigram F1 100 significant negative -0.321 0.103 0.0011 -0.00290 ok
Trigram Jaccard 100 significant negative -0.321 0.103 0.0011 -0.00295 ok
gpt-4o-2024-08-06 v1 BLEU-4 100 negative -0.029 8.17e-04 0.7778 -0.00011 ok
chrF++ 100 negative -0.004 2.01e-05 0.9647 -0.00001 ok
METEOR 100 negative -0.161 0.026 0.1089 -0.00085 ok
ROUGE-L 100 negative -0.192 0.037 0.0563 -0.00080 ok
BERTScore 100 significant negative -0.316 0.100 0.0013 -0.00026 ok
COMET 100 negative -0.154 0.024 0.1257 -0.00024 ok
BLEURT 100 significant negative -0.670 0.449 2.51e-14 -0.00214 ok
Trigram precision 100 negative -0.026 6.90e-04 0.7952 -0.00012 ok
Trigram recall 100 negative -0.072 0.005 0.4746 -0.00036 ok
Trigram F1 100 negative -0.047 0.002 0.6438 -0.00022 ok
Trigram Jaccard 100 negative -0.063 0.004 0.5333 -0.00021 ok
gpt-4o-2024-08-06 v2 BLEU-4 100 significant negative -0.339 0.115 0.0006 -0.00193 ok
chrF++ 100 significant negative -0.367 0.134 0.0002 -0.00138 ok
METEOR 100 significant negative -0.461 0.213 1.39e-06 -0.00227 ok
ROUGE-L 100 significant negative -0.447 0.200 3.06e-06 -0.00194 ok
BERTScore 100 significant negative -0.627 0.393 3.10e-12 -0.00052 ok
COMET 100 significant negative -0.418 0.175 1.52e-05 -0.00078 ok
BLEURT 100 significant negative -0.761 0.579 4.14e-20 -0.00271 ok
Trigram precision 100 significant negative -0.324 0.105 0.0010 -0.00223 ok
Trigram recall 100 significant negative -0.327 0.107 0.0009 -0.00224 ok
Trigram F1 100 significant negative -0.326 0.107 0.0009 -0.00223 ok
Trigram Jaccard 100 significant negative -0.322 0.104 0.0011 -0.00190 ok
gpt-4o-2024-08-06 v3 BLEU-4 100 significant negative -0.328 0.108 0.0009 -0.00234 ok
chrF++ 100 significant negative -0.374 0.140 0.0001 -0.00158 ok
METEOR 100 significant negative -0.441 0.195 4.29e-06 -0.00227 ok
ROUGE-L 100 significant negative -0.486 0.236 3.04e-07 -0.00225 ok
BERTScore 100 significant negative -0.599 0.359 4.54e-11 -0.00050 ok
COMET 100 significant negative -0.399 0.159 3.93e-05 -0.00081 ok
BLEURT 100 significant negative -0.662 0.438 6.35e-14 -0.00248 ok
Trigram precision 100 significant negative -0.348 0.121 0.0004 -0.00301 ok
Trigram recall 100 significant negative -0.346 0.120 0.0004 -0.00292 ok
Trigram F1 100 significant negative -0.347 0.120 0.0004 -0.00295 ok
Trigram Jaccard 100 significant negative -0.343 0.118 0.0005 -0.00298 ok
gpt-4o-2024-11-20 v1 BLEU-4 100 negative -0.071 0.005 0.4839 -0.00028 ok
chrF++ 100 negative -0.009 8.57e-05 0.9272 -0.00003 ok
METEOR 100 significant negative -0.265 0.070 0.0078 -0.00129 ok
ROUGE-L 100 significant negative -0.233 0.054 0.0199 -0.00095 ok
BERTScore 100 significant negative -0.305 0.093 0.0020 -0.00027 ok
COMET 100 negative -0.097 0.009 0.3378 -0.00016 ok
BLEURT 100 significant negative -0.648 0.420 3.05e-13 -0.00188 ok
Trigram precision 100 negative -0.090 0.008 0.3735 -0.00038 ok
Trigram recall 100 negative -0.120 0.014 0.2346 -0.00055 ok
Trigram F1 100 negative -0.103 0.011 0.3101 -0.00045 ok
Trigram Jaccard 100 negative -0.115 0.013 0.2556 -0.00034 ok
gpt-4o-2024-11-20 v2 BLEU-4 100 significant negative -0.330 0.109 0.0008 -0.00203 ok
chrF++ 100 significant negative -0.372 0.138 0.0001 -0.00143 ok
METEOR 100 significant negative -0.464 0.215 1.17e-06 -0.00233 ok
ROUGE-L 100 significant negative -0.418 0.175 1.53e-05 -0.00184 ok
BERTScore 100 significant negative -0.600 0.360 4.21e-11 -0.00048 ok
COMET 100 significant negative -0.406 0.165 2.74e-05 -0.00077 ok
BLEURT 100 significant negative -0.743 0.553 8.16e-19 -0.00249 ok
Trigram precision 100 significant negative -0.305 0.093 0.0020 -0.00215 ok
Trigram recall 100 significant negative -0.313 0.098 0.0015 -0.00222 ok
Trigram F1 100 significant negative -0.310 0.096 0.0017 -0.00218 ok
Trigram Jaccard 100 significant negative -0.309 0.095 0.0018 -0.00195 ok
gpt-4o-2024-11-20 v3 BLEU-4 100 significant negative -0.363 0.132 0.0002 -0.00225 ok
chrF++ 100 significant negative -0.356 0.127 0.0003 -0.00137 ok
METEOR 100 significant negative -0.465 0.216 1.08e-06 -0.00223 ok
ROUGE-L 100 significant negative -0.477 0.227 5.40e-07 -0.00212 ok
BERTScore 100 significant negative -0.627 0.394 2.83e-12 -0.00048 ok
COMET 100 significant negative -0.386 0.149 7.42e-05 -0.00069 ok
BLEURT 100 significant negative -0.736 0.541 2.82e-18 -0.00249 ok
Trigram precision 100 significant negative -0.363 0.131 0.0002 -0.00295 ok
Trigram recall 100 significant negative -0.359 0.129 0.0002 -0.00286 ok
Trigram F1 100 significant negative -0.361 0.130 0.0002 -0.00290 ok
Trigram Jaccard 100 significant negative -0.346 0.120 0.0004 -0.00281 ok
gpt-5 v1 BLEU-4 100 positive 0.056 0.003 0.5810 0.00024 ok
chrF++ 100 positive 0.042 0.002 0.6787 0.00013 ok
METEOR 100 negative -0.126 0.016 0.2122 -0.00058 ok
ROUGE-L 100 negative -0.128 0.016 0.2055 -0.00047 ok
BERTScore 100 significant negative -0.247 0.061 0.0134 -0.00017 ok
COMET 100 negative -0.029 8.21e-04 0.7771 -0.00005 ok
BLEURT 100 significant negative -0.628 0.394 2.80e-12 -0.00181 ok
Trigram precision 100 positive 0.024 5.71e-04 0.8135 0.00011 ok
Trigram recall 100 positive 0.009 7.25e-05 0.9330 0.00004 ok
Trigram F1 100 positive 0.018 3.08e-04 0.8625 0.00008 ok
Trigram Jaccard 100 negative -0.011 1.19e-04 0.9141 -0.00003 ok
gpt-5 v2 BLEU-4 100 significant negative -0.421 0.177 1.28e-05 -0.00269 ok
chrF++ 100 significant negative -0.465 0.217 1.07e-06 -0.00183 ok
METEOR 100 significant negative -0.489 0.239 2.46e-07 -0.00229 ok
ROUGE-L 100 significant negative -0.436 0.190 5.84e-06 -0.00172 ok
BERTScore 100 significant negative -0.680 0.462 7.56e-15 -0.00052 ok
COMET 100 significant negative -0.522 0.273 2.55e-08 -0.00100 ok
BLEURT 100 significant negative -0.809 0.655 2.27e-24 -0.00323 ok
Trigram precision 100 significant negative -0.302 0.091 0.0023 -0.00219 ok
Trigram recall 100 significant negative -0.338 0.115 0.0006 -0.00246 ok
Trigram F1 100 significant negative -0.323 0.104 0.0010 -0.00234 ok
Trigram Jaccard 100 significant negative -0.319 0.102 0.0012 -0.00224 ok
gpt-5 v3 BLEU-4 100 significant negative -0.374 0.140 0.0001 -0.00238 ok
chrF++ 100 significant negative -0.443 0.196 3.95e-06 -0.00165 ok
METEOR 100 significant negative -0.524 0.274 2.23e-08 -0.00248 ok
ROUGE-L 100 significant negative -0.471 0.221 7.83e-07 -0.00197 ok
BERTScore 100 significant negative -0.610 0.372 1.64e-11 -0.00042 ok
COMET 100 significant negative -0.479 0.229 4.69e-07 -0.00089 ok
BLEURT 100 significant negative -0.753 0.567 1.65e-19 -0.00259 ok
Trigram precision 100 significant negative -0.370 0.137 0.0002 -0.00305 ok
Trigram recall 100 significant negative -0.378 0.143 0.0001 -0.00312 ok
Trigram F1 100 significant negative -0.374 0.140 0.0001 -0.00308 ok
Trigram Jaccard 100 significant negative -0.368 0.135 0.0002 -0.00336 ok
gpt-5.1 v1 BLEU-4 100 positive 0.128 0.016 0.2055 0.00052 ok
chrF++ 100 positive 0.111 0.012 0.2708 0.00032 ok
METEOR 100 negative -0.063 0.004 0.5306 -0.00028 ok
ROUGE-L 100 negative -0.139 0.019 0.1690 -0.00054 ok
BERTScore 100 significant negative -0.294 0.087 0.0029 -0.00023 ok
COMET 100 positive 0.012 1.36e-04 0.9084 0.00002 ok
BLEURT 100 significant negative -0.631 0.399 1.90e-12 -0.00179 ok
Trigram precision 100 positive 0.048 0.002 0.6385 0.00021 ok
Trigram recall 100 positive 0.061 0.004 0.5442 0.00029 ok
Trigram F1 100 positive 0.056 0.003 0.5822 0.00026 ok
Trigram Jaccard 100 positive 0.030 9.13e-04 0.7654 0.00009 ok
gpt-5.1 v2 BLEU-4 100 significant negative -0.308 0.095 0.0018 -0.00200 ok
chrF++ 100 significant negative -0.331 0.109 0.0008 -0.00131 ok
METEOR 100 significant negative -0.406 0.165 2.78e-05 -0.00190 ok
ROUGE-L 100 significant negative -0.363 0.132 0.0002 -0.00152 ok
BERTScore 100 significant negative -0.575 0.331 3.90e-10 -0.00045 ok
COMET 100 significant negative -0.414 0.171 1.88e-05 -0.00080 ok
BLEURT 100 significant negative -0.732 0.536 4.85e-18 -0.00258 ok
Trigram precision 100 significant negative -0.284 0.081 0.0042 -0.00211 ok
Trigram recall 100 significant negative -0.283 0.080 0.0044 -0.00208 ok
Trigram F1 100 significant negative -0.284 0.080 0.0042 -0.00209 ok
Trigram Jaccard 100 significant negative -0.288 0.083 0.0036 -0.00203 ok
gpt-5.1 v3 BLEU-4 100 significant negative -0.336 0.113 0.0006 -0.00197 ok
chrF++ 100 significant negative -0.375 0.141 0.0001 -0.00134 ok
METEOR 100 significant negative -0.466 0.217 1.01e-06 -0.00210 ok
ROUGE-L 100 significant negative -0.479 0.229 4.75e-07 -0.00191 ok
BERTScore 100 significant negative -0.595 0.354 6.92e-11 -0.00043 ok
COMET 100 significant negative -0.411 0.169 2.21e-05 -0.00078 ok
BLEURT 100 significant negative -0.716 0.512 5.80e-17 -0.00237 ok
Trigram precision 100 significant negative -0.358 0.128 0.0003 -0.00270 ok
Trigram recall 100 significant negative -0.360 0.129 0.0002 -0.00266 ok
Trigram F1 100 significant negative -0.359 0.129 0.0002 -0.00266 ok
Trigram Jaccard 100 significant negative -0.345 0.119 0.0004 -0.00268 ok
gpt-5.2 v1 BLEU-4 100 negative -0.088 0.008 0.3826 -0.00040 ok
chrF++ 100 negative -0.107 0.011 0.2891 -0.00035 ok
METEOR 100 negative -0.177 0.031 0.0782 -0.00085 ok
ROUGE-L 100 negative -0.098 0.010 0.3315 -0.00041 ok
BERTScore 100 significant negative -0.287 0.082 0.0038 -0.00020 ok
COMET 100 negative -0.007 4.51e-05 0.9471 -0.00001 ok
BLEURT 100 significant negative -0.640 0.410 7.43e-13 -0.00197 ok
Trigram precision 100 positive 0.024 5.96e-04 0.8094 0.00011 ok
Trigram recall 100 negative -0.035 0.001 0.7286 -0.00017 ok
Trigram F1 100 negative -5.81e-04 3.38e-07 0.9954 -2.69e-06 ok
Trigram Jaccard 100 negative -0.019 3.63e-04 0.8508 -0.00006 ok
gpt-5.2 v2 BLEU-4 100 significant negative -0.401 0.161 3.53e-05 -0.00274 ok
chrF++ 100 significant negative -0.470 0.221 8.23e-07 -0.00200 ok
METEOR 100 significant negative -0.479 0.229 4.72e-07 -0.00222 ok
ROUGE-L 100 significant negative -0.442 0.195 4.16e-06 -0.00174 ok
BERTScore 100 significant negative -0.609 0.371 1.83e-11 -0.00049 ok
COMET 100 significant negative -0.491 0.241 2.16e-07 -0.00103 ok
BLEURT 100 significant negative -0.737 0.544 2.22e-18 -0.00291 ok
Trigram precision 100 significant negative -0.309 0.096 0.0018 -0.00232 ok
Trigram recall 100 significant negative -0.330 0.109 0.0008 -0.00246 ok
Trigram F1 100 significant negative -0.320 0.103 0.0012 -0.00239 ok
Trigram Jaccard 100 significant negative -0.327 0.107 0.0009 -0.00236 ok
gpt-5.2 v3 BLEU-4 100 significant negative -0.308 0.095 0.0018 -0.00204 ok
chrF++ 100 significant negative -0.331 0.110 0.0008 -0.00136 ok
METEOR 100 significant negative -0.360 0.130 0.0002 -0.00161 ok
ROUGE-L 100 significant negative -0.342 0.117 0.0005 -0.00144 ok
BERTScore 100 significant negative -0.587 0.344 1.39e-10 -0.00044 ok
COMET 100 significant negative -0.406 0.164 2.84e-05 -0.00075 ok
BLEURT 100 significant negative -0.705 0.498 2.55e-16 -0.00248 ok
Trigram precision 100 significant negative -0.272 0.074 0.0062 -0.00212 ok
Trigram recall 100 significant negative -0.277 0.077 0.0053 -0.00209 ok
Trigram F1 100 significant negative -0.274 0.075 0.0058 -0.00209 ok
Trigram Jaccard 100 significant negative -0.286 0.082 0.0040 -0.00226 ok
gpt-5.3-chat-latest v1 BLEU-4 100 positive 0.021 4.35e-04 0.8369 0.00010 ok
chrF++ 100 positive 0.037 0.001 0.7137 0.00012 ok
METEOR 100 negative -0.025 6.13e-04 0.8068 -0.00012 ok
ROUGE-L 100 negative -0.065 0.004 0.5216 -0.00028 ok
BERTScore 100 significant negative -0.342 0.117 0.0005 -0.00026 ok
COMET 100 negative -0.194 0.037 0.0536 -0.00038 ok
BLEURT 100 significant negative -0.693 0.481 1.32e-15 -0.00212 ok
Trigram precision 100 positive 0.022 4.71e-04 0.8303 0.00011 ok
Trigram recall 100 positive 0.019 3.46e-04 0.8542 0.00009 ok
Trigram F1 100 positive 0.021 4.31e-04 0.8375 0.00010 ok
Trigram Jaccard 100 positive 2.27e-04 5.17e-08 0.9982 7.22e-07 ok
gpt-5.3-chat-latest v2 BLEU-4 100 significant negative -0.391 0.152 5.90e-05 -0.00247 ok
chrF++ 100 significant negative -0.432 0.187 7.09e-06 -0.00171 ok
METEOR 100 significant negative -0.457 0.209 1.72e-06 -0.00206 ok
ROUGE-L 100 significant negative -0.406 0.165 2.82e-05 -0.00165 ok
BERTScore 100 significant negative -0.579 0.335 2.89e-10 -0.00047 ok
COMET 100 significant negative -0.473 0.224 6.57e-07 -0.00091 ok
BLEURT 100 significant negative -0.741 0.550 1.12e-18 -0.00273 ok
Trigram precision 100 significant negative -0.316 0.100 0.0014 -0.00220 ok
Trigram recall 100 significant negative -0.347 0.121 0.0004 -0.00238 ok
Trigram F1 100 significant negative -0.333 0.111 0.0007 -0.00229 ok
Trigram Jaccard 100 significant negative -0.336 0.113 0.0006 -0.00219 ok
gpt-5.3-chat-latest v3 BLEU-4 100 significant negative -0.374 0.140 0.0001 -0.00223 ok
chrF++ 100 significant negative -0.397 0.157 4.41e-05 -0.00152 ok
METEOR 100 significant negative -0.399 0.159 3.95e-05 -0.00171 ok
ROUGE-L 100 significant negative -0.423 0.179 1.19e-05 -0.00164 ok
BERTScore 100 significant negative -0.558 0.311 1.66e-09 -0.00041 ok
COMET 100 significant negative -0.423 0.179 1.18e-05 -0.00078 ok
BLEURT 100 significant negative -0.722 0.521 2.48e-17 -0.00246 ok
Trigram precision 100 significant negative -0.314 0.098 0.0015 -0.00229 ok
Trigram recall 100 significant negative -0.331 0.110 0.0008 -0.00238 ok
Trigram F1 100 significant negative -0.322 0.104 0.0011 -0.00232 ok
Trigram Jaccard 100 significant negative -0.323 0.104 0.0011 -0.00242 ok
gpt-5.4 v1 BLEU-4 100 positive 0.089 0.008 0.3763 0.00039 ok
chrF++ 100 positive 0.046 0.002 0.6490 0.00013 ok
METEOR 100 negative -0.069 0.005 0.4971 -0.00032 ok
ROUGE-L 100 negative -0.096 0.009 0.3413 -0.00038 ok
BERTScore 100 significant negative -0.308 0.095 0.0018 -0.00020 ok
COMET 100 negative -0.044 0.002 0.6661 -0.00008 ok
BLEURT 100 significant negative -0.599 0.359 4.45e-11 -0.00178 ok
Trigram precision 100 positive 0.044 0.002 0.6614 0.00019 ok
Trigram recall 100 positive 0.025 6.33e-04 0.8038 0.00011 ok
Trigram F1 100 positive 0.036 0.001 0.7207 0.00015 ok
Trigram Jaccard 100 positive 0.021 4.34e-04 0.8369 0.00006 ok
gpt-5.4 v2 BLEU-4 100 significant negative -0.394 0.155 5.08e-05 -0.00227 ok
chrF++ 100 significant negative -0.421 0.177 1.29e-05 -0.00146 ok
METEOR 100 significant negative -0.475 0.226 5.89e-07 -0.00199 ok
ROUGE-L 100 significant negative -0.490 0.240 2.29e-07 -0.00186 ok
BERTScore 100 significant negative -0.631 0.398 1.93e-12 -0.00048 ok
COMET 100 significant negative -0.459 0.210 1.60e-06 -0.00088 ok
BLEURT 100 significant negative -0.756 0.572 9.18e-20 -0.00261 ok
Trigram precision 100 significant negative -0.381 0.145 9.19e-05 -0.00265 ok
Trigram recall 100 significant negative -0.382 0.146 8.98e-05 -0.00261 ok
Trigram F1 100 significant negative -0.382 0.146 8.61e-05 -0.00262 ok
Trigram Jaccard 100 significant negative -0.359 0.129 0.0002 -0.00242 ok
gpt-5.4 v3 BLEU-4 100 significant negative -0.398 0.159 4.06e-05 -0.00261 ok
chrF++ 100 significant negative -0.414 0.172 1.81e-05 -0.00158 ok
METEOR 100 significant negative -0.459 0.210 1.60e-06 -0.00188 ok
ROUGE-L 100 significant negative -0.438 0.192 5.28e-06 -0.00171 ok
BERTScore 100 significant negative -0.632 0.399 1.84e-12 -0.00044 ok
COMET 100 significant negative -0.450 0.202 2.65e-06 -0.00083 ok
BLEURT 100 significant negative -0.690 0.476 2.08e-15 -0.00251 ok
Trigram precision 100 significant negative -0.303 0.092 0.0022 -0.00239 ok
Trigram recall 100 significant negative -0.311 0.096 0.0017 -0.00238 ok
Trigram F1 100 significant negative -0.306 0.094 0.0019 -0.00237 ok
Trigram Jaccard 100 significant negative -0.310 0.096 0.0017 -0.00256 ok
gpt-5.5 v1 BLEU-4 100 negative -0.002 4.52e-06 0.9833 -9.57e-06 ok
chrF++ 100 negative -0.011 1.32e-04 0.9097 -0.00004 ok
METEOR 100 negative -0.023 5.20e-04 0.8217 -0.00011 ok
ROUGE-L 100 negative -0.042 0.002 0.6788 -0.00017 ok
BERTScore 100 significant negative -0.268 0.072 0.0070 -0.00021 ok
COMET 100 negative -0.125 0.016 0.2166 -0.00024 ok
BLEURT 100 significant negative -0.570 0.325 5.85e-10 -0.00179 ok
Trigram precision 100 positive 0.058 0.003 0.5653 0.00028 ok
Trigram recall 100 positive 0.042 0.002 0.6757 0.00020 ok
Trigram F1 100 positive 0.052 0.003 0.6074 0.00025 ok
Trigram Jaccard 100 positive 0.024 5.73e-04 0.8131 0.00008 ok
gpt-5.5 v2 BLEU-4 100 significant negative -0.438 0.192 5.28e-06 -0.00293 ok
chrF++ 100 significant negative -0.456 0.208 1.84e-06 -0.00193 ok
METEOR 100 significant negative -0.457 0.209 1.71e-06 -0.00199 ok
ROUGE-L 100 significant negative -0.456 0.208 1.91e-06 -0.00175 ok
BERTScore 100 significant negative -0.633 0.400 1.64e-12 -0.00048 ok
COMET 100 significant negative -0.473 0.224 6.81e-07 -0.00093 ok
BLEURT 100 significant negative -0.717 0.514 4.68e-17 -0.00262 ok
Trigram precision 100 significant negative -0.297 0.088 0.0027 -0.00215 ok
Trigram recall 100 significant negative -0.326 0.106 0.0009 -0.00235 ok
Trigram F1 100 significant negative -0.313 0.098 0.0015 -0.00225 ok
Trigram Jaccard 100 significant negative -0.319 0.102 0.0012 -0.00223 ok
gpt-5.5 v3 BLEU-4 100 significant negative -0.299 0.089 0.0025 -0.00226 ok
chrF++ 100 significant negative -0.383 0.147 8.37e-05 -0.00163 ok
METEOR 100 significant negative -0.356 0.127 0.0003 -0.00159 ok
ROUGE-L 100 significant negative -0.356 0.127 0.0003 -0.00150 ok
BERTScore 100 significant negative -0.588 0.346 1.22e-10 -0.00039 ok
COMET 100 significant negative -0.473 0.224 6.51e-07 -0.00084 ok
BLEURT 100 significant negative -0.681 0.464 6.19e-15 -0.00259 ok
Trigram precision 100 significant negative -0.224 0.050 0.0252 -0.00197 ok
Trigram recall 100 significant negative -0.235 0.055 0.0188 -0.00203 ok
Trigram F1 100 significant negative -0.229 0.053 0.0216 -0.00200 ok
Trigram Jaccard 100 significant negative -0.253 0.064 0.0111 -0.00238 ok
gpt-5.5_v4_mini v1 BLEU-4 100 significant negative -0.387 0.149 7.11e-05 -0.00260 ok
chrF++ 100 significant negative -0.414 0.172 1.81e-05 -0.00179 ok
METEOR 100 significant negative -0.501 0.251 1.13e-07 -0.00264 ok
ROUGE-L 100 significant negative -0.495 0.245 1.65e-07 -0.00232 ok
BERTScore 100 significant negative -0.589 0.347 1.16e-10 -0.00051 ok
COMET 100 significant negative -0.414 0.172 1.83e-05 -0.00092 ok
BLEURT 100 significant negative -0.722 0.521 2.29e-17 -0.00274 ok
Trigram precision 100 significant negative -0.368 0.136 0.0002 -0.00293 ok
Trigram recall 100 significant negative -0.373 0.139 0.0001 -0.00294 ok
Trigram F1 100 significant negative -0.371 0.137 0.0001 -0.00292 ok
Trigram Jaccard 100 significant negative -0.363 0.131 0.0002 -0.00276 ok
gpt-5.5_v4_mini_high v1 BLEU-4 100 significant negative -0.367 0.135 0.0002 -0.00252 ok
chrF++ 100 significant negative -0.402 0.162 3.31e-05 -0.00162 ok
METEOR 100 significant negative -0.476 0.226 5.61e-07 -0.00235 ok
ROUGE-L 100 significant negative -0.510 0.260 5.94e-08 -0.00225 ok
BERTScore 100 significant negative -0.574 0.329 4.30e-10 -0.00044 ok
COMET 100 significant negative -0.420 0.176 1.36e-05 -0.00081 ok
BLEURT 100 significant negative -0.691 0.477 1.86e-15 -0.00246 ok
Trigram precision 100 significant negative -0.413 0.171 1.92e-05 -0.00341 ok
Trigram recall 100 significant negative -0.424 0.180 1.09e-05 -0.00339 ok
Trigram F1 100 significant negative -0.419 0.176 1.42e-05 -0.00339 ok
Trigram Jaccard 100 significant negative -0.410 0.168 2.31e-05 -0.00337 ok
gpt-5.5_v4_mini_medium v1 BLEU-4 100 significant negative -0.360 0.129 0.0002 -0.00221 ok
chrF++ 100 significant negative -0.396 0.157 4.52e-05 -0.00153 ok
METEOR 100 significant negative -0.508 0.258 6.75e-08 -0.00230 ok
ROUGE-L 100 significant negative -0.503 0.253 9.72e-08 -0.00210 ok
BERTScore 100 significant negative -0.576 0.332 3.66e-10 -0.00044 ok
COMET 100 significant negative -0.436 0.190 5.70e-06 -0.00084 ok
BLEURT 100 significant negative -0.709 0.503 1.47e-16 -0.00241 ok
Trigram precision 100 significant negative -0.383 0.147 8.44e-05 -0.00276 ok
Trigram recall 100 significant negative -0.393 0.154 5.34e-05 -0.00269 ok
Trigram F1 100 significant negative -0.389 0.151 6.42e-05 -0.00272 ok
Trigram Jaccard 100 significant negative -0.386 0.149 7.46e-05 -0.00252 ok
gpt-5.5_v4_reasoning v1 BLEU-4 100 significant negative -0.403 0.163 3.19e-05 -0.00295 ok
chrF++ 100 significant negative -0.408 0.166 2.57e-05 -0.00206 ok
METEOR 100 significant negative -0.397 0.157 4.39e-05 -0.00193 ok
ROUGE-L 100 significant negative -0.387 0.150 7.08e-05 -0.00184 ok
BERTScore 100 significant negative -0.478 0.228 4.98e-07 -0.00047 ok
COMET 100 significant negative -0.397 0.157 4.40e-05 -0.00102 ok
BLEURT 100 significant negative -0.676 0.457 1.18e-14 -0.00275 ok
Trigram precision 100 significant negative -0.334 0.111 0.0007 -0.00258 ok
Trigram recall 100 significant negative -0.339 0.115 0.0006 -0.00254 ok
Trigram F1 100 significant negative -0.337 0.114 0.0006 -0.00255 ok
Trigram Jaccard 100 significant negative -0.342 0.117 0.0005 -0.00277 ok
gpt-5.5_v4_reasoning_high v1 BLEU-4 100 significant negative -0.415 0.173 1.72e-05 -0.00289 ok
chrF++ 100 significant negative -0.441 0.195 4.36e-06 -0.00183 ok
METEOR 100 significant negative -0.464 0.216 1.14e-06 -0.00196 ok
ROUGE-L 100 significant negative -0.476 0.226 5.74e-07 -0.00189 ok
BERTScore 100 significant negative -0.614 0.377 1.07e-11 -0.00041 ok
COMET 100 significant negative -0.464 0.216 1.14e-06 -0.00087 ok
BLEURT 100 significant negative -0.708 0.502 1.65e-16 -0.00257 ok
Trigram precision 100 significant negative -0.340 0.116 0.0005 -0.00279 ok
Trigram recall 100 significant negative -0.352 0.124 0.0003 -0.00284 ok
Trigram F1 100 significant negative -0.347 0.120 0.0004 -0.00281 ok
Trigram Jaccard 100 significant negative -0.359 0.129 0.0002 -0.00316 ok
gpt-5.5_v4_reasoning_medium v1 BLEU-4 100 significant negative -0.478 0.229 4.90e-07 -0.00337 ok
chrF++ 100 significant negative -0.499 0.249 1.25e-07 -0.00214 ok
METEOR 100 significant negative -0.528 0.278 1.68e-08 -0.00226 ok
ROUGE-L 100 significant negative -0.534 0.285 1.04e-08 -0.00210 ok
BERTScore 100 significant negative -0.674 0.455 1.48e-14 -0.00047 ok
COMET 100 significant negative -0.477 0.227 5.32e-07 -0.00095 ok
BLEURT 100 significant negative -0.760 0.577 4.99e-20 -0.00289 ok
Trigram precision 100 significant negative -0.420 0.176 1.38e-05 -0.00327 ok
Trigram recall 100 significant negative -0.421 0.177 1.31e-05 -0.00323 ok
Trigram F1 100 significant negative -0.421 0.177 1.28e-05 -0.00325 ok
Trigram Jaccard 100 significant negative -0.401 0.161 3.49e-05 -0.00349 ok
gpt-5.6-sol v1 BLEU-4 100 negative -0.084 0.007 0.4037 -0.00039 ok
chrF++ 100 positive 0.017 2.75e-04 0.8700 0.00007 ok
METEOR 100 negative -0.107 0.012 0.2878 -0.00060 ok
ROUGE-L 100 negative -0.080 0.006 0.4285 -0.00039 ok
BERTScore 100 significant negative -0.212 0.045 0.0339 -0.00020 ok
COMET 100 negative -0.053 0.003 0.5980 -0.00014 ok
BLEURT 100 significant negative -0.422 0.178 1.21e-05 -0.00158 ok
Trigram precision 100 negative -0.064 0.004 0.5271 -0.00031 ok
Trigram recall 100 negative -0.076 0.006 0.4544 -0.00039 ok
Trigram F1 100 negative -0.069 0.005 0.4968 -0.00034 ok
Trigram Jaccard 100 negative -0.096 0.009 0.3418 -0.00032 ok
gpt-5.6-sol v2 BLEU-4 100 significant negative -0.407 0.165 2.70e-05 -0.00271 ok
chrF++ 100 significant negative -0.440 0.194 4.59e-06 -0.00184 ok
METEOR 100 significant negative -0.461 0.213 1.35e-06 -0.00199 ok
ROUGE-L 100 significant negative -0.409 0.167 2.42e-05 -0.00167 ok
BERTScore 100 significant negative -0.630 0.397 2.25e-12 -0.00048 ok
COMET 100 significant negative -0.514 0.264 4.63e-08 -0.00098 ok
BLEURT 100 significant negative -0.734 0.538 3.94e-18 -0.00268 ok
Trigram precision 100 significant negative -0.312 0.097 0.0016 -0.00230 ok
Trigram recall 100 significant negative -0.331 0.109 0.0008 -0.00239 ok
Trigram F1 100 significant negative -0.322 0.104 0.0011 -0.00234 ok
Trigram Jaccard 100 significant negative -0.325 0.106 0.0010 -0.00237 ok
gpt-5.6-sol v3 BLEU-4 100 significant negative -0.446 0.199 3.37e-06 -0.00304 ok
chrF++ 100 significant negative -0.483 0.233 3.61e-07 -0.00194 ok
METEOR 100 significant negative -0.496 0.246 1.54e-07 -0.00204 ok
ROUGE-L 100 significant negative -0.468 0.219 9.23e-07 -0.00183 ok
BERTScore 100 significant negative -0.631 0.398 1.98e-12 -0.00042 ok
COMET 100 significant negative -0.477 0.228 5.12e-07 -0.00084 ok
BLEURT 100 significant negative -0.740 0.548 1.43e-18 -0.00250 ok
Trigram precision 100 significant negative -0.346 0.120 0.0004 -0.00281 ok
Trigram recall 100 significant negative -0.362 0.131 0.0002 -0.00289 ok
Trigram F1 100 significant negative -0.355 0.126 0.0003 -0.00285 ok
Trigram Jaccard 100 significant negative -0.371 0.137 0.0001 -0.00315 ok
legacy_scholarly v3 BLEU-4 100 significant negative -0.366 0.134 0.0002 -0.00269 ok
chrF++ 100 significant negative -0.392 0.153 5.61e-05 -0.00174 ok
METEOR 100 significant negative -0.399 0.159 3.99e-05 -0.00185 ok
ROUGE-L 100 significant negative -0.419 0.176 1.42e-05 -0.00175 ok
BERTScore 100 significant negative -0.576 0.332 3.57e-10 -0.00041 ok
COMET 100 significant negative -0.381 0.145 9.03e-05 -0.00073 ok
BLEURT 100 significant negative -0.703 0.494 3.56e-16 -0.00266 ok
Trigram precision 100 significant negative -0.278 0.077 0.0051 -0.00217 ok
Trigram recall 100 significant negative -0.284 0.081 0.0041 -0.00220 ok
Trigram F1 100 significant negative -0.282 0.080 0.0045 -0.00218 ok
Trigram Jaccard 100 significant negative -0.277 0.077 0.0053 -0.00219 ok
paper_guidance_ablation_gpt56 v1 BLEU-4 100 significant negative -0.387 0.150 6.89e-05 -0.00258 ok
chrF++ 100 significant negative -0.424 0.180 1.09e-05 -0.00178 ok
METEOR 100 significant negative -0.447 0.199 3.20e-06 -0.00199 ok
ROUGE-L 100 significant negative -0.391 0.153 5.67e-05 -0.00165 ok
BERTScore 100 significant negative -0.584 0.341 1.85e-10 -0.00044 ok
COMET 100 significant negative -0.464 0.216 1.14e-06 -0.00089 ok
BLEURT 100 significant negative -0.699 0.488 6.40e-16 -0.00250 ok
Trigram precision 100 significant negative -0.291 0.085 0.0033 -0.00219 ok
Trigram recall 100 significant negative -0.318 0.101 0.0013 -0.00233 ok
Trigram F1 100 significant negative -0.305 0.093 0.0021 -0.00225 ok
Trigram Jaccard 100 significant negative -0.317 0.100 0.0013 -0.00230 ok
paper_guidance_ablation_gpt56 v2 BLEU-4 100 significant negative -0.452 0.204 2.36e-06 -0.00294 ok
chrF++ 100 significant negative -0.472 0.222 7.32e-07 -0.00195 ok
METEOR 100 significant negative -0.467 0.218 9.69e-07 -0.00218 ok
ROUGE-L 100 significant negative -0.440 0.194 4.64e-06 -0.00188 ok
BERTScore 100 significant negative -0.586 0.344 1.49e-10 -0.00041 ok
COMET 100 significant negative -0.412 0.170 2.01e-05 -0.00074 ok
BLEURT 100 significant negative -0.723 0.522 2.08e-17 -0.00249 ok
Trigram precision 100 significant negative -0.354 0.126 0.0003 -0.00260 ok
Trigram recall 100 significant negative -0.385 0.148 7.53e-05 -0.00280 ok
Trigram F1 100 significant negative -0.371 0.137 0.0001 -0.00270 ok
Trigram Jaccard 100 significant negative -0.368 0.136 0.0002 -0.00267 ok
paper_guidance_ablation_gpt56 v3 BLEU-4 100 significant negative -0.440 0.193 4.76e-06 -0.00289 ok
chrF++ 100 significant negative -0.474 0.225 6.19e-07 -0.00192 ok
METEOR 100 significant negative -0.488 0.239 2.53e-07 -0.00202 ok
ROUGE-L 100 significant negative -0.457 0.209 1.71e-06 -0.00183 ok
BERTScore 100 significant negative -0.633 0.400 1.67e-12 -0.00042 ok
COMET 100 significant negative -0.457 0.209 1.74e-06 -0.00080 ok
BLEURT 100 significant negative -0.705 0.496 2.82e-16 -0.00234 ok
Trigram precision 100 significant negative -0.350 0.123 0.0004 -0.00279 ok
Trigram recall 100 significant negative -0.380 0.144 9.83e-05 -0.00296 ok
Trigram F1 100 significant negative -0.365 0.133 0.0002 -0.00287 ok
Trigram Jaccard 100 significant negative -0.375 0.140 0.0001 -0.00320 ok

Downloadable Table

Generated by generate_translation_prompt_evaluation.py.