Metric vs Passage Length

Generated: 2026-11-05 01:58:33 UTC

Back to translation prompt evaluation.

Metric vs Passage Length Patterns

Passage length is measured as the source Greek token count when source text is available, falling back to human translation word count only when a source passage has no Greek tokens. Each row regresses one metric against passage length for one prompt version.

Evaluable regressions605
Positive40
Negative565
Significant positive0
Significant negative478

Across 605 evaluable metric/prompt regressions, negative correlations are more common: 40 positive, 565 negative, and 0 flat. Using p < 0.05, 0 are significantly positive and 478 are significantly negative.

Prompt Metric Rows Pattern Pearson r R^2 P-value Slope Status
claude_fable_5 v1 BLEU-4 100 negative -0.095 0.009 0.3474 -0.00041 ok
chrF++ 100 negative -0.104 0.011 0.3044 -0.00031 ok
METEOR 100 significant negative -0.223 0.050 0.0260 -0.00094 ok
ROUGE-L 100 significant negative -0.263 0.069 0.0082 -0.00088 ok
BERTScore 100 significant negative -0.481 0.232 3.98e-07 -0.00032 ok
COMET 100 negative -0.169 0.029 0.0928 -0.00033 ok
BLEURT 100 significant negative -0.678 0.460 9.03e-15 -0.00175 ok
Trigram precision 100 negative -0.018 3.35e-04 0.8566 -0.00009 ok
Trigram recall 100 negative -0.014 2.02e-04 0.8885 -0.00007 ok
Trigram F1 100 negative -0.015 2.26e-04 0.8821 -0.00007 ok
Trigram Jaccard 100 negative -0.038 0.001 0.7055 -0.00013 ok
claude_fable_5 v2 BLEU-4 100 significant negative -0.414 0.172 1.81e-05 -0.00256 ok
chrF++ 100 significant negative -0.459 0.211 1.58e-06 -0.00168 ok
METEOR 100 significant negative -0.466 0.217 1.03e-06 -0.00192 ok
ROUGE-L 100 significant negative -0.457 0.209 1.75e-06 -0.00166 ok
BERTScore 100 significant negative -0.612 0.374 1.34e-11 -0.00043 ok
COMET 100 significant negative -0.484 0.234 3.32e-07 -0.00087 ok
BLEURT 100 significant negative -0.720 0.518 3.16e-17 -0.00238 ok
Trigram precision 100 significant negative -0.337 0.114 0.0006 -0.00237 ok
Trigram recall 100 significant negative -0.361 0.130 0.0002 -0.00252 ok
Trigram F1 100 significant negative -0.350 0.123 0.0004 -0.00244 ok
Trigram Jaccard 100 significant negative -0.349 0.122 0.0004 -0.00240 ok
claude_fable_5 v3 BLEU-4 100 significant negative -0.435 0.189 6.21e-06 -0.00276 ok
chrF++ 100 significant negative -0.484 0.235 3.30e-07 -0.00182 ok
METEOR 100 significant negative -0.455 0.207 2.03e-06 -0.00181 ok
ROUGE-L 100 significant negative -0.464 0.215 1.18e-06 -0.00172 ok
BERTScore 100 significant negative -0.657 0.431 1.18e-13 -0.00041 ok
COMET 100 significant negative -0.505 0.255 8.48e-08 -0.00090 ok
BLEURT 100 significant negative -0.765 0.586 1.81e-20 -0.00262 ok
Trigram precision 100 significant negative -0.335 0.112 0.0007 -0.00257 ok
Trigram recall 100 significant negative -0.352 0.124 0.0003 -0.00262 ok
Trigram F1 100 significant negative -0.344 0.118 0.0005 -0.00259 ok
Trigram Jaccard 100 significant negative -0.344 0.118 0.0005 -0.00286 ok
claude_opus_4_8 v1 BLEU-4 100 negative -0.008 6.92e-05 0.9345 -0.00003 ok
chrF++ 100 negative -7.12e-05 5.07e-09 0.9994 -2.02e-07 ok
METEOR 100 negative -0.172 0.029 0.0876 -0.00077 ok
ROUGE-L 100 negative -0.190 0.036 0.0580 -0.00065 ok
BERTScore 100 significant negative -0.283 0.080 0.0043 -0.00020 ok
COMET 100 positive 0.026 6.93e-04 0.7949 0.00004 ok
BLEURT 100 significant negative -0.588 0.346 1.26e-10 -0.00154 ok
Trigram precision 100 negative -0.014 1.94e-04 0.8907 -0.00005 ok
Trigram recall 100 negative -0.043 0.002 0.6741 -0.00017 ok
Trigram F1 100 negative -0.024 5.63e-04 0.8147 -0.00009 ok
Trigram Jaccard 100 negative -0.038 0.001 0.7041 -0.00009 ok
claude_opus_4_8 v2 BLEU-4 100 significant negative -0.459 0.210 1.61e-06 -0.00284 ok
chrF++ 100 significant negative -0.478 0.228 5.02e-07 -0.00183 ok
METEOR 100 significant negative -0.514 0.264 4.50e-08 -0.00214 ok
ROUGE-L 100 significant negative -0.530 0.281 1.41e-08 -0.00203 ok
BERTScore 100 significant negative -0.628 0.395 2.61e-12 -0.00047 ok
COMET 100 significant negative -0.468 0.219 9.11e-07 -0.00089 ok
BLEURT 100 significant negative -0.728 0.530 8.94e-18 -0.00249 ok
Trigram precision 100 significant negative -0.401 0.161 3.57e-05 -0.00289 ok
Trigram recall 100 significant negative -0.409 0.167 2.40e-05 -0.00292 ok
Trigram F1 100 significant negative -0.406 0.165 2.74e-05 -0.00290 ok
Trigram Jaccard 100 significant negative -0.388 0.150 6.74e-05 -0.00274 ok
claude_opus_4_8 v3 BLEU-4 100 significant negative -0.419 0.175 1.44e-05 -0.00284 ok
chrF++ 100 significant negative -0.459 0.211 1.55e-06 -0.00181 ok
METEOR 100 significant negative -0.493 0.243 1.86e-07 -0.00222 ok
ROUGE-L 100 significant negative -0.522 0.273 2.51e-08 -0.00209 ok
BERTScore 100 significant negative -0.654 0.428 1.54e-13 -0.00044 ok
COMET 100 significant negative -0.493 0.243 1.91e-07 -0.00091 ok
BLEURT 100 significant negative -0.732 0.536 5.17e-18 -0.00258 ok
Trigram precision 100 significant negative -0.401 0.161 3.60e-05 -0.00325 ok
Trigram recall 100 significant negative -0.410 0.168 2.32e-05 -0.00331 ok
Trigram F1 100 significant negative -0.406 0.165 2.76e-05 -0.00328 ok
Trigram Jaccard 100 significant negative -0.394 0.155 5.04e-05 -0.00348 ok
claude_sonnet_5 v1 BLEU-4 100 positive 0.051 0.003 0.6163 0.00021 ok
chrF++ 100 positive 0.020 4.10e-04 0.8416 0.00006 ok
METEOR 100 negative -0.156 0.024 0.1214 -0.00069 ok
ROUGE-L 100 negative -0.192 0.037 0.0550 -0.00072 ok
BERTScore 100 significant negative -0.349 0.122 0.0004 -0.00029 ok
COMET 100 negative -0.100 0.010 0.3232 -0.00018 ok
BLEURT 100 significant negative -0.603 0.364 3.11e-11 -0.00172 ok
Trigram precision 100 negative -0.002 5.75e-06 0.9811 -0.00001 ok
Trigram recall 100 negative -0.029 8.52e-04 0.7731 -0.00014 ok
Trigram F1 100 negative -0.013 1.80e-04 0.8946 -0.00006 ok
Trigram Jaccard 100 negative -0.028 7.83e-04 0.7823 -0.00008 ok
claude_sonnet_5 v2 BLEU-4 100 significant negative -0.339 0.115 0.0006 -0.00204 ok
chrF++ 100 significant negative -0.362 0.131 0.0002 -0.00128 ok
METEOR 100 significant negative -0.504 0.254 8.79e-08 -0.00222 ok
ROUGE-L 100 significant negative -0.494 0.244 1.76e-07 -0.00187 ok
BERTScore 100 significant negative -0.537 0.288 8.71e-09 -0.00040 ok
COMET 100 significant negative -0.413 0.170 1.97e-05 -0.00071 ok
BLEURT 100 significant negative -0.723 0.522 2.12e-17 -0.00223 ok
Trigram precision 100 significant negative -0.362 0.131 0.0002 -0.00255 ok
Trigram recall 100 significant negative -0.366 0.134 0.0002 -0.00255 ok
Trigram F1 100 significant negative -0.365 0.134 0.0002 -0.00255 ok
Trigram Jaccard 100 significant negative -0.366 0.134 0.0002 -0.00233 ok
claude_sonnet_5 v3 BLEU-4 100 significant negative -0.419 0.175 1.47e-05 -0.00283 ok
chrF++ 100 significant negative -0.457 0.209 1.75e-06 -0.00178 ok
METEOR 100 significant negative -0.521 0.272 2.66e-08 -0.00214 ok
ROUGE-L 100 significant negative -0.528 0.279 1.63e-08 -0.00213 ok
BERTScore 100 significant negative -0.640 0.409 7.79e-13 -0.00043 ok
COMET 100 significant negative -0.517 0.267 3.65e-08 -0.00090 ok
BLEURT 100 significant negative -0.741 0.549 1.20e-18 -0.00246 ok
Trigram precision 100 significant negative -0.406 0.165 2.75e-05 -0.00348 ok
Trigram recall 100 significant negative -0.409 0.167 2.45e-05 -0.00343 ok
Trigram F1 100 significant negative -0.408 0.166 2.56e-05 -0.00345 ok
Trigram Jaccard 100 significant negative -0.409 0.168 2.33e-05 -0.00386 ok
gpt-4-turbo-2024-04-09 v1 BLEU-4 100 positive 0.047 0.002 0.6420 0.00018 ok
chrF++ 100 positive 0.065 0.004 0.5216 0.00020 ok
METEOR 100 negative -0.180 0.032 0.0737 -0.00093 ok
ROUGE-L 100 negative -0.104 0.011 0.3022 -0.00041 ok
BERTScore 100 significant negative -0.237 0.056 0.0178 -0.00019 ok
COMET 100 negative -0.136 0.018 0.1789 -0.00023 ok
BLEURT 100 significant negative -0.690 0.476 1.96e-15 -0.00207 ok
Trigram precision 100 negative -0.012 1.45e-04 0.9054 -0.00005 ok
Trigram recall 100 negative -0.073 0.005 0.4724 -0.00034 ok
Trigram F1 100 negative -0.041 0.002 0.6861 -0.00018 ok
Trigram Jaccard 100 negative -0.059 0.003 0.5623 -0.00017 ok
gpt-4-turbo-2024-04-09 v2 BLEU-4 100 significant negative -0.460 0.212 1.47e-06 -0.00306 ok
chrF++ 100 significant negative -0.446 0.199 3.36e-06 -0.00195 ok
METEOR 100 significant negative -0.503 0.253 9.70e-08 -0.00283 ok
ROUGE-L 100 significant negative -0.501 0.251 1.09e-07 -0.00247 ok
BERTScore 100 significant negative -0.617 0.381 8.27e-12 -0.00055 ok
COMET 100 significant negative -0.464 0.215 1.17e-06 -0.00090 ok
BLEURT 100 significant negative -0.759 0.576 5.69e-20 -0.00301 ok
Trigram precision 100 significant negative -0.410 0.168 2.25e-05 -0.00324 ok
Trigram recall 100 significant negative -0.421 0.178 1.26e-05 -0.00332 ok
Trigram F1 100 significant negative -0.417 0.174 1.61e-05 -0.00327 ok
Trigram Jaccard 100 significant negative -0.397 0.158 4.35e-05 -0.00286 ok
gpt-4-turbo-2024-04-09 v3 BLEU-4 100 significant negative -0.356 0.127 0.0003 -0.00204 ok
chrF++ 100 significant negative -0.346 0.120 0.0004 -0.00134 ok
METEOR 100 significant negative -0.464 0.215 1.17e-06 -0.00228 ok
ROUGE-L 100 significant negative -0.441 0.195 4.33e-06 -0.00196 ok
BERTScore 100 significant negative -0.506 0.256 7.79e-08 -0.00043 ok
COMET 100 significant negative -0.339 0.115 0.0006 -0.00063 ok
BLEURT 100 significant negative -0.744 0.554 7.28e-19 -0.00245 ok
Trigram precision 100 significant negative -0.319 0.102 0.0012 -0.00210 ok
Trigram recall 100 significant negative -0.349 0.122 0.0004 -0.00224 ok
Trigram F1 100 significant negative -0.334 0.112 0.0007 -0.00216 ok
Trigram Jaccard 100 significant negative -0.333 0.111 0.0007 -0.00174 ok
gpt-4.1-2025-04-14 v1 BLEU-4 100 positive 0.059 0.004 0.5577 0.00024 ok
chrF++ 100 positive 0.115 0.013 0.2533 0.00036 ok
METEOR 100 negative -0.129 0.017 0.2002 -0.00062 ok
ROUGE-L 100 negative -0.136 0.018 0.1778 -0.00054 ok
BERTScore 100 significant negative -0.265 0.070 0.0077 -0.00023 ok
COMET 100 negative -0.043 0.002 0.6738 -0.00007 ok
BLEURT 100 significant negative -0.638 0.408 8.90e-13 -0.00182 ok
Trigram precision 100 positive 0.051 0.003 0.6155 0.00022 ok
Trigram recall 100 positive 0.018 3.11e-04 0.8617 0.00008 ok
Trigram F1 100 positive 0.036 0.001 0.7220 0.00016 ok
Trigram Jaccard 100 positive 0.004 1.31e-05 0.9715 0.00001 ok
gpt-4.1-2025-04-14 v2 BLEU-4 100 significant negative -0.292 0.085 0.0032 -0.00180 ok
chrF++ 100 significant negative -0.291 0.085 0.0033 -0.00117 ok
METEOR 100 significant negative -0.371 0.138 0.0001 -0.00191 ok
ROUGE-L 100 significant negative -0.387 0.150 7.05e-05 -0.00173 ok
BERTScore 100 significant negative -0.562 0.316 1.13e-09 -0.00044 ok
COMET 100 significant negative -0.392 0.153 5.62e-05 -0.00072 ok
BLEURT 100 significant negative -0.701 0.492 4.43e-16 -0.00231 ok
Trigram precision 100 significant negative -0.276 0.076 0.0054 -0.00201 ok
Trigram recall 100 significant negative -0.291 0.084 0.0034 -0.00209 ok
Trigram F1 100 significant negative -0.283 0.080 0.0043 -0.00205 ok
Trigram Jaccard 100 significant negative -0.290 0.084 0.0034 -0.00185 ok
gpt-4.1-2025-04-14 v3 BLEU-4 100 significant negative -0.328 0.107 0.0009 -0.00206 ok
chrF++ 100 significant negative -0.374 0.140 0.0001 -0.00143 ok
METEOR 100 significant negative -0.484 0.234 3.48e-07 -0.00216 ok
ROUGE-L 100 significant negative -0.490 0.240 2.32e-07 -0.00207 ok
BERTScore 100 significant negative -0.633 0.401 1.53e-12 -0.00049 ok
COMET 100 significant negative -0.425 0.180 1.07e-05 -0.00082 ok
BLEURT 100 significant negative -0.755 0.569 1.24e-19 -0.00259 ok
Trigram precision 100 significant negative -0.366 0.134 0.0002 -0.00290 ok
Trigram recall 100 significant negative -0.362 0.131 0.0002 -0.00285 ok
Trigram F1 100 significant negative -0.364 0.132 0.0002 -0.00286 ok
Trigram Jaccard 100 significant negative -0.352 0.124 0.0003 -0.00290 ok
gpt-4o-2024-05-13 v1 BLEU-4 100 negative -0.069 0.005 0.4960 -0.00029 ok
chrF++ 100 significant negative -0.228 0.052 0.0223 -0.00079 ok
METEOR 100 significant negative -0.321 0.103 0.0011 -0.00161 ok
ROUGE-L 100 significant negative -0.334 0.111 0.0007 -0.00148 ok
BERTScore 100 significant negative -0.439 0.193 4.88e-06 -0.00038 ok
COMET 100 significant negative -0.408 0.167 2.48e-05 -0.00083 ok
BLEURT 100 significant negative -0.644 0.415 4.91e-13 -0.00211 ok
Trigram precision 100 negative -0.048 0.002 0.6362 -0.00022 ok
Trigram recall 100 negative -0.107 0.011 0.2901 -0.00052 ok
Trigram F1 100 negative -0.094 0.009 0.3533 -0.00045 ok
Trigram Jaccard 100 negative -0.107 0.012 0.2882 -0.00034 ok
gpt-4o-2024-05-13 v2 BLEU-4 100 significant negative -0.349 0.122 0.0004 -0.00206 ok
chrF++ 100 significant negative -0.373 0.139 0.0001 -0.00157 ok
METEOR 100 significant negative -0.441 0.195 4.37e-06 -0.00232 ok
ROUGE-L 100 significant negative -0.446 0.199 3.24e-06 -0.00213 ok
BERTScore 100 significant negative -0.560 0.314 1.38e-09 -0.00051 ok
COMET 100 significant negative -0.390 0.152 6.01e-05 -0.00084 ok
BLEURT 100 significant negative -0.710 0.504 1.31e-16 -0.00261 ok
Trigram precision 100 significant negative -0.300 0.090 0.0025 -0.00208 ok
Trigram recall 100 significant negative -0.324 0.105 0.0010 -0.00213 ok
Trigram F1 100 significant negative -0.316 0.100 0.0014 -0.00212 ok
Trigram Jaccard 100 significant negative -0.315 0.099 0.0014 -0.00180 ok
gpt-4o-2024-05-13 v3 BLEU-4 100 significant negative -0.323 0.104 0.0011 -0.00225 ok
chrF++ 100 significant negative -0.383 0.147 8.23e-05 -0.00176 ok
METEOR 100 significant negative -0.461 0.213 1.36e-06 -0.00258 ok
ROUGE-L 100 significant negative -0.453 0.205 2.20e-06 -0.00230 ok
BERTScore 100 significant negative -0.530 0.280 1.46e-08 -0.00047 ok
COMET 100 significant negative -0.411 0.169 2.19e-05 -0.00091 ok
BLEURT 100 significant negative -0.714 0.510 7.04e-17 -0.00275 ok
Trigram precision 100 significant negative -0.312 0.097 0.0016 -0.00285 ok
Trigram recall 100 significant negative -0.334 0.111 0.0007 -0.00300 ok
Trigram F1 100 significant negative -0.326 0.106 0.0009 -0.00294 ok
Trigram Jaccard 100 significant negative -0.326 0.106 0.0009 -0.00299 ok
gpt-4o-2024-08-06 v1 BLEU-4 100 negative -0.029 8.17e-04 0.7778 -0.00011 ok
chrF++ 100 negative -0.004 2.01e-05 0.9647 -0.00001 ok
METEOR 100 negative -0.161 0.026 0.1089 -0.00085 ok
ROUGE-L 100 negative -0.192 0.037 0.0563 -0.00080 ok
BERTScore 100 significant negative -0.317 0.100 0.0013 -0.00026 ok
COMET 100 negative -0.154 0.024 0.1254 -0.00024 ok
BLEURT 100 significant negative -0.670 0.449 2.48e-14 -0.00214 ok
Trigram precision 100 negative -0.026 6.90e-04 0.7952 -0.00012 ok
Trigram recall 100 negative -0.072 0.005 0.4746 -0.00036 ok
Trigram F1 100 negative -0.047 0.002 0.6438 -0.00022 ok
Trigram Jaccard 100 negative -0.063 0.004 0.5333 -0.00021 ok
gpt-4o-2024-08-06 v2 BLEU-4 100 significant negative -0.339 0.115 0.0006 -0.00193 ok
chrF++ 100 significant negative -0.367 0.134 0.0002 -0.00138 ok
METEOR 100 significant negative -0.461 0.213 1.38e-06 -0.00228 ok
ROUGE-L 100 significant negative -0.447 0.200 3.06e-06 -0.00194 ok
BERTScore 100 significant negative -0.627 0.393 3.08e-12 -0.00052 ok
COMET 100 significant negative -0.418 0.175 1.51e-05 -0.00078 ok
BLEURT 100 significant negative -0.761 0.579 4.01e-20 -0.00272 ok
Trigram precision 100 significant negative -0.324 0.105 0.0010 -0.00223 ok
Trigram recall 100 significant negative -0.327 0.107 0.0009 -0.00224 ok
Trigram F1 100 significant negative -0.326 0.107 0.0009 -0.00223 ok
Trigram Jaccard 100 significant negative -0.322 0.104 0.0011 -0.00190 ok
gpt-4o-2024-08-06 v3 BLEU-4 100 significant negative -0.328 0.108 0.0008 -0.00234 ok
chrF++ 100 significant negative -0.375 0.141 0.0001 -0.00159 ok
METEOR 100 significant negative -0.444 0.197 3.65e-06 -0.00228 ok
ROUGE-L 100 significant negative -0.488 0.238 2.65e-07 -0.00226 ok
BERTScore 100 significant negative -0.599 0.359 4.49e-11 -0.00050 ok
COMET 100 significant negative -0.399 0.159 3.85e-05 -0.00081 ok
BLEURT 100 significant negative -0.663 0.439 5.77e-14 -0.00248 ok
Trigram precision 100 significant negative -0.348 0.121 0.0004 -0.00301 ok
Trigram recall 100 significant negative -0.346 0.120 0.0004 -0.00292 ok
Trigram F1 100 significant negative -0.347 0.120 0.0004 -0.00295 ok
Trigram Jaccard 100 significant negative -0.343 0.118 0.0005 -0.00298 ok
gpt-4o-2024-11-20 v1 BLEU-4 100 negative -0.071 0.005 0.4839 -0.00028 ok
chrF++ 100 negative -0.009 8.57e-05 0.9272 -0.00003 ok
METEOR 100 significant negative -0.265 0.070 0.0078 -0.00129 ok
ROUGE-L 100 significant negative -0.233 0.054 0.0199 -0.00095 ok
BERTScore 100 significant negative -0.306 0.093 0.0020 -0.00027 ok
COMET 100 negative -0.097 0.009 0.3364 -0.00016 ok
BLEURT 100 significant negative -0.649 0.421 2.98e-13 -0.00188 ok
Trigram precision 100 negative -0.090 0.008 0.3735 -0.00038 ok
Trigram recall 100 negative -0.120 0.014 0.2346 -0.00055 ok
Trigram F1 100 negative -0.103 0.011 0.3101 -0.00045 ok
Trigram Jaccard 100 negative -0.115 0.013 0.2556 -0.00034 ok
gpt-4o-2024-11-20 v2 BLEU-4 100 significant negative -0.330 0.109 0.0008 -0.00203 ok
chrF++ 100 significant negative -0.372 0.138 0.0001 -0.00143 ok
METEOR 100 significant negative -0.464 0.215 1.17e-06 -0.00234 ok
ROUGE-L 100 significant negative -0.418 0.175 1.53e-05 -0.00184 ok
BERTScore 100 significant negative -0.600 0.360 4.14e-11 -0.00048 ok
COMET 100 significant negative -0.406 0.165 2.71e-05 -0.00077 ok
BLEURT 100 significant negative -0.743 0.553 8.08e-19 -0.00249 ok
Trigram precision 100 significant negative -0.305 0.093 0.0020 -0.00215 ok
Trigram recall 100 significant negative -0.313 0.098 0.0015 -0.00222 ok
Trigram F1 100 significant negative -0.310 0.096 0.0017 -0.00218 ok
Trigram Jaccard 100 significant negative -0.309 0.095 0.0018 -0.00195 ok
gpt-4o-2024-11-20 v3 BLEU-4 100 significant negative -0.368 0.135 0.0002 -0.00227 ok
chrF++ 100 significant negative -0.360 0.129 0.0002 -0.00138 ok
METEOR 100 significant negative -0.468 0.219 9.22e-07 -0.00225 ok
ROUGE-L 100 significant negative -0.479 0.230 4.59e-07 -0.00213 ok
BERTScore 100 significant negative -0.628 0.394 2.77e-12 -0.00048 ok
COMET 100 significant negative -0.386 0.149 7.32e-05 -0.00069 ok
BLEURT 100 significant negative -0.737 0.543 2.39e-18 -0.00250 ok
Trigram precision 100 significant negative -0.367 0.135 0.0002 -0.00298 ok
Trigram recall 100 significant negative -0.363 0.132 0.0002 -0.00290 ok
Trigram F1 100 significant negative -0.365 0.133 0.0002 -0.00293 ok
Trigram Jaccard 100 significant negative -0.350 0.122 0.0004 -0.00284 ok
gpt-5 v1 BLEU-4 100 positive 0.056 0.003 0.5833 0.00024 ok
chrF++ 100 positive 0.040 0.002 0.6931 0.00013 ok
METEOR 100 negative -0.129 0.017 0.2014 -0.00059 ok
ROUGE-L 100 negative -0.131 0.017 0.1950 -0.00048 ok
BERTScore 100 significant negative -0.247 0.061 0.0133 -0.00017 ok
COMET 100 negative -0.029 8.31e-04 0.7759 -0.00005 ok
BLEURT 100 significant negative -0.628 0.394 2.77e-12 -0.00181 ok
Trigram precision 100 positive 0.018 3.37e-04 0.8561 0.00008 ok
Trigram recall 100 positive 0.003 6.65e-06 0.9797 0.00001 ok
Trigram F1 100 positive 0.012 1.38e-04 0.9075 0.00005 ok
Trigram Jaccard 100 negative -0.017 2.81e-04 0.8685 -0.00005 ok
gpt-5 v2 BLEU-4 100 significant negative -0.425 0.180 1.06e-05 -0.00271 ok
chrF++ 100 significant negative -0.467 0.218 9.48e-07 -0.00184 ok
METEOR 100 significant negative -0.489 0.239 2.46e-07 -0.00231 ok
ROUGE-L 100 significant negative -0.436 0.190 5.90e-06 -0.00174 ok
BERTScore 100 significant negative -0.680 0.462 7.47e-15 -0.00052 ok
COMET 100 significant negative -0.522 0.273 2.51e-08 -0.00100 ok
BLEURT 100 significant negative -0.810 0.656 1.97e-24 -0.00323 ok
Trigram precision 100 significant negative -0.303 0.092 0.0021 -0.00224 ok
Trigram recall 100 significant negative -0.340 0.115 0.0005 -0.00250 ok
Trigram F1 100 significant negative -0.324 0.105 0.0010 -0.00238 ok
Trigram Jaccard 100 significant negative -0.320 0.103 0.0012 -0.00229 ok
gpt-5 v3 BLEU-4 100 significant negative -0.380 0.144 9.80e-05 -0.00241 ok
chrF++ 100 significant negative -0.446 0.199 3.29e-06 -0.00166 ok
METEOR 100 significant negative -0.528 0.278 1.70e-08 -0.00250 ok
ROUGE-L 100 significant negative -0.472 0.223 7.08e-07 -0.00198 ok
BERTScore 100 significant negative -0.610 0.372 1.62e-11 -0.00042 ok
COMET 100 significant negative -0.479 0.230 4.60e-07 -0.00089 ok
BLEURT 100 significant negative -0.754 0.569 1.31e-19 -0.00259 ok
Trigram precision 100 significant negative -0.375 0.141 0.0001 -0.00310 ok
Trigram recall 100 significant negative -0.383 0.146 8.53e-05 -0.00316 ok
Trigram F1 100 significant negative -0.379 0.144 9.87e-05 -0.00313 ok
Trigram Jaccard 100 significant negative -0.372 0.139 0.0001 -0.00340 ok
gpt-5.1 v1 BLEU-4 100 positive 0.128 0.016 0.2055 0.00052 ok
chrF++ 100 positive 0.111 0.012 0.2708 0.00032 ok
METEOR 100 negative -0.063 0.004 0.5306 -0.00028 ok
ROUGE-L 100 negative -0.139 0.019 0.1690 -0.00054 ok
BERTScore 100 significant negative -0.295 0.087 0.0029 -0.00023 ok
COMET 100 positive 0.011 1.30e-04 0.9104 0.00002 ok
BLEURT 100 significant negative -0.631 0.399 1.88e-12 -0.00179 ok
Trigram precision 100 positive 0.048 0.002 0.6385 0.00021 ok
Trigram recall 100 positive 0.061 0.004 0.5442 0.00029 ok
Trigram F1 100 positive 0.056 0.003 0.5822 0.00026 ok
Trigram Jaccard 100 positive 0.030 9.13e-04 0.7654 0.00009 ok
gpt-5.1 v2 BLEU-4 100 significant negative -0.312 0.097 0.0016 -0.00203 ok
chrF++ 100 significant negative -0.333 0.111 0.0007 -0.00132 ok
METEOR 100 significant negative -0.406 0.165 2.74e-05 -0.00191 ok
ROUGE-L 100 significant negative -0.364 0.132 0.0002 -0.00153 ok
BERTScore 100 significant negative -0.575 0.331 3.87e-10 -0.00045 ok
COMET 100 significant negative -0.414 0.171 1.86e-05 -0.00080 ok
BLEURT 100 significant negative -0.733 0.537 4.42e-18 -0.00259 ok
Trigram precision 100 significant negative -0.286 0.082 0.0039 -0.00216 ok
Trigram recall 100 significant negative -0.285 0.081 0.0041 -0.00212 ok
Trigram F1 100 significant negative -0.285 0.081 0.0040 -0.00213 ok
Trigram Jaccard 100 significant negative -0.291 0.084 0.0034 -0.00209 ok
gpt-5.1 v3 BLEU-4 100 significant negative -0.340 0.116 0.0005 -0.00200 ok
chrF++ 100 significant negative -0.377 0.142 0.0001 -0.00135 ok
METEOR 100 significant negative -0.468 0.219 9.25e-07 -0.00211 ok
ROUGE-L 100 significant negative -0.479 0.230 4.59e-07 -0.00192 ok
BERTScore 100 significant negative -0.595 0.354 6.91e-11 -0.00043 ok
COMET 100 significant negative -0.411 0.169 2.18e-05 -0.00078 ok
BLEURT 100 significant negative -0.717 0.513 5.17e-17 -0.00238 ok
Trigram precision 100 significant negative -0.362 0.131 0.0002 -0.00274 ok
Trigram recall 100 significant negative -0.363 0.132 0.0002 -0.00270 ok
Trigram F1 100 significant negative -0.362 0.131 0.0002 -0.00271 ok
Trigram Jaccard 100 significant negative -0.349 0.122 0.0004 -0.00272 ok
gpt-5.2 v1 BLEU-4 100 negative -0.089 0.008 0.3805 -0.00040 ok
chrF++ 100 negative -0.108 0.012 0.2829 -0.00035 ok
METEOR 100 negative -0.182 0.033 0.0703 -0.00086 ok
ROUGE-L 100 negative -0.101 0.010 0.3190 -0.00042 ok
BERTScore 100 significant negative -0.287 0.082 0.0038 -0.00020 ok
COMET 100 negative -0.007 4.74e-05 0.9458 -0.00001 ok
BLEURT 100 significant negative -0.640 0.410 7.30e-13 -0.00197 ok
Trigram precision 100 positive 0.022 4.82e-04 0.8284 0.00010 ok
Trigram recall 100 negative -0.038 0.001 0.7076 -0.00018 ok
Trigram F1 100 negative -0.003 1.06e-05 0.9744 -0.00002 ok
Trigram Jaccard 100 negative -0.022 4.64e-04 0.8316 -0.00006 ok
gpt-5.2 v2 BLEU-4 100 significant negative -0.404 0.163 3.04e-05 -0.00276 ok
chrF++ 100 significant negative -0.471 0.222 7.51e-07 -0.00201 ok
METEOR 100 significant negative -0.480 0.231 4.29e-07 -0.00224 ok
ROUGE-L 100 significant negative -0.444 0.197 3.75e-06 -0.00175 ok
BERTScore 100 significant negative -0.609 0.371 1.81e-11 -0.00049 ok
COMET 100 significant negative -0.491 0.241 2.11e-07 -0.00103 ok
BLEURT 100 significant negative -0.739 0.545 1.81e-18 -0.00292 ok
Trigram precision 100 significant negative -0.314 0.099 0.0015 -0.00236 ok
Trigram recall 100 significant negative -0.335 0.112 0.0007 -0.00250 ok
Trigram F1 100 significant negative -0.325 0.106 0.0010 -0.00243 ok
Trigram Jaccard 100 significant negative -0.332 0.110 0.0008 -0.00240 ok
gpt-5.2 v3 BLEU-4 100 significant negative -0.312 0.097 0.0016 -0.00205 ok
chrF++ 100 significant negative -0.335 0.112 0.0007 -0.00137 ok
METEOR 100 significant negative -0.368 0.136 0.0002 -0.00163 ok
ROUGE-L 100 significant negative -0.347 0.120 0.0004 -0.00145 ok
BERTScore 100 significant negative -0.587 0.345 1.34e-10 -0.00044 ok
COMET 100 significant negative -0.406 0.165 2.75e-05 -0.00075 ok
BLEURT 100 significant negative -0.706 0.499 2.20e-16 -0.00248 ok
Trigram precision 100 significant negative -0.277 0.077 0.0053 -0.00215 ok
Trigram recall 100 significant negative -0.282 0.079 0.0045 -0.00211 ok
Trigram F1 100 significant negative -0.279 0.078 0.0050 -0.00212 ok
Trigram Jaccard 100 significant negative -0.289 0.083 0.0036 -0.00228 ok
gpt-5.3-chat-latest v1 BLEU-4 100 positive 0.021 4.22e-04 0.8393 0.00010 ok
chrF++ 100 positive 0.035 0.001 0.7278 0.00012 ok
METEOR 100 negative -0.031 9.47e-04 0.7612 -0.00015 ok
ROUGE-L 100 negative -0.068 0.005 0.5028 -0.00029 ok
BERTScore 100 significant negative -0.342 0.117 0.0005 -0.00026 ok
COMET 100 negative -0.194 0.038 0.0534 -0.00038 ok
BLEURT 100 significant negative -0.693 0.481 1.29e-15 -0.00212 ok
Trigram precision 100 positive 0.016 2.62e-04 0.8729 0.00008 ok
Trigram recall 100 positive 0.013 1.70e-04 0.8975 0.00006 ok
Trigram F1 100 positive 0.015 2.30e-04 0.8809 0.00007 ok
Trigram Jaccard 100 negative -0.005 2.11e-05 0.9638 -0.00001 ok
gpt-5.3-chat-latest v2 BLEU-4 100 significant negative -0.395 0.156 4.87e-05 -0.00249 ok
chrF++ 100 significant negative -0.434 0.189 6.35e-06 -0.00172 ok
METEOR 100 significant negative -0.458 0.210 1.69e-06 -0.00207 ok
ROUGE-L 100 significant negative -0.406 0.165 2.71e-05 -0.00166 ok
BERTScore 100 significant negative -0.579 0.335 2.86e-10 -0.00047 ok
COMET 100 significant negative -0.474 0.224 6.43e-07 -0.00091 ok
BLEURT 100 significant negative -0.742 0.551 1.02e-18 -0.00274 ok
Trigram precision 100 significant negative -0.319 0.102 0.0012 -0.00224 ok
Trigram recall 100 significant negative -0.349 0.122 0.0004 -0.00242 ok
Trigram F1 100 significant negative -0.335 0.112 0.0006 -0.00233 ok
Trigram Jaccard 100 significant negative -0.339 0.115 0.0006 -0.00223 ok
gpt-5.3-chat-latest v3 BLEU-4 100 significant negative -0.381 0.145 9.16e-05 -0.00225 ok
chrF++ 100 significant negative -0.400 0.160 3.69e-05 -0.00153 ok
METEOR 100 significant negative -0.406 0.165 2.83e-05 -0.00174 ok
ROUGE-L 100 significant negative -0.426 0.181 1.01e-05 -0.00166 ok
BERTScore 100 significant negative -0.558 0.311 1.62e-09 -0.00041 ok
COMET 100 significant negative -0.423 0.179 1.14e-05 -0.00078 ok
BLEURT 100 significant negative -0.723 0.523 1.98e-17 -0.00247 ok
Trigram precision 100 significant negative -0.320 0.102 0.0012 -0.00232 ok
Trigram recall 100 significant negative -0.337 0.114 0.0006 -0.00242 ok
Trigram F1 100 significant negative -0.328 0.108 0.0009 -0.00235 ok
Trigram Jaccard 100 significant negative -0.328 0.107 0.0009 -0.00244 ok
gpt-5.4 v1 BLEU-4 100 positive 0.089 0.008 0.3777 0.00039 ok
chrF++ 100 positive 0.044 0.002 0.6652 0.00013 ok
METEOR 100 negative -0.074 0.005 0.4649 -0.00034 ok
ROUGE-L 100 negative -0.099 0.010 0.3285 -0.00039 ok
BERTScore 100 significant negative -0.309 0.095 0.0018 -0.00020 ok
COMET 100 negative -0.044 0.002 0.6639 -0.00009 ok
BLEURT 100 significant negative -0.599 0.359 4.45e-11 -0.00178 ok
Trigram precision 100 positive 0.037 0.001 0.7138 0.00016 ok
Trigram recall 100 positive 0.019 3.54e-04 0.8526 0.00008 ok
Trigram F1 100 positive 0.029 8.65e-04 0.7714 0.00013 ok
Trigram Jaccard 100 positive 0.014 2.05e-04 0.8877 0.00004 ok
gpt-5.4 v2 BLEU-4 100 significant negative -0.397 0.158 4.29e-05 -0.00228 ok
chrF++ 100 significant negative -0.424 0.179 1.13e-05 -0.00147 ok
METEOR 100 significant negative -0.476 0.227 5.43e-07 -0.00200 ok
ROUGE-L 100 significant negative -0.491 0.241 2.09e-07 -0.00187 ok
BERTScore 100 significant negative -0.631 0.399 1.90e-12 -0.00048 ok
COMET 100 significant negative -0.459 0.211 1.56e-06 -0.00088 ok
BLEURT 100 significant negative -0.757 0.573 8.33e-20 -0.00261 ok
Trigram precision 100 significant negative -0.384 0.147 8.03e-05 -0.00268 ok
Trigram recall 100 significant negative -0.384 0.148 7.94e-05 -0.00263 ok
Trigram F1 100 significant negative -0.385 0.148 7.56e-05 -0.00265 ok
Trigram Jaccard 100 significant negative -0.362 0.131 0.0002 -0.00245 ok
gpt-5.4 v3 BLEU-4 100 significant negative -0.405 0.164 2.97e-05 -0.00264 ok
chrF++ 100 significant negative -0.418 0.175 1.51e-05 -0.00159 ok
METEOR 100 significant negative -0.465 0.216 1.12e-06 -0.00190 ok
ROUGE-L 100 significant negative -0.440 0.194 4.52e-06 -0.00172 ok
BERTScore 100 significant negative -0.632 0.399 1.79e-12 -0.00044 ok
COMET 100 significant negative -0.450 0.203 2.60e-06 -0.00083 ok
BLEURT 100 significant negative -0.691 0.478 1.69e-15 -0.00251 ok
Trigram precision 100 significant negative -0.308 0.095 0.0018 -0.00243 ok
Trigram recall 100 significant negative -0.316 0.100 0.0014 -0.00242 ok
Trigram F1 100 significant negative -0.312 0.097 0.0016 -0.00241 ok
Trigram Jaccard 100 significant negative -0.315 0.099 0.0014 -0.00260 ok
gpt-5.5 v1 BLEU-4 100 negative -0.002 4.52e-06 0.9833 -9.57e-06 ok
chrF++ 100 negative -0.011 1.32e-04 0.9097 -0.00004 ok
METEOR 100 negative -0.023 5.20e-04 0.8217 -0.00011 ok
ROUGE-L 100 negative -0.042 0.002 0.6788 -0.00017 ok
BERTScore 100 significant negative -0.268 0.072 0.0070 -0.00021 ok
COMET 100 negative -0.125 0.016 0.2154 -0.00024 ok
BLEURT 100 significant negative -0.570 0.325 5.81e-10 -0.00179 ok
Trigram precision 100 positive 0.058 0.003 0.5653 0.00028 ok
Trigram recall 100 positive 0.042 0.002 0.6757 0.00020 ok
Trigram F1 100 positive 0.052 0.003 0.6074 0.00025 ok
Trigram Jaccard 100 positive 0.024 5.73e-04 0.8131 0.00008 ok
gpt-5.5 v2 BLEU-4 100 significant negative -0.441 0.195 4.29e-06 -0.00295 ok
chrF++ 100 significant negative -0.459 0.210 1.60e-06 -0.00194 ok
METEOR 100 significant negative -0.458 0.210 1.66e-06 -0.00200 ok
ROUGE-L 100 significant negative -0.456 0.208 1.87e-06 -0.00176 ok
BERTScore 100 significant negative -0.633 0.401 1.61e-12 -0.00048 ok
COMET 100 significant negative -0.473 0.224 6.70e-07 -0.00093 ok
BLEURT 100 significant negative -0.718 0.515 4.25e-17 -0.00262 ok
Trigram precision 100 significant negative -0.300 0.090 0.0025 -0.00219 ok
Trigram recall 100 significant negative -0.328 0.108 0.0008 -0.00239 ok
Trigram F1 100 significant negative -0.315 0.099 0.0014 -0.00229 ok
Trigram Jaccard 100 significant negative -0.323 0.104 0.0011 -0.00228 ok
gpt-5.5 v3 BLEU-4 100 significant negative -0.303 0.092 0.0022 -0.00228 ok
chrF++ 100 significant negative -0.386 0.149 7.30e-05 -0.00164 ok
METEOR 100 significant negative -0.360 0.130 0.0002 -0.00161 ok
ROUGE-L 100 significant negative -0.359 0.129 0.0002 -0.00151 ok
BERTScore 100 significant negative -0.589 0.347 1.18e-10 -0.00039 ok
COMET 100 significant negative -0.474 0.225 6.31e-07 -0.00084 ok
BLEURT 100 significant negative -0.682 0.466 5.35e-15 -0.00259 ok
Trigram precision 100 significant negative -0.229 0.053 0.0217 -0.00201 ok
Trigram recall 100 significant negative -0.240 0.058 0.0160 -0.00207 ok
Trigram F1 100 significant negative -0.235 0.055 0.0185 -0.00204 ok
Trigram Jaccard 100 significant negative -0.257 0.066 0.0098 -0.00241 ok
gpt-5.5_v4_mini v1 BLEU-4 100 significant negative -0.392 0.153 5.57e-05 -0.00262 ok
chrF++ 100 significant negative -0.417 0.174 1.55e-05 -0.00180 ok
METEOR 100 significant negative -0.505 0.255 8.40e-08 -0.00266 ok
ROUGE-L 100 significant negative -0.497 0.247 1.40e-07 -0.00233 ok
BERTScore 100 significant negative -0.589 0.347 1.14e-10 -0.00051 ok
COMET 100 significant negative -0.415 0.172 1.80e-05 -0.00092 ok
BLEURT 100 significant negative -0.723 0.523 1.90e-17 -0.00274 ok
Trigram precision 100 significant negative -0.373 0.139 0.0001 -0.00296 ok
Trigram recall 100 significant negative -0.377 0.142 0.0001 -0.00298 ok
Trigram F1 100 significant negative -0.375 0.141 0.0001 -0.00296 ok
Trigram Jaccard 100 significant negative -0.367 0.135 0.0002 -0.00279 ok
gpt-5.5_v4_mini_high v1 BLEU-4 100 significant negative -0.372 0.139 0.0001 -0.00255 ok
chrF++ 100 significant negative -0.406 0.165 2.76e-05 -0.00163 ok
METEOR 100 significant negative -0.483 0.233 3.59e-07 -0.00237 ok
ROUGE-L 100 significant negative -0.514 0.264 4.53e-08 -0.00226 ok
BERTScore 100 significant negative -0.574 0.330 4.20e-10 -0.00044 ok
COMET 100 significant negative -0.420 0.177 1.34e-05 -0.00082 ok
BLEURT 100 significant negative -0.692 0.479 1.52e-15 -0.00247 ok
Trigram precision 100 significant negative -0.419 0.175 1.44e-05 -0.00344 ok
Trigram recall 100 significant negative -0.430 0.185 8.08e-06 -0.00343 ok
Trigram F1 100 significant negative -0.425 0.180 1.06e-05 -0.00343 ok
Trigram Jaccard 100 significant negative -0.414 0.172 1.83e-05 -0.00340 ok
gpt-5.5_v4_mini_medium v1 BLEU-4 100 significant negative -0.366 0.134 0.0002 -0.00224 ok
chrF++ 100 significant negative -0.400 0.160 3.68e-05 -0.00154 ok
METEOR 100 significant negative -0.515 0.265 4.30e-08 -0.00232 ok
ROUGE-L 100 significant negative -0.506 0.256 7.86e-08 -0.00211 ok
BERTScore 100 significant negative -0.576 0.332 3.57e-10 -0.00044 ok
COMET 100 significant negative -0.437 0.191 5.58e-06 -0.00084 ok
BLEURT 100 significant negative -0.711 0.505 1.22e-16 -0.00242 ok
Trigram precision 100 significant negative -0.389 0.151 6.39e-05 -0.00281 ok
Trigram recall 100 significant negative -0.399 0.159 3.97e-05 -0.00273 ok
Trigram F1 100 significant negative -0.395 0.156 4.80e-05 -0.00276 ok
Trigram Jaccard 100 significant negative -0.391 0.153 5.65e-05 -0.00256 ok
gpt-5.5_v4_reasoning v1 BLEU-4 100 significant negative -0.407 0.166 2.61e-05 -0.00297 ok
chrF++ 100 significant negative -0.410 0.168 2.32e-05 -0.00207 ok
METEOR 100 significant negative -0.399 0.159 3.97e-05 -0.00195 ok
ROUGE-L 100 significant negative -0.388 0.151 6.57e-05 -0.00185 ok
BERTScore 100 significant negative -0.478 0.228 4.95e-07 -0.00047 ok
COMET 100 significant negative -0.397 0.158 4.35e-05 -0.00102 ok
BLEURT 100 significant negative -0.677 0.458 1.05e-14 -0.00275 ok
Trigram precision 100 significant negative -0.338 0.114 0.0006 -0.00263 ok
Trigram recall 100 significant negative -0.344 0.118 0.0005 -0.00258 ok
Trigram F1 100 significant negative -0.341 0.117 0.0005 -0.00259 ok
Trigram Jaccard 100 significant negative -0.346 0.120 0.0004 -0.00281 ok
gpt-5.5_v4_reasoning_high v1 BLEU-4 100 significant negative -0.420 0.176 1.36e-05 -0.00291 ok
chrF++ 100 significant negative -0.444 0.197 3.75e-06 -0.00184 ok
METEOR 100 significant negative -0.467 0.218 9.76e-07 -0.00197 ok
ROUGE-L 100 significant negative -0.478 0.228 5.05e-07 -0.00191 ok
BERTScore 100 significant negative -0.614 0.378 1.05e-11 -0.00041 ok
COMET 100 significant negative -0.465 0.216 1.11e-06 -0.00087 ok
BLEURT 100 significant negative -0.710 0.504 1.35e-16 -0.00257 ok
Trigram precision 100 significant negative -0.345 0.119 0.0004 -0.00282 ok
Trigram recall 100 significant negative -0.357 0.127 0.0003 -0.00288 ok
Trigram F1 100 significant negative -0.352 0.124 0.0003 -0.00285 ok
Trigram Jaccard 100 significant negative -0.364 0.132 0.0002 -0.00320 ok
gpt-5.5_v4_reasoning_medium v1 BLEU-4 100 significant negative -0.483 0.233 3.64e-07 -0.00339 ok
chrF++ 100 significant negative -0.502 0.252 1.05e-07 -0.00215 ok
METEOR 100 significant negative -0.530 0.281 1.45e-08 -0.00227 ok
ROUGE-L 100 significant negative -0.535 0.287 9.48e-09 -0.00211 ok
BERTScore 100 significant negative -0.674 0.455 1.46e-14 -0.00047 ok
COMET 100 significant negative -0.477 0.228 5.22e-07 -0.00095 ok
BLEURT 100 significant negative -0.761 0.579 4.15e-20 -0.00290 ok
Trigram precision 100 significant negative -0.424 0.180 1.10e-05 -0.00332 ok
Trigram recall 100 significant negative -0.425 0.181 1.03e-05 -0.00327 ok
Trigram F1 100 significant negative -0.425 0.181 1.02e-05 -0.00329 ok
Trigram Jaccard 100 significant negative -0.406 0.165 2.78e-05 -0.00354 ok
gpt-5.6-sol v1 BLEU-4 100 negative -0.085 0.007 0.4009 -0.00039 ok
chrF++ 100 positive 0.015 2.23e-04 0.8828 0.00006 ok
METEOR 100 negative -0.110 0.012 0.2738 -0.00062 ok
ROUGE-L 100 negative -0.082 0.007 0.4156 -0.00040 ok
BERTScore 100 significant negative -0.213 0.045 0.0337 -0.00020 ok
COMET 100 negative -0.054 0.003 0.5970 -0.00014 ok
BLEURT 100 significant negative -0.422 0.178 1.20e-05 -0.00158 ok
Trigram precision 100 negative -0.069 0.005 0.4943 -0.00034 ok
Trigram recall 100 negative -0.081 0.007 0.4243 -0.00041 ok
Trigram F1 100 negative -0.074 0.005 0.4648 -0.00037 ok
Trigram Jaccard 100 negative -0.101 0.010 0.3170 -0.00034 ok
gpt-5.6-sol v2 BLEU-4 100 significant negative -0.410 0.168 2.22e-05 -0.00273 ok
chrF++ 100 significant negative -0.442 0.196 4.04e-06 -0.00185 ok
METEOR 100 significant negative -0.462 0.214 1.29e-06 -0.00200 ok
ROUGE-L 100 significant negative -0.411 0.169 2.19e-05 -0.00169 ok
BERTScore 100 significant negative -0.630 0.397 2.21e-12 -0.00048 ok
COMET 100 significant negative -0.514 0.264 4.52e-08 -0.00098 ok
BLEURT 100 significant negative -0.735 0.540 3.42e-18 -0.00269 ok
Trigram precision 100 significant negative -0.316 0.100 0.0013 -0.00233 ok
Trigram recall 100 significant negative -0.335 0.112 0.0007 -0.00243 ok
Trigram F1 100 significant negative -0.326 0.106 0.0009 -0.00238 ok
Trigram Jaccard 100 significant negative -0.330 0.109 0.0008 -0.00241 ok
gpt-5.6-sol v3 BLEU-4 100 significant negative -0.453 0.205 2.28e-06 -0.00307 ok
chrF++ 100 significant negative -0.487 0.237 2.87e-07 -0.00195 ok
METEOR 100 significant negative -0.498 0.248 1.34e-07 -0.00206 ok
ROUGE-L 100 significant negative -0.470 0.220 8.32e-07 -0.00184 ok
BERTScore 100 significant negative -0.631 0.398 1.94e-12 -0.00042 ok
COMET 100 significant negative -0.478 0.228 5.07e-07 -0.00084 ok
BLEURT 100 significant negative -0.741 0.549 1.20e-18 -0.00250 ok
Trigram precision 100 significant negative -0.351 0.123 0.0003 -0.00285 ok
Trigram recall 100 significant negative -0.367 0.135 0.0002 -0.00293 ok
Trigram F1 100 significant negative -0.360 0.129 0.0002 -0.00289 ok
Trigram Jaccard 100 significant negative -0.375 0.141 0.0001 -0.00320 ok
legacy_scholarly v3 BLEU-4 100 significant negative -0.370 0.137 0.0001 -0.00271 ok
chrF++ 100 significant negative -0.394 0.155 4.99e-05 -0.00175 ok
METEOR 100 significant negative -0.402 0.161 3.44e-05 -0.00186 ok
ROUGE-L 100 significant negative -0.421 0.177 1.28e-05 -0.00176 ok
BERTScore 100 significant negative -0.576 0.332 3.53e-10 -0.00041 ok
COMET 100 significant negative -0.382 0.146 8.90e-05 -0.00073 ok
BLEURT 100 significant negative -0.704 0.495 3.16e-16 -0.00266 ok
Trigram precision 100 significant negative -0.285 0.081 0.0041 -0.00221 ok
Trigram recall 100 significant negative -0.290 0.084 0.0034 -0.00224 ok
Trigram F1 100 significant negative -0.288 0.083 0.0036 -0.00222 ok
Trigram Jaccard 100 significant negative -0.282 0.079 0.0045 -0.00222 ok
paper_guidance_ablation_gpt56 v1 BLEU-4 100 significant negative -0.391 0.153 5.76e-05 -0.00261 ok
chrF++ 100 significant negative -0.426 0.182 9.70e-06 -0.00179 ok
METEOR 100 significant negative -0.447 0.200 3.05e-06 -0.00201 ok
ROUGE-L 100 significant negative -0.393 0.154 5.23e-05 -0.00166 ok
BERTScore 100 significant negative -0.584 0.341 1.82e-10 -0.00044 ok
COMET 100 significant negative -0.465 0.216 1.08e-06 -0.00090 ok
BLEURT 100 significant negative -0.700 0.490 5.14e-16 -0.00250 ok
Trigram precision 100 significant negative -0.295 0.087 0.0029 -0.00223 ok
Trigram recall 100 significant negative -0.322 0.103 0.0011 -0.00237 ok
Trigram F1 100 significant negative -0.309 0.095 0.0018 -0.00229 ok
Trigram Jaccard 100 significant negative -0.321 0.103 0.0011 -0.00234 ok
paper_guidance_ablation_gpt56 v2 BLEU-4 100 significant negative -0.457 0.209 1.71e-06 -0.00297 ok
chrF++ 100 significant negative -0.474 0.225 6.27e-07 -0.00196 ok
METEOR 100 significant negative -0.468 0.219 9.36e-07 -0.00219 ok
ROUGE-L 100 significant negative -0.441 0.194 4.43e-06 -0.00189 ok
BERTScore 100 significant negative -0.586 0.344 1.47e-10 -0.00041 ok
COMET 100 significant negative -0.413 0.170 1.99e-05 -0.00074 ok
BLEURT 100 significant negative -0.724 0.524 1.83e-17 -0.00249 ok
Trigram precision 100 significant negative -0.358 0.128 0.0003 -0.00264 ok
Trigram recall 100 significant negative -0.388 0.151 6.57e-05 -0.00284 ok
Trigram F1 100 significant negative -0.374 0.140 0.0001 -0.00274 ok
Trigram Jaccard 100 significant negative -0.372 0.138 0.0001 -0.00271 ok
paper_guidance_ablation_gpt56 v3 BLEU-4 100 significant negative -0.444 0.197 3.63e-06 -0.00291 ok
chrF++ 100 significant negative -0.477 0.227 5.26e-07 -0.00193 ok
METEOR 100 significant negative -0.491 0.241 2.18e-07 -0.00203 ok
ROUGE-L 100 significant negative -0.459 0.211 1.57e-06 -0.00184 ok
BERTScore 100 significant negative -0.633 0.400 1.65e-12 -0.00042 ok
COMET 100 significant negative -0.458 0.209 1.70e-06 -0.00080 ok
BLEURT 100 significant negative -0.706 0.498 2.40e-16 -0.00235 ok
Trigram precision 100 significant negative -0.354 0.126 0.0003 -0.00284 ok
Trigram recall 100 significant negative -0.384 0.148 7.99e-05 -0.00300 ok
Trigram F1 100 significant negative -0.370 0.137 0.0002 -0.00291 ok
Trigram Jaccard 100 significant negative -0.379 0.144 9.97e-05 -0.00324 ok

Downloadable Table

Generated by generate_translation_prompt_evaluation.py.