Metric vs Passage Length

Generated: 2026-07-25 12:54:32 UTC

Back to translation prompt evaluation.

Metric vs Passage Length Patterns

Passage length is measured as the source Greek token count when source text is available, falling back to human translation word count only when a source passage has no Greek tokens. Each row regresses one metric against passage length for one prompt version.

Evaluable regressions432
Positive43
Negative389
Significant positive0
Significant negative317

Across 432 evaluable metric/prompt regressions, negative correlations are more common: 43 positive, 389 negative, and 0 flat. Using p < 0.05, 0 are significantly positive and 317 are significantly negative.

Prompt Metric Rows Pattern Pearson r R^2 P-value Slope Status
claude_fable_5 v1 BLEU-4 100 negative -0.086 0.007 0.3924 -0.00037 ok
chrF++ 100 negative -0.095 0.009 0.3471 -0.00028 ok
METEOR 100 significant negative -0.202 0.041 0.0442 -0.00085 ok
ROUGE-L 100 significant negative -0.252 0.063 0.0115 -0.00083 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 negative -0.007 4.49e-05 0.9473 -0.00003 ok
Trigram recall 100 positive 0.002 2.63e-06 0.9872 8.00e-06 ok
Trigram F1 100 negative -0.001 1.71e-06 0.9897 -6.38e-06 ok
Trigram Jaccard 100 negative -0.023 5.20e-04 0.8218 -0.00008 ok
claude_fable_5 v2 BLEU-4 100 significant negative -0.401 0.161 3.55e-05 -0.00250 ok
chrF++ 100 significant negative -0.446 0.199 3.37e-06 -0.00165 ok
METEOR 100 significant negative -0.457 0.209 1.73e-06 -0.00187 ok
ROUGE-L 100 significant negative -0.442 0.195 4.24e-06 -0.00161 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.327 0.107 0.0009 -0.00229 ok
Trigram recall 100 significant negative -0.349 0.122 0.0004 -0.00243 ok
Trigram F1 100 significant negative -0.339 0.115 0.0006 -0.00236 ok
Trigram Jaccard 100 significant negative -0.340 0.115 0.0005 -0.00232 ok
claude_fable_5 v3 BLEU-4 100 significant negative -0.426 0.182 9.77e-06 -0.00272 ok
chrF++ 100 significant negative -0.475 0.226 5.81e-07 -0.00179 ok
METEOR 100 significant negative -0.445 0.198 3.41e-06 -0.00176 ok
ROUGE-L 100 significant negative -0.450 0.203 2.57e-06 -0.00167 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.326 0.106 0.0009 -0.00250 ok
Trigram recall 100 significant negative -0.340 0.115 0.0005 -0.00254 ok
Trigram F1 100 significant negative -0.333 0.111 0.0007 -0.00251 ok
Trigram Jaccard 100 significant negative -0.334 0.112 0.0007 -0.00279 ok
claude_opus_4_8 v1 BLEU-4 100 negative -0.008 7.03e-05 0.9340 -0.00003 ok
chrF++ 100 positive 0.004 1.60e-05 0.9685 0.00001 ok
METEOR 100 negative -0.167 0.028 0.0971 -0.00075 ok
ROUGE-L 100 negative -0.182 0.033 0.0704 -0.00063 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 negative -0.014 1.94e-04 0.8907 -0.00005 ok
Trigram recall 100 negative -0.040 0.002 0.6895 -0.00017 ok
Trigram F1 100 negative -0.023 5.35e-04 0.8193 -0.00009 ok
Trigram Jaccard 100 negative -0.038 0.001 0.7082 -0.00009 ok
claude_opus_4_8 v3 BLEU-4 100 significant negative -0.415 0.172 1.77e-05 -0.00282 ok
chrF++ 100 significant negative -0.453 0.205 2.26e-06 -0.00179 ok
METEOR 100 significant negative -0.488 0.238 2.55e-07 -0.00219 ok
ROUGE-L 100 significant negative -0.511 0.261 5.59e-08 -0.00204 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.393 0.154 5.24e-05 -0.00319 ok
Trigram recall 100 significant negative -0.399 0.159 3.89e-05 -0.00322 ok
Trigram F1 100 significant negative -0.397 0.158 4.32e-05 -0.00320 ok
Trigram Jaccard 100 significant negative -0.385 0.148 7.71e-05 -0.00341 ok
claude_sonnet_5 v1 BLEU-4 100 positive 0.051 0.003 0.6171 0.00021 ok
chrF++ 100 positive 0.022 4.69e-04 0.8307 0.00006 ok
METEOR 100 negative -0.153 0.023 0.1289 -0.00068 ok
ROUGE-L 100 negative -0.188 0.035 0.0614 -0.00070 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 positive 0.002 2.77e-06 0.9869 7.62e-06 ok
Trigram recall 100 negative -0.021 4.58e-04 0.8326 -0.00010 ok
Trigram F1 100 negative -0.008 6.18e-05 0.9381 -0.00004 ok
Trigram Jaccard 100 negative -0.023 5.34e-04 0.8195 -0.00007 ok
claude_sonnet_5 v2 BLEU-4 100 significant negative -0.334 0.112 0.0007 -0.00201 ok
chrF++ 100 significant negative -0.355 0.126 0.0003 -0.00126 ok
METEOR 100 significant negative -0.493 0.243 1.84e-07 -0.00217 ok
ROUGE-L 100 significant negative -0.482 0.232 3.89e-07 -0.00182 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.354 0.125 0.0003 -0.00248 ok
Trigram recall 100 significant negative -0.356 0.127 0.0003 -0.00246 ok
Trigram F1 100 significant negative -0.356 0.127 0.0003 -0.00247 ok
Trigram Jaccard 100 significant negative -0.357 0.127 0.0003 -0.00225 ok
claude_sonnet_5 v3 BLEU-4 100 significant negative -0.412 0.170 2.05e-05 -0.00280 ok
chrF++ 100 significant negative -0.449 0.202 2.80e-06 -0.00174 ok
METEOR 100 significant negative -0.511 0.262 5.40e-08 -0.00210 ok
ROUGE-L 100 significant negative -0.512 0.263 5.05e-08 -0.00209 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.400 0.160 3.80e-05 -0.00343 ok
Trigram recall 100 significant negative -0.399 0.159 3.88e-05 -0.00337 ok
Trigram F1 100 significant negative -0.400 0.160 3.79e-05 -0.00339 ok
Trigram Jaccard 100 significant negative -0.403 0.162 3.24e-05 -0.00381 ok
gpt-4-turbo-2024-04-09 v1 BLEU-4 100 positive 0.046 0.002 0.6470 0.00018 ok
chrF++ 100 positive 0.066 0.004 0.5139 0.00020 ok
METEOR 100 negative -0.178 0.032 0.0759 -0.00093 ok
ROUGE-L 100 negative -0.103 0.011 0.3058 -0.00041 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 negative -0.012 1.45e-04 0.9054 -0.00005 ok
Trigram recall 100 negative -0.073 0.005 0.4724 -0.00034 ok
Trigram F1 100 negative -0.041 0.002 0.6861 -0.00018 ok
Trigram Jaccard 100 negative -0.059 0.003 0.5623 -0.00017 ok
gpt-4-turbo-2024-04-09 v2 BLEU-4 100 significant negative -0.459 0.211 1.53e-06 -0.00305 ok
chrF++ 100 significant negative -0.438 0.192 5.11e-06 -0.00193 ok
METEOR 100 significant negative -0.488 0.238 2.66e-07 -0.00277 ok
ROUGE-L 100 significant negative -0.489 0.239 2.49e-07 -0.00243 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.401 0.161 3.60e-05 -0.00319 ok
Trigram recall 100 significant negative -0.413 0.171 1.95e-05 -0.00328 ok
Trigram F1 100 significant negative -0.408 0.166 2.53e-05 -0.00323 ok
Trigram Jaccard 100 significant negative -0.392 0.154 5.45e-05 -0.00284 ok
gpt-4-turbo-2024-04-09 v3 BLEU-4 100 significant negative -0.354 0.125 0.0003 -0.00202 ok
chrF++ 100 significant negative -0.338 0.115 0.0006 -0.00132 ok
METEOR 100 significant negative -0.447 0.200 3.07e-06 -0.00223 ok
ROUGE-L 100 significant negative -0.427 0.183 9.22e-06 -0.00191 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.308 0.095 0.0018 -0.00203 ok
Trigram recall 100 significant negative -0.336 0.113 0.0006 -0.00217 ok
Trigram F1 100 significant negative -0.322 0.104 0.0011 -0.00209 ok
Trigram Jaccard 100 significant negative -0.323 0.104 0.0011 -0.00169 ok
gpt-4.1-2025-04-14 v1 BLEU-4 100 positive 0.062 0.004 0.5386 0.00025 ok
chrF++ 100 positive 0.120 0.014 0.2351 0.00038 ok
METEOR 100 negative -0.124 0.015 0.2198 -0.00060 ok
ROUGE-L 100 negative -0.132 0.018 0.1892 -0.00053 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 positive 0.057 0.003 0.5764 0.00025 ok
Trigram recall 100 positive 0.023 5.52e-04 0.8165 0.00011 ok
Trigram F1 100 positive 0.042 0.002 0.6795 0.00019 ok
Trigram Jaccard 100 positive 0.009 7.75e-05 0.9307 0.00003 ok
gpt-4.1-2025-04-14 v2 BLEU-4 100 significant negative -0.289 0.083 0.0036 -0.00178 ok
chrF++ 100 significant negative -0.285 0.081 0.0041 -0.00115 ok
METEOR 100 significant negative -0.367 0.135 0.0002 -0.00188 ok
ROUGE-L 100 significant negative -0.384 0.148 7.91e-05 -0.00172 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.272 0.074 0.0061 -0.00197 ok
Trigram recall 100 significant negative -0.287 0.082 0.0038 -0.00205 ok
Trigram F1 100 significant negative -0.279 0.078 0.0049 -0.00200 ok
Trigram Jaccard 100 significant negative -0.285 0.081 0.0040 -0.00181 ok
gpt-4.1-2025-04-14 v3 BLEU-4 100 significant negative -0.327 0.107 0.0009 -0.00206 ok
chrF++ 100 significant negative -0.368 0.135 0.0002 -0.00142 ok
METEOR 100 significant negative -0.467 0.218 9.85e-07 -0.00211 ok
ROUGE-L 100 significant negative -0.476 0.226 5.63e-07 -0.00202 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.360 0.130 0.0002 -0.00286 ok
Trigram recall 100 significant negative -0.355 0.126 0.0003 -0.00282 ok
Trigram F1 100 significant negative -0.358 0.128 0.0003 -0.00282 ok
Trigram Jaccard 100 significant negative -0.348 0.121 0.0004 -0.00287 ok
gpt-4o-2024-05-13 v1 BLEU-4 100 negative -0.069 0.005 0.4933 -0.00029 ok
chrF++ 100 significant negative -0.227 0.052 0.0230 -0.00078 ok
METEOR 100 significant negative -0.320 0.103 0.0012 -0.00160 ok
ROUGE-L 100 significant negative -0.333 0.111 0.0007 -0.00147 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 negative -0.048 0.002 0.6362 -0.00022 ok
Trigram recall 100 negative -0.105 0.011 0.2979 -0.00051 ok
Trigram F1 100 negative -0.093 0.009 0.3593 -0.00044 ok
Trigram Jaccard 100 negative -0.106 0.011 0.2936 -0.00034 ok
gpt-4o-2024-05-13 v2 BLEU-4 100 significant negative -0.340 0.116 0.0005 -0.00200 ok
chrF++ 100 significant negative -0.365 0.133 0.0002 -0.00153 ok
METEOR 100 significant negative -0.428 0.183 8.81e-06 -0.00225 ok
ROUGE-L 100 significant negative -0.436 0.190 5.73e-06 -0.00207 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.288 0.083 0.0036 -0.00199 ok
Trigram recall 100 significant negative -0.312 0.097 0.0016 -0.00204 ok
Trigram F1 100 significant negative -0.304 0.092 0.0021 -0.00203 ok
Trigram Jaccard 100 significant negative -0.303 0.092 0.0022 -0.00173 ok
gpt-4o-2024-05-13 v3 BLEU-4 100 significant negative -0.319 0.102 0.0012 -0.00223 ok
chrF++ 100 significant negative -0.377 0.142 0.0001 -0.00174 ok
METEOR 100 significant negative -0.445 0.198 3.51e-06 -0.00250 ok
ROUGE-L 100 significant negative -0.443 0.196 3.95e-06 -0.00225 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.301 0.091 0.0024 -0.00275 ok
Trigram recall 100 significant negative -0.323 0.105 0.0010 -0.00292 ok
Trigram F1 100 significant negative -0.315 0.099 0.0014 -0.00286 ok
Trigram Jaccard 100 significant negative -0.318 0.101 0.0013 -0.00293 ok
gpt-4o-2024-08-06 v1 BLEU-4 100 negative -0.029 8.35e-04 0.7754 -0.00012 ok
chrF++ 100 positive 2.25e-04 5.07e-08 0.9982 6.91e-07 ok
METEOR 100 negative -0.161 0.026 0.1099 -0.00085 ok
ROUGE-L 100 negative -0.190 0.036 0.0579 -0.00079 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 negative -0.026 6.90e-04 0.7952 -0.00012 ok
Trigram recall 100 negative -0.072 0.005 0.4746 -0.00036 ok
Trigram F1 100 negative -0.047 0.002 0.6438 -0.00022 ok
Trigram Jaccard 100 negative -0.063 0.004 0.5333 -0.00021 ok
gpt-4o-2024-08-06 v2 BLEU-4 100 significant negative -0.340 0.115 0.0005 -0.00193 ok
chrF++ 100 significant negative -0.363 0.132 0.0002 -0.00137 ok
METEOR 100 significant negative -0.455 0.207 1.96e-06 -0.00224 ok
ROUGE-L 100 significant negative -0.445 0.198 3.41e-06 -0.00194 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.325 0.106 0.0010 -0.00222 ok
Trigram recall 100 significant negative -0.325 0.106 0.0010 -0.00223 ok
Trigram F1 100 significant negative -0.326 0.106 0.0009 -0.00222 ok
Trigram Jaccard 100 significant negative -0.322 0.103 0.0011 -0.00189 ok
gpt-4o-2024-08-06 v3 BLEU-4 100 significant negative -0.329 0.108 0.0008 -0.00234 ok
chrF++ 100 significant negative -0.369 0.137 0.0002 -0.00157 ok
METEOR 100 significant negative -0.430 0.185 7.88e-06 -0.00223 ok
ROUGE-L 100 significant negative -0.476 0.226 5.72e-07 -0.00221 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.341 0.116 0.0005 -0.00296 ok
Trigram recall 100 significant negative -0.339 0.115 0.0006 -0.00288 ok
Trigram F1 100 significant negative -0.340 0.115 0.0005 -0.00290 ok
Trigram Jaccard 100 significant negative -0.339 0.115 0.0006 -0.00295 ok
gpt-4o-2024-11-20 v1 BLEU-4 100 negative -0.071 0.005 0.4818 -0.00028 ok
chrF++ 100 negative -0.009 7.71e-05 0.9309 -0.00003 ok
METEOR 100 significant negative -0.263 0.069 0.0082 -0.00128 ok
ROUGE-L 100 significant negative -0.231 0.054 0.0205 -0.00095 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 negative -0.090 0.008 0.3735 -0.00038 ok
Trigram recall 100 negative -0.119 0.014 0.2386 -0.00054 ok
Trigram F1 100 negative -0.102 0.010 0.3127 -0.00044 ok
Trigram Jaccard 100 negative -0.114 0.013 0.2575 -0.00034 ok
gpt-4o-2024-11-20 v2 BLEU-4 100 significant negative -0.328 0.108 0.0008 -0.00202 ok
chrF++ 100 significant negative -0.363 0.132 0.0002 -0.00141 ok
METEOR 100 significant negative -0.449 0.201 2.84e-06 -0.00228 ok
ROUGE-L 100 significant negative -0.401 0.160 3.63e-05 -0.00180 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.305 0.093 0.0020 -0.00215 ok
Trigram recall 100 significant negative -0.312 0.097 0.0016 -0.00222 ok
Trigram F1 100 significant negative -0.309 0.096 0.0017 -0.00218 ok
Trigram Jaccard 100 significant negative -0.308 0.095 0.0018 -0.00195 ok
gpt-4o-2024-11-20 v3 BLEU-4 100 significant negative -0.362 0.131 0.0002 -0.00225 ok
chrF++ 100 significant negative -0.350 0.123 0.0004 -0.00136 ok
METEOR 100 significant negative -0.453 0.205 2.24e-06 -0.00221 ok
ROUGE-L 100 significant negative -0.462 0.214 1.30e-06 -0.00208 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.364 0.132 0.0002 -0.00296 ok
Trigram recall 100 significant negative -0.359 0.129 0.0002 -0.00286 ok
Trigram F1 100 significant negative -0.361 0.131 0.0002 -0.00290 ok
Trigram Jaccard 100 significant negative -0.346 0.120 0.0004 -0.00282 ok
gpt-5 v1 BLEU-4 100 positive 0.055 0.003 0.5837 0.00024 ok
chrF++ 100 positive 0.046 0.002 0.6485 0.00014 ok
METEOR 100 negative -0.125 0.016 0.2158 -0.00057 ok
ROUGE-L 100 negative -0.126 0.016 0.2102 -0.00046 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 positive 0.024 5.71e-04 0.8135 0.00011 ok
Trigram recall 100 positive 0.011 1.29e-04 0.9105 0.00005 ok
Trigram F1 100 positive 0.019 3.58e-04 0.8518 0.00009 ok
Trigram Jaccard 100 negative -0.009 8.97e-05 0.9255 -0.00003 ok
gpt-5 v2 BLEU-4 100 significant negative -0.414 0.171 1.88e-05 -0.00265 ok
chrF++ 100 significant negative -0.458 0.210 1.62e-06 -0.00180 ok
METEOR 100 significant negative -0.472 0.223 7.23e-07 -0.00223 ok
ROUGE-L 100 significant negative -0.422 0.178 1.22e-05 -0.00168 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.294 0.087 0.0030 -0.00214 ok
Trigram recall 100 significant negative -0.330 0.109 0.0008 -0.00241 ok
Trigram F1 100 significant negative -0.315 0.099 0.0014 -0.00229 ok
Trigram Jaccard 100 significant negative -0.312 0.098 0.0016 -0.00220 ok
gpt-5 v3 BLEU-4 100 significant negative -0.374 0.140 0.0001 -0.00238 ok
chrF++ 100 significant negative -0.440 0.194 4.62e-06 -0.00165 ok
METEOR 100 significant negative -0.518 0.268 3.43e-08 -0.00247 ok
ROUGE-L 100 significant negative -0.467 0.218 9.70e-07 -0.00196 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.370 0.137 0.0001 -0.00306 ok
Trigram recall 100 significant negative -0.376 0.142 0.0001 -0.00312 ok
Trigram F1 100 significant negative -0.374 0.140 0.0001 -0.00308 ok
Trigram Jaccard 100 significant negative -0.367 0.135 0.0002 -0.00336 ok
gpt-5.1 v1 BLEU-4 100 positive 0.127 0.016 0.2067 0.00051 ok
chrF++ 100 positive 0.113 0.013 0.2626 0.00033 ok
METEOR 100 negative -0.060 0.004 0.5502 -0.00027 ok
ROUGE-L 100 negative -0.137 0.019 0.1738 -0.00054 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 positive 0.048 0.002 0.6385 0.00021 ok
Trigram recall 100 positive 0.063 0.004 0.5322 0.00030 ok
Trigram F1 100 positive 0.057 0.003 0.5744 0.00026 ok
Trigram Jaccard 100 positive 0.031 9.81e-04 0.7570 0.00010 ok
gpt-5.1 v2 BLEU-4 100 significant negative -0.309 0.095 0.0018 -0.00200 ok
chrF++ 100 significant negative -0.327 0.107 0.0009 -0.00129 ok
METEOR 100 significant negative -0.401 0.161 3.56e-05 -0.00189 ok
ROUGE-L 100 significant negative -0.361 0.130 0.0002 -0.00151 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.285 0.081 0.0041 -0.00211 ok
Trigram recall 100 significant negative -0.281 0.079 0.0046 -0.00207 ok
Trigram F1 100 significant negative -0.283 0.080 0.0043 -0.00208 ok
Trigram Jaccard 100 significant negative -0.288 0.083 0.0037 -0.00203 ok
gpt-5.1 v3 BLEU-4 100 significant negative -0.336 0.113 0.0006 -0.00198 ok
chrF++ 100 significant negative -0.370 0.137 0.0002 -0.00133 ok
METEOR 100 significant negative -0.448 0.201 2.89e-06 -0.00204 ok
ROUGE-L 100 significant negative -0.464 0.215 1.16e-06 -0.00187 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.351 0.123 0.0003 -0.00265 ok
Trigram recall 100 significant negative -0.352 0.124 0.0003 -0.00262 ok
Trigram F1 100 significant negative -0.351 0.123 0.0003 -0.00262 ok
Trigram Jaccard 100 significant negative -0.339 0.115 0.0006 -0.00265 ok
gpt-5.2 v1 BLEU-4 100 negative -0.089 0.008 0.3809 -0.00040 ok
chrF++ 100 negative -0.108 0.012 0.2858 -0.00035 ok
METEOR 100 negative -0.177 0.031 0.0788 -0.00085 ok
ROUGE-L 100 negative -0.097 0.009 0.3357 -0.00041 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 positive 0.024 5.96e-04 0.8094 0.00011 ok
Trigram recall 100 negative -0.035 0.001 0.7286 -0.00017 ok
Trigram F1 100 negative -5.81e-04 3.38e-07 0.9954 -2.69e-06 ok
Trigram Jaccard 100 negative -0.019 3.63e-04 0.8508 -0.00006 ok
gpt-5.2 v2 BLEU-4 100 significant negative -0.394 0.155 4.94e-05 -0.00270 ok
chrF++ 100 significant negative -0.462 0.213 1.31e-06 -0.00197 ok
METEOR 100 significant negative -0.465 0.216 1.08e-06 -0.00217 ok
ROUGE-L 100 significant negative -0.432 0.187 7.10e-06 -0.00170 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.302 0.091 0.0023 -0.00228 ok
Trigram recall 100 significant negative -0.322 0.104 0.0011 -0.00242 ok
Trigram F1 100 significant negative -0.312 0.098 0.0015 -0.00234 ok
Trigram Jaccard 100 significant negative -0.321 0.103 0.0011 -0.00233 ok
gpt-5.2 v3 BLEU-4 100 significant negative -0.309 0.095 0.0018 -0.00204 ok
chrF++ 100 significant negative -0.326 0.106 0.0010 -0.00134 ok
METEOR 100 significant negative -0.341 0.116 0.0005 -0.00156 ok
ROUGE-L 100 significant negative -0.327 0.107 0.0009 -0.00141 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.267 0.071 0.0073 -0.00210 ok
Trigram recall 100 significant negative -0.269 0.073 0.0067 -0.00205 ok
Trigram F1 100 significant negative -0.268 0.072 0.0071 -0.00206 ok
Trigram Jaccard 100 significant negative -0.282 0.080 0.0044 -0.00225 ok
gpt-5.3-chat-latest v1 BLEU-4 100 positive 0.020 4.10e-04 0.8415 0.00010 ok
chrF++ 100 positive 0.038 0.001 0.7038 0.00013 ok
METEOR 100 negative -0.024 5.58e-04 0.8155 -0.00012 ok
ROUGE-L 100 negative -0.064 0.004 0.5292 -0.00027 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 positive 0.021 4.36e-04 0.8366 0.00010 ok
Trigram recall 100 positive 0.019 3.80e-04 0.8474 0.00009 ok
Trigram F1 100 positive 0.021 4.34e-04 0.8369 0.00010 ok
Trigram Jaccard 100 positive 3.08e-04 9.47e-08 0.9976 9.77e-07 ok
gpt-5.3-chat-latest v2 BLEU-4 100 significant negative -0.391 0.152 5.90e-05 -0.00247 ok
chrF++ 100 significant negative -0.431 0.186 7.63e-06 -0.00171 ok
METEOR 100 significant negative -0.453 0.205 2.18e-06 -0.00206 ok
ROUGE-L 100 significant negative -0.403 0.162 3.29e-05 -0.00164 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.316 0.100 0.0014 -0.00220 ok
Trigram recall 100 significant negative -0.346 0.120 0.0004 -0.00238 ok
Trigram F1 100 significant negative -0.332 0.110 0.0007 -0.00229 ok
Trigram Jaccard 100 significant negative -0.336 0.113 0.0006 -0.00219 ok
gpt-5.3-chat-latest v3 BLEU-4 100 significant negative -0.370 0.137 0.0002 -0.00220 ok
chrF++ 100 significant negative -0.392 0.154 5.52e-05 -0.00150 ok
METEOR 100 significant negative -0.388 0.150 6.71e-05 -0.00168 ok
ROUGE-L 100 significant negative -0.412 0.170 2.08e-05 -0.00161 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.308 0.095 0.0018 -0.00225 ok
Trigram recall 100 significant negative -0.323 0.105 0.0010 -0.00233 ok
Trigram F1 100 significant negative -0.316 0.100 0.0014 -0.00228 ok
Trigram Jaccard 100 significant negative -0.318 0.101 0.0013 -0.00238 ok
gpt-5.4 v1 BLEU-4 100 positive 0.089 0.008 0.3795 0.00039 ok
chrF++ 100 positive 0.048 0.002 0.6347 0.00014 ok
METEOR 100 negative -0.067 0.005 0.5047 -0.00031 ok
ROUGE-L 100 negative -0.095 0.009 0.3476 -0.00037 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 positive 0.043 0.002 0.6683 0.00019 ok
Trigram recall 100 positive 0.027 7.43e-04 0.7878 0.00012 ok
Trigram F1 100 positive 0.037 0.001 0.7171 0.00016 ok
Trigram Jaccard 100 positive 0.022 4.63e-04 0.8317 0.00006 ok
gpt-5.4 v2 BLEU-4 100 significant negative -0.393 0.154 5.25e-05 -0.00226 ok
chrF++ 100 significant negative -0.415 0.172 1.76e-05 -0.00145 ok
METEOR 100 significant negative -0.456 0.208 1.85e-06 -0.00194 ok
ROUGE-L 100 significant negative -0.474 0.225 6.19e-07 -0.00182 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.373 0.139 0.0001 -0.00260 ok
Trigram recall 100 significant negative -0.372 0.138 0.0001 -0.00256 ok
Trigram F1 100 significant negative -0.373 0.139 0.0001 -0.00257 ok
Trigram Jaccard 100 significant negative -0.352 0.124 0.0003 -0.00238 ok
gpt-5.4 v3 BLEU-4 100 significant negative -0.393 0.154 5.24e-05 -0.00258 ok
chrF++ 100 significant negative -0.408 0.166 2.51e-05 -0.00155 ok
METEOR 100 significant negative -0.444 0.197 3.77e-06 -0.00184 ok
ROUGE-L 100 significant negative -0.426 0.181 1.02e-05 -0.00167 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.298 0.089 0.0026 -0.00235 ok
Trigram recall 100 significant negative -0.303 0.092 0.0022 -0.00233 ok
Trigram F1 100 significant negative -0.300 0.090 0.0024 -0.00233 ok
Trigram Jaccard 100 significant negative -0.306 0.093 0.0020 -0.00253 ok
gpt-5.5 v1 BLEU-4 100 negative -0.003 7.66e-06 0.9782 -0.00001 ok
chrF++ 100 negative -0.009 8.21e-05 0.9287 -0.00003 ok
METEOR 100 negative -0.021 4.35e-04 0.8368 -0.00010 ok
ROUGE-L 100 negative -0.041 0.002 0.6860 -0.00017 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 positive 0.057 0.003 0.5709 0.00027 ok
Trigram recall 100 positive 0.044 0.002 0.6615 0.00021 ok
Trigram F1 100 positive 0.052 0.003 0.6049 0.00025 ok
Trigram Jaccard 100 positive 0.024 5.88e-04 0.8107 0.00008 ok
gpt-5.5 v2 BLEU-4 100 significant negative -0.430 0.185 7.97e-06 -0.00289 ok
chrF++ 100 significant negative -0.450 0.202 2.71e-06 -0.00191 ok
METEOR 100 significant negative -0.444 0.197 3.78e-06 -0.00193 ok
ROUGE-L 100 significant negative -0.443 0.196 3.87e-06 -0.00171 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.290 0.084 0.0035 -0.00211 ok
Trigram recall 100 significant negative -0.317 0.101 0.0013 -0.00230 ok
Trigram F1 100 significant negative -0.305 0.093 0.0021 -0.00221 ok
Trigram Jaccard 100 significant negative -0.314 0.098 0.0015 -0.00220 ok
gpt-5.5 v3 BLEU-4 100 significant negative -0.336 0.113 0.0006 -0.00252 ok
chrF++ 100 significant negative -0.417 0.174 1.57e-05 -0.00177 ok
METEOR 100 significant negative -0.369 0.136 0.0002 -0.00163 ok
ROUGE-L 100 significant negative -0.373 0.139 0.0001 -0.00155 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.251 0.063 0.0119 -0.00218 ok
Trigram recall 100 significant negative -0.259 0.067 0.0091 -0.00221 ok
Trigram F1 100 significant negative -0.255 0.065 0.0103 -0.00219 ok
Trigram Jaccard 100 significant negative -0.285 0.081 0.0041 -0.00263 ok
gpt-5.5_v4_mini v1 BLEU-4 100 significant negative -0.387 0.150 7.01e-05 -0.00260 ok
chrF++ 100 significant negative -0.411 0.169 2.15e-05 -0.00178 ok
METEOR 100 significant negative -0.488 0.238 2.61e-07 -0.00259 ok
ROUGE-L 100 significant negative -0.485 0.235 3.16e-07 -0.00228 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.362 0.131 0.0002 -0.00288 ok
Trigram recall 100 significant negative -0.366 0.134 0.0002 -0.00290 ok
Trigram F1 100 significant negative -0.364 0.132 0.0002 -0.00288 ok
Trigram Jaccard 100 significant negative -0.357 0.128 0.0003 -0.00272 ok
gpt-5.5_v4_mini_high v1 BLEU-4 100 significant negative -0.367 0.135 0.0002 -0.00253 ok
chrF++ 100 significant negative -0.398 0.158 4.10e-05 -0.00161 ok
METEOR 100 significant negative -0.462 0.213 1.34e-06 -0.00231 ok
ROUGE-L 100 significant negative -0.497 0.247 1.49e-07 -0.00221 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.406 0.165 2.74e-05 -0.00336 ok
Trigram recall 100 significant negative -0.416 0.173 1.64e-05 -0.00335 ok
Trigram F1 100 significant negative -0.411 0.169 2.12e-05 -0.00334 ok
Trigram Jaccard 100 significant negative -0.404 0.163 3.06e-05 -0.00334 ok
gpt-5.5_v4_mini_medium v1 BLEU-4 100 significant negative -0.359 0.129 0.0002 -0.00221 ok
chrF++ 100 significant negative -0.391 0.153 5.67e-05 -0.00152 ok
METEOR 100 significant negative -0.492 0.242 2.05e-07 -0.00226 ok
ROUGE-L 100 significant negative -0.489 0.239 2.52e-07 -0.00206 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.375 0.140 0.0001 -0.00271 ok
Trigram recall 100 significant negative -0.383 0.147 8.38e-05 -0.00264 ok
Trigram F1 100 significant negative -0.380 0.144 9.85e-05 -0.00267 ok
Trigram Jaccard 100 significant negative -0.378 0.143 0.0001 -0.00248 ok
gpt-5.5_v4_reasoning v1 BLEU-4 42 significant negative -0.422 0.178 0.0053 -0.00517 ok
chrF++ 42 significant negative -0.437 0.191 0.0038 -0.00307 ok
METEOR 42 significant negative -0.404 0.163 0.0080 -0.00250 ok
ROUGE-L 42 significant negative -0.402 0.162 0.0083 -0.00263 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 42 significant negative -0.316 0.100 0.0416 -0.00443 ok
Trigram recall 42 significant negative -0.304 0.093 0.0500 -0.00418 ok
Trigram F1 42 significant negative -0.310 0.096 0.0454 -0.00429 ok
Trigram Jaccard 42 significant negative -0.334 0.111 0.0308 -0.00509 ok
gpt-5.5_v4_reasoning_high v1 BLEU-4 32 significant negative -0.479 0.230 0.0055 -0.00569 ok
chrF++ 32 significant negative -0.488 0.238 0.0046 -0.00321 ok
METEOR 32 significant negative -0.550 0.303 0.0011 -0.00343 ok
ROUGE-L 32 significant negative -0.453 0.205 0.0093 -0.00288 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 32 negative -0.325 0.106 0.0693 -0.00486 ok
Trigram recall 32 significant negative -0.353 0.125 0.0474 -0.00525 ok
Trigram F1 32 negative -0.340 0.116 0.0569 -0.00506 ok
Trigram Jaccard 32 significant negative -0.372 0.138 0.0360 -0.00590 ok
gpt-5.5_v4_reasoning_medium v1 BLEU-4 32 significant negative -0.544 0.296 0.0013 -0.00651 ok
chrF++ 32 significant negative -0.533 0.284 0.0017 -0.00360 ok
METEOR 32 significant negative -0.592 0.350 0.0004 -0.00385 ok
ROUGE-L 32 significant negative -0.512 0.263 0.0027 -0.00323 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 32 significant negative -0.440 0.194 0.0116 -0.00627 ok
Trigram recall 32 significant negative -0.435 0.189 0.0129 -0.00623 ok
Trigram F1 32 significant negative -0.438 0.192 0.0122 -0.00624 ok
Trigram Jaccard 32 significant negative -0.431 0.186 0.0138 -0.00735 ok
gpt-5.6-sol v1 BLEU-4 100 negative -0.085 0.007 0.4001 -0.00039 ok
chrF++ 100 positive 0.019 3.56e-04 0.8523 0.00007 ok
METEOR 100 negative -0.107 0.011 0.2914 -0.00059 ok
ROUGE-L 100 negative -0.079 0.006 0.4340 -0.00039 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 negative -0.065 0.004 0.5213 -0.00031 ok
Trigram recall 100 negative -0.074 0.005 0.4662 -0.00037 ok
Trigram F1 100 negative -0.068 0.005 0.4992 -0.00034 ok
Trigram Jaccard 100 negative -0.095 0.009 0.3448 -0.00032 ok
gpt-5.6-sol v2 BLEU-4 100 significant negative -0.403 0.163 3.16e-05 -0.00268 ok
chrF++ 100 significant negative -0.436 0.191 5.64e-06 -0.00182 ok
METEOR 100 significant negative -0.450 0.203 2.62e-06 -0.00193 ok
ROUGE-L 100 significant negative -0.402 0.161 3.44e-05 -0.00164 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.307 0.094 0.0019 -0.00226 ok
Trigram recall 100 significant negative -0.324 0.105 0.0010 -0.00233 ok
Trigram F1 100 significant negative -0.316 0.100 0.0013 -0.00229 ok
Trigram Jaccard 100 significant negative -0.319 0.102 0.0012 -0.00232 ok
gpt-5.6-sol v3 BLEU-4 100 significant negative -0.444 0.197 3.77e-06 -0.00302 ok
chrF++ 100 significant negative -0.479 0.230 4.55e-07 -0.00191 ok
METEOR 100 significant negative -0.483 0.234 3.53e-07 -0.00199 ok
ROUGE-L 100 significant negative -0.460 0.211 1.49e-06 -0.00179 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.343 0.118 0.0005 -0.00278 ok
Trigram recall 100 significant negative -0.357 0.127 0.0003 -0.00284 ok
Trigram F1 100 significant negative -0.351 0.123 0.0003 -0.00281 ok
Trigram Jaccard 100 significant negative -0.366 0.134 0.0002 -0.00312 ok
legacy_scholarly v3 BLEU-4 100 significant negative -0.364 0.133 0.0002 -0.00266 ok
chrF++ 100 significant negative -0.389 0.151 6.31e-05 -0.00172 ok
METEOR 100 significant negative -0.391 0.153 5.69e-05 -0.00180 ok
ROUGE-L 100 significant negative -0.413 0.170 1.97e-05 -0.00171 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.276 0.076 0.0055 -0.00214 ok
Trigram recall 100 significant negative -0.279 0.078 0.0049 -0.00215 ok
Trigram F1 100 significant negative -0.278 0.077 0.0050 -0.00214 ok
Trigram Jaccard 100 significant negative -0.273 0.074 0.0060 -0.00216 ok
paper_guidance_ablation_gpt56 v1 BLEU-4 100 significant negative -0.384 0.147 8.00e-05 -0.00255 ok
chrF++ 100 significant negative -0.420 0.177 1.33e-05 -0.00175 ok
METEOR 100 significant negative -0.436 0.190 5.84e-06 -0.00194 ok
ROUGE-L 100 significant negative -0.384 0.148 7.87e-05 -0.00161 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.286 0.082 0.0039 -0.00215 ok
Trigram recall 100 significant negative -0.311 0.097 0.0016 -0.00227 ok
Trigram F1 100 significant negative -0.299 0.089 0.0025 -0.00221 ok
Trigram Jaccard 100 significant negative -0.311 0.097 0.0016 -0.00226 ok
paper_guidance_ablation_gpt56 v2 BLEU-4 100 significant negative -0.451 0.203 2.55e-06 -0.00292 ok
chrF++ 100 significant negative -0.469 0.220 8.44e-07 -0.00193 ok
METEOR 100 significant negative -0.459 0.211 1.57e-06 -0.00213 ok
ROUGE-L 100 significant negative -0.434 0.188 6.53e-06 -0.00184 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.352 0.124 0.0003 -0.00258 ok
Trigram recall 100 significant negative -0.380 0.145 9.48e-05 -0.00276 ok
Trigram F1 100 significant negative -0.367 0.135 0.0002 -0.00266 ok
Trigram Jaccard 100 significant negative -0.364 0.132 0.0002 -0.00263 ok
paper_guidance_ablation_gpt56 v3 BLEU-4 100 significant negative -0.433 0.187 6.86e-06 -0.00287 ok
chrF++ 100 significant negative -0.465 0.217 1.07e-06 -0.00189 ok
METEOR 100 significant negative -0.483 0.233 3.61e-07 -0.00200 ok
ROUGE-L 100 significant negative -0.444 0.197 3.71e-06 -0.00180 ok
BERTScore 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
COMET 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
BLEURT 0 not enough data N/A N/A N/A N/A needs at least two rows with metric scores
Trigram precision 100 significant negative -0.345 0.119 0.0004 -0.00277 ok
Trigram recall 100 significant negative -0.372 0.138 0.0001 -0.00293 ok
Trigram F1 100 significant negative -0.359 0.129 0.0002 -0.00284 ok
Trigram Jaccard 100 significant negative -0.371 0.138 0.0001 -0.00318 ok

Downloadable Table

Generated by generate_translation_prompt_evaluation.py.