Translation Prompt Evaluation

Generated: 2026-09-09 13:05:01 UTC

This page compares each AI translation prompt version against the best available human translation for the same lemma, using the automated MT metric set from Zainaldin et al. 2026: BLEU-4, chrF++, METEOR, ROUGE-L, BERTScore, COMET, and BLEURT. Length regression and residual tables remain as local diagnostics for translation-length drift.

Inputs: one representative AI run per lemma and prompt version, preferring the current preferred source text, with status completed or approved, non-empty translation text, and 100 Kappa rows from Gabe's final review tracker export. Full translation texts are used for metrics but are not printed on these pages.

Metric Engines

The paper metric set is BLEU-4, chrF++, METEOR, ROUGE-L, BERTScore, COMET, and BLEURT. Lexical metrics run locally. BERTScore needs the bert-score package, COMET needs unbabel-comet, and BLEURT needs the BLEURT package plus a local checkpoint path in BLEURT_CHECKPOINT.

MetricStatus for this run
BLEU-4 SacreBLEU sentence BLEU-4
chrF++ SacreBLEU chrF++ with word_order=2
METEOR NLTK METEOR with WordNet synonyms
ROUGE-L rouge-score ROUGE-L with stemming
BERTScore persistent cache 6,000/6,000
COMET persistent cache 6,000/6,000
BLEURT persistent cache 6,000/6,000

Paper Corpus Summary

This is the paper-facing 100-row Kappa corpus from Gabe's final review tracker, not the broader approved-human translation pool.

Ground-truth rows100
Greek source tokens3,040
Human reference words4,416
ChatGPT v3 exact6
ChatGPT v3 <=2 edits10
ChatGPT v3 guidance97/100
Claude full variants9/9
Missing Claude variantsNone

For ordinary ChatGPT v3, 97 of 100 Kappa rows have at least one guidance match, with 1,191 total run-guidance links.

Paper-Facing Prompt Metrics

Prompt Pairs BLEU-4 chrF++ METEOR ROUGE-L Corpus BLEU 3-gram F1 4-gram F1 Exact <=2 char edits
gpt-5.5 v1 100 25.1% 53.7% 56.0% 58.4% 26.6% 20.7% 13.0% 0 1
gpt-5.5 v2 100 51.9% 72.4% 77.3% 78.0% 48.5% 42.3% 32.9% 2 4
gpt-5.5 v3 100 57.6% 77.2% 80.8% 81.2% 56.0% 49.5% 40.9% 6 10
claude_fable_5 v1 100 27.5% 58.3% 66.0% 67.9% 33.0% 26.4% 17.4% 0 0
claude_fable_5 v2 100 54.3% 74.4% 78.1% 79.1% 49.8% 43.2% 33.8% 2 4
claude_fable_5 v3 100 58.2% 77.4% 81.9% 82.1% 55.9% 49.4% 40.2% 3 6

Paired ChatGPT Prompt Deltas

Each row compares the same Kappa lemmas under two prompt versions. Positive deltas mean the later prompt scored higher.

Comparison Metric Pairs Mean delta Paired t p Wins Losses Ties
v1->v2 BLEU-4 100 26.8% 2.91e-27 96 4 0
v1->v2 chrF++ 100 18.7% 1.84e-28 96 4 0
v1->v2 METEOR 100 21.3% 1.27e-26 95 4 1
v1->v2 ROUGE-L 100 19.6% 9.47e-31 97 2 1
v1->v2 3-gram F1 100 27.3% 4.99e-25 93 5 2
v1->v2 4-gram F1 100 26.0% 1.94e-21 92 6 2
v2->v3 BLEU-4 100 5.7% 0.0009 62 33 5
v2->v3 chrF++ 100 4.8% 8.90e-07 68 30 2
v2->v3 METEOR 100 3.5% 0.0004 64 31 5
v2->v3 ROUGE-L 100 3.2% 0.0002 62 30 8
v2->v3 3-gram F1 100 7.2% 0.0005 65 30 5
v2->v3 4-gram F1 100 8.6% 0.0004 64 31 5
v1->v3 BLEU-4 100 32.5% 4.09e-30 98 2 0
v1->v3 chrF++ 100 23.5% 2.61e-35 100 0 0
v1->v3 METEOR 100 24.8% 7.39e-30 98 2 0
v1->v3 ROUGE-L 100 22.8% 2.69e-33 99 1 0
v1->v3 3-gram F1 100 34.5% 4.31e-27 97 2 1
v1->v3 4-gram F1 100 34.6% 4.60e-24 96 2 2

Repeated-Run Variance

This section uses every completed run from gpt-5.5_v3_repeat. It is separated from the main prompt-comparison table because the question is variance across repeated model samples, not mean performance of another prompt.

Repeated lemmas100
Repeated runs500
Median BLEU range9.4%
Max BLEU range46.5%
Median ROUGE range5.8%
Max ROUGE range20.5%
Median chrF range5.5%
Mean distinct outputs4.04

Repeated-Run Values by Lemma

Corpus row Lemma ID Headword Runs Distinct outputs BLEU range BLEU values ROUGE range ROUGE values chrF range chrF values AI words
1 2,054 Καβαλίς 5 5 10.4% 1: 66.5%; 2: 76.7%; 3: 68.9%; 4: 76.8%; 5: 72.5% 3.3% 1: 85.3%; 2: 86.2%; 3: 85.5%; 4: 87.3%; 5: 84.0% 4.4% 1: 80.4%; 2: 82.9%; 3: 80.0%; 4: 84.4%; 5: 82.2% 1: 64.000; 2: 65.000; 3: 66.000; 4: 61.000; 5: 66.000
2 2,055 Καβασσός 5 5 7.2% 1: 42.4%; 2: 42.2%; 3: 35.3%; 4: 38.7%; 5: 42.5% 7.8% 1: 72.6%; 2: 68.6%; 3: 64.8%; 4: 70.1%; 5: 71.1% 6.1% 1: 66.3%; 2: 64.5%; 3: 61.9%; 4: 64.1%; 5: 68.1% 1: 106.000; 2: 101.000; 3: 104.000; 4: 105.000; 5: 102.000
3 2,056 Καβειρία 5 5 5.4% 1: 44.6%; 2: 42.4%; 3: 45.6%; 4: 40.2%; 5: 41.7% 4.9% 1: 77.0%; 2: 73.9%; 3: 74.1%; 4: 72.1%; 5: 72.6% 3.9% 1: 73.3%; 2: 72.0%; 3: 74.8%; 4: 70.9%; 5: 72.7% 1: 101.000; 2: 99.000; 3: 104.000; 4: 96.000; 5: 100.000
4 2,057 Καβελλιών 5 4 20.8% 1: 42.2%; 2: 42.2%; 3: 48.0%; 4: 60.9%; 5: 40.1% 14.5% 1: 83.6%; 2: 83.6%; 3: 92.3%; 4: 93.9%; 5: 79.4% 12.0% 1: 73.0%; 2: 73.0%; 3: 78.5%; 4: 81.6%; 5: 69.6% 1: 33.000; 2: 33.000; 3: 31.000; 4: 32.000; 5: 34.000
5 2,058 Καβύλη 5 3 8.8% 1: 67.4%; 2: 70.0%; 3: 76.2%; 4: 70.0%; 5: 70.0% 4.3% 1: 95.7%; 2: 91.3%; 3: 95.7%; 4: 91.3%; 5: 91.3% 3.6% 1: 85.9%; 2: 85.3%; 3: 88.8%; 4: 85.3%; 5: 85.3% 1: 23.000; 2: 23.000; 3: 23.000; 4: 23.000; 5: 23.000
6 2,059 Καδμεία 5 5 7.7% 1: 44.1%; 2: 42.5%; 3: 50.2%; 4: 44.1%; 5: 46.2% 9.8% 1: 78.0%; 2: 76.2%; 3: 78.0%; 4: 82.9%; 5: 73.2% 2.2% 1: 69.3%; 2: 69.1%; 3: 71.3%; 4: 70.4%; 5: 69.1% 1: 21.000; 2: 22.000; 3: 21.000; 4: 21.000; 5: 21.000
7 2,060 Κάδοι 5 3 21.7% 1: 78.0%; 2: 73.8%; 3: 73.8%; 4: 56.3%; 5: 73.8% 5.6% 1: 88.9%; 2: 83.3%; 3: 83.3%; 4: 88.9%; 5: 83.3% 15.3% 1: 86.8%; 2: 83.6%; 3: 83.6%; 4: 71.5%; 5: 83.6% 1: 18.000; 2: 18.000; 3: 18.000; 4: 18.000; 5: 18.000
8 2,061 Καδούσιοι 5 1 0.0% 1: 100.0%; 2: 100.0%; 3: 100.0%; 4: 100.0%; 5: 100.0% 0.0% 1: 100.0%; 2: 100.0%; 3: 100.0%; 4: 100.0%; 5: 100.0% 0.0% 1: 100.0%; 2: 100.0%; 3: 100.0%; 4: 100.0%; 5: 100.0% 1: 14.000; 2: 14.000; 3: 14.000; 4: 14.000; 5: 14.000
9 2,802 Κάδρεμα 5 5 20.2% 1: 39.7%; 2: 59.9%; 3: 56.2%; 4: 57.9%; 5: 54.1% 13.0% 1: 73.9%; 2: 87.0%; 3: 85.1%; 4: 78.3%; 5: 73.9% 15.1% 1: 60.0%; 2: 75.1%; 3: 74.2%; 4: 72.2%; 5: 68.8% 1: 22.000; 2: 22.000; 3: 23.000; 4: 22.000; 5: 22.000
10 2,062 Κάθαια 5 3 7.1% 1: 44.5%; 2: 44.5%; 3: 44.5%; 4: 51.6%; 5: 44.5% 3.9% 1: 66.7%; 2: 66.7%; 3: 66.7%; 4: 70.6%; 5: 66.7% 3.4% 1: 67.1%; 2: 67.1%; 3: 66.6%; 4: 70.0%; 5: 67.1% 1: 26.000; 2: 26.000; 3: 26.000; 4: 26.000; 5: 26.000
11 2,074 Καικῖνον 5 2 24.0% 1: 65.3%; 2: 65.3%; 3: 41.2%; 4: 41.2%; 5: 65.3% 9.5% 1: 85.7%; 2: 85.7%; 3: 76.2%; 4: 76.2%; 5: 85.7% 8.7% 1: 84.0%; 2: 84.0%; 3: 75.4%; 4: 75.4%; 5: 84.0% 1: 10.000; 2: 10.000; 3: 10.000; 4: 10.000; 5: 10.000
12 2,075 Καινίνη 5 3 14.4% 1: 65.0%; 2: 79.5%; 3: 79.1%; 4: 79.1%; 5: 79.5% 12.9% 1: 80.0%; 2: 92.9%; 3: 86.7%; 4: 86.7%; 5: 92.9% 8.8% 1: 79.2%; 2: 88.0%; 3: 86.6%; 4: 86.6%; 5: 88.0% 1: 15.000; 2: 13.000; 3: 15.000; 4: 15.000; 5: 13.000
13 2,076 Καινοί 5 1 0.0% 1: 82.8%; 2: 82.8%; 3: 82.8%; 4: 82.8%; 5: 82.8% 0.0% 1: 100.0%; 2: 100.0%; 3: 100.0%; 4: 100.0%; 5: 100.0% 0.0% 1: 94.9%; 2: 94.9%; 3: 94.9%; 4: 94.9%; 5: 94.9% 1: 11.000; 2: 11.000; 3: 11.000; 4: 11.000; 5: 11.000
14 2,078 Καινύς 5 2 0.0% 1: 70.0%; 2: 70.0%; 3: 70.0%; 4: 70.0%; 5: 70.0% 0.0% 1: 79.1%; 2: 79.1%; 3: 79.1%; 4: 79.1%; 5: 79.1% 0.1% 1: 75.3%; 2: 75.2%; 3: 75.2%; 4: 75.2%; 5: 75.2% 1: 21.000; 2: 21.000; 3: 21.000; 4: 21.000; 5: 21.000
15 2,077 Καιρή 5 5 11.8% 1: 53.5%; 2: 58.3%; 3: 58.3%; 4: 58.3%; 5: 46.5% 5.7% 1: 74.3%; 2: 80.0%; 3: 80.0%; 4: 80.0%; 5: 74.3% 5.2% 1: 71.8%; 2: 74.3%; 3: 74.2%; 4: 74.7%; 5: 69.5% 1: 18.000; 2: 18.000; 3: 18.000; 4: 18.000; 5: 18.000
16 2,079 Καισάρεια 5 3 2.2% 1: 66.5%; 2: 64.3%; 3: 66.5%; 4: 66.5%; 5: 66.5% 3.4% 1: 84.6%; 2: 85.3%; 3: 88.0%; 4: 88.0%; 5: 88.0% 2.6% 1: 78.2%; 2: 76.4%; 3: 79.0%; 4: 79.0%; 5: 79.0% 1: 39.000; 2: 36.000; 3: 36.000; 4: 36.000; 5: 36.000
17 2,080 Καλαβρία 5 3 8.2% 1: 35.2%; 2: 35.3%; 3: 43.4%; 4: 35.3%; 5: 35.3% 7.9% 1: 72.7%; 2: 68.6%; 3: 76.5%; 4: 68.6%; 5: 68.6% 5.2% 1: 70.8%; 2: 70.0%; 3: 75.2%; 4: 70.0%; 5: 70.0% 1: 15.000; 2: 17.000; 3: 16.000; 4: 17.000; 5: 17.000
18 2,081 Καλάθη 5 5 20.8% 1: 59.0%; 2: 63.5%; 3: 72.9%; 4: 62.2%; 5: 52.1% 6.5% 1: 91.5%; 2: 89.6%; 3: 93.8%; 4: 87.2%; 5: 88.2% 10.2% 1: 78.1%; 2: 79.7%; 3: 84.6%; 4: 79.6%; 5: 74.4% 1: 45.000; 2: 47.000; 3: 47.000; 4: 45.000; 5: 44.000
19 2,082 Καλάμαι 5 1 0.0% 1: 100.0%; 2: 100.0%; 3: 100.0%; 4: 100.0%; 5: 100.0% 0.0% 1: 100.0%; 2: 100.0%; 3: 100.0%; 4: 100.0%; 5: 100.0% 0.0% 1: 100.0%; 2: 100.0%; 3: 100.0%; 4: 100.0%; 5: 100.0% 1: 9.000; 2: 9.000; 3: 9.000; 4: 9.000; 5: 9.000
20 2,083 Καλαμένθη 5 5 20.4% 1: 58.4%; 2: 61.0%; 3: 55.8%; 4: 48.1%; 5: 68.5% 15.2% 1: 75.0%; 2: 83.3%; 3: 72.3%; 4: 77.3%; 5: 87.5% 15.6% 1: 77.9%; 2: 79.1%; 3: 73.3%; 4: 66.8%; 5: 82.4% 1: 24.000; 2: 24.000; 3: 23.000; 4: 20.000; 5: 24.000
21 2,084 Κάλαρνα 5 4 46.5% 1: 53.5%; 2: 100.0%; 3: 77.8%; 4: 77.8%; 5: 100.0% 17.2% 1: 82.8%; 2: 100.0%; 3: 85.7%; 4: 85.7%; 5: 100.0% 17.2% 1: 82.8%; 2: 100.0%; 3: 88.1%; 4: 87.9%; 5: 100.0% 1: 15.000; 2: 14.000; 3: 14.000; 4: 14.000; 5: 14.000
22 2,085 Καλάσιρις 5 4 19.4% 1: 35.3%; 2: 54.6%; 3: 35.3%; 4: 54.6%; 5: 35.3% 7.1% 1: 71.4%; 2: 78.6%; 3: 71.4%; 4: 78.6%; 5: 71.4% 8.2% 1: 74.7%; 2: 80.9%; 3: 72.7%; 4: 78.2%; 5: 72.7% 1: 15.000; 2: 15.000; 3: 15.000; 4: 15.000; 5: 15.000
23 2,086 Καλατίαι 5 2 23.2% 1: 100.0%; 2: 100.0%; 3: 76.8%; 4: 100.0%; 5: 100.0% 6.7% 1: 100.0%; 2: 100.0%; 3: 93.3%; 4: 100.0%; 5: 100.0% 12.1% 1: 100.0%; 2: 100.0%; 3: 87.9%; 4: 100.0%; 5: 100.0% 1: 8.000; 2: 8.000; 3: 7.000; 4: 8.000; 5: 8.000
24 2,087 Καλαύρεια 5 5 17.2% 1: 49.7%; 2: 56.9%; 3: 63.2%; 4: 66.9%; 5: 56.7% 3.7% 1: 88.1%; 2: 90.0%; 3: 90.0%; 4: 91.8%; 5: 88.5% 7.9% 1: 76.4%; 2: 79.5%; 3: 81.7%; 4: 84.3%; 5: 80.1% 1: 29.000; 2: 30.000; 3: 30.000; 4: 31.000; 5: 31.000
25 2,114 Κάλβιος 5 4 22.8% 1: 47.6%; 2: 52.5%; 3: 50.2%; 4: 70.5%; 5: 70.5% 9.0% 1: 75.7%; 2: 78.9%; 3: 74.3%; 4: 83.3%; 5: 83.3% 13.2% 1: 69.1%; 2: 75.2%; 3: 70.3%; 4: 82.4%; 5: 82.4% 1: 19.000; 2: 20.000; 3: 17.000; 4: 18.000; 5: 18.000
26 2,115 Καλὴ ἀκτή 5 5 6.5% 1: 34.6%; 2: 37.6%; 3: 34.7%; 4: 40.5%; 5: 34.0% 6.9% 1: 66.7%; 2: 70.4%; 3: 68.8%; 4: 70.4%; 5: 63.5% 4.1% 1: 59.8%; 2: 62.3%; 3: 60.3%; 4: 63.8%; 5: 60.1% 1: 62.000; 2: 61.000; 3: 61.000; 4: 61.000; 5: 62.000
27 2,116 Κάληρος 5 5 9.2% 1: 32.6%; 2: 30.9%; 3: 23.4%; 4: 30.4%; 5: 24.2% 9.8% 1: 72.0%; 2: 68.4%; 3: 62.3%; 4: 64.9%; 5: 62.2% 10.3% 1: 64.5%; 2: 60.4%; 3: 54.1%; 4: 58.8%; 5: 59.4% 1: 35.000; 2: 39.000; 3: 37.000; 4: 34.000; 5: 34.000
28 2,117 Καλησία 5 2 7.2% 1: 81.5%; 2: 74.3%; 3: 81.5%; 4: 81.5%; 5: 81.5% 5.4% 1: 91.9%; 2: 86.5%; 3: 91.9%; 4: 91.9%; 5: 91.9% 7.8% 1: 91.8%; 2: 84.0%; 3: 91.8%; 4: 91.8%; 5: 91.8% 1: 18.000; 2: 18.000; 3: 18.000; 4: 18.000; 5: 18.000
29 2,118 Καλλάτηβος 5 2 17.2% 1: 82.8%; 2: 82.8%; 3: 82.8%; 4: 100.0%; 5: 100.0% 8.3% 1: 91.7%; 2: 91.7%; 3: 91.7%; 4: 100.0%; 5: 100.0% 6.4% 1: 93.6%; 2: 93.6%; 3: 93.6%; 4: 100.0%; 5: 100.0% 1: 12.000; 2: 12.000; 3: 12.000; 4: 12.000; 5: 12.000
30 2,119 Κάλλατις 5 5 5.3% 1: 37.5%; 2: 32.9%; 3: 32.2%; 4: 32.4%; 5: 32.9% 5.6% 1: 70.7%; 2: 65.6%; 3: 67.2%; 4: 69.6%; 5: 65.1% 4.1% 1: 65.9%; 2: 62.0%; 3: 63.0%; 4: 65.0%; 5: 61.8% 1: 68.000; 2: 66.000; 3: 69.000; 4: 70.000; 5: 64.000
31 2,325 Καλλίαι 5 1 10.0% 1: 41.9%; 2: 51.9%; 3: 41.9%; 4: 41.9%; 5: 51.9% 0.0% 1: 82.6%; 2: 82.6%; 3: 82.6%; 4: 82.6%; 5: 82.6% 3.7% 1: 74.4%; 2: 78.1%; 3: 74.4%; 4: 74.4%; 5: 78.1% 1: 22.000; 2: 22.000; 3: 22.000; 4: 22.000; 5: 22.000
32 2,326 Καλλίαρος 5 5 8.2% 1: 69.5%; 2: 63.8%; 3: 61.3%; 4: 65.9%; 5: 63.0% 6.4% 1: 93.6%; 2: 87.5%; 3: 87.2%; 4: 90.7%; 5: 87.2% 8.1% 1: 85.9%; 2: 80.8%; 3: 77.8%; 4: 84.7%; 5: 82.3% 1: 47.000; 2: 49.000; 3: 47.000; 4: 50.000; 5: 47.000
33 2,327 Καλλιόπη 5 3 16.4% 1: 69.7%; 2: 53.4%; 3: 69.7%; 4: 69.7%; 5: 69.7% 19.7% 1: 91.9%; 2: 72.2%; 3: 91.9%; 4: 91.9%; 5: 86.5% 11.4% 1: 84.4%; 2: 73.6%; 3: 84.4%; 4: 84.4%; 5: 85.0% 1: 18.000; 2: 17.000; 3: 18.000; 4: 18.000; 5: 18.000
34 2,328 Καλλίπολις 5 5 8.4% 1: 46.7%; 2: 50.3%; 3: 42.2%; 4: 50.6%; 5: 48.0% 3.8% 1: 69.6%; 2: 70.3%; 3: 68.1%; 4: 71.9%; 5: 69.7% 7.2% 1: 72.7%; 2: 69.5%; 3: 65.5%; 4: 72.1%; 5: 69.5% 1: 49.000; 2: 48.000; 3: 48.000; 4: 46.000; 5: 46.000
35 2,329 Κάλπη 5 5 16.5% 1: 50.8%; 2: 65.8%; 3: 63.3%; 4: 64.8%; 5: 67.3% 6.3% 1: 83.9%; 2: 90.3%; 3: 87.7%; 4: 85.0%; 5: 84.7% 14.6% 1: 67.0%; 2: 81.6%; 3: 79.7%; 4: 79.5%; 5: 80.1% 1: 54.000; 2: 55.000; 3: 56.000; 4: 55.000; 5: 53.000
36 2,330 Καλύβη 5 4 8.6% 1: 80.4%; 2: 75.6%; 3: 71.8%; 4: 75.6%; 5: 78.4% 4.4% 1: 91.7%; 2: 89.4%; 3: 88.9%; 4: 89.4%; 5: 93.3% 7.9% 1: 84.3%; 2: 83.1%; 3: 81.5%; 4: 83.1%; 5: 89.3% 1: 24.000; 2: 23.000; 3: 21.000; 4: 23.000; 5: 21.000
37 2,331 Κάλυδνα 5 4 8.2% 1: 67.9%; 2: 67.1%; 3: 63.8%; 4: 67.1%; 5: 72.0% 3.6% 1: 94.3%; 2: 93.0%; 3: 90.7%; 4: 93.0%; 5: 92.0% 3.8% 1: 82.8%; 2: 86.5%; 3: 83.2%; 4: 86.5%; 5: 86.6% 1: 44.000; 2: 43.000; 3: 43.000; 4: 43.000; 5: 44.000
38 2,332 Καλυδών 5 4 9.6% 1: 58.9%; 2: 49.3%; 3: 58.9%; 4: 58.9%; 5: 50.4% 2.1% 1: 85.0%; 2: 85.0%; 3: 85.0%; 4: 85.0%; 5: 82.9% 2.5% 1: 80.0%; 2: 77.4%; 3: 80.0%; 4: 80.0%; 5: 77.9% 1: 20.000; 2: 20.000; 3: 20.000; 4: 20.000; 5: 21.000
39 2,333 Κάλυμνα 5 5 19.8% 1: 72.0%; 2: 54.6%; 3: 74.4%; 4: 65.6%; 5: 74.4% 2.7% 1: 89.2%; 2: 89.2%; 3: 90.7%; 4: 89.2%; 5: 91.9% 13.5% 1: 84.7%; 2: 73.1%; 3: 86.5%; 4: 80.4%; 5: 86.6% 1: 36.000; 2: 36.000; 3: 37.000; 4: 36.000; 5: 36.000
40 2,334 Κάλυνδα 5 2 13.4% 1: 100.0%; 2: 100.0%; 3: 100.0%; 4: 86.6%; 5: 86.6% 6.7% 1: 100.0%; 2: 100.0%; 3: 100.0%; 4: 93.3%; 5: 93.3% 5.4% 1: 100.0%; 2: 100.0%; 3: 100.0%; 4: 94.6%; 5: 94.6% 1: 15.000; 2: 15.000; 3: 15.000; 4: 15.000; 5: 15.000
41 2,335 Κάλυτις 5 4 2.5% 1: 34.0%; 2: 34.3%; 3: 32.2%; 4: 34.7%; 5: 34.3% 6.6% 1: 70.6%; 2: 66.7%; 3: 64.0%; 4: 70.6%; 5: 66.7% 3.1% 1: 62.8%; 2: 61.3%; 3: 59.9%; 4: 63.0%; 5: 61.3% 1: 25.000; 2: 25.000; 3: 24.000; 4: 25.000; 5: 25.000
42 2,342 Κάμιρος 5 5 15.6% 1: 60.3%; 2: 54.9%; 3: 59.7%; 4: 49.6%; 5: 65.1% 9.2% 1: 85.5%; 2: 81.4%; 3: 82.1%; 4: 78.3%; 5: 87.5% 8.4% 1: 83.6%; 2: 80.4%; 3: 79.7%; 4: 76.6%; 5: 85.0% 1: 56.000; 2: 59.000; 3: 58.000; 4: 61.000; 5: 58.000
43 2,345 Κάναθα 5 3 23.8% 1: 64.0%; 2: 40.3%; 3: 64.0%; 4: 64.0%; 5: 64.0% 11.1% 1: 83.3%; 2: 72.2%; 3: 83.3%; 4: 83.3%; 5: 83.3% 8.4% 1: 84.1%; 2: 75.8%; 3: 84.1%; 4: 84.1%; 5: 83.8% 1: 19.000; 2: 19.000; 3: 19.000; 4: 19.000; 5: 19.000
44 2,346 Κάναι 5 5 4.0% 1: 56.4%; 2: 60.4%; 3: 59.2%; 4: 60.2%; 5: 58.4% 1.9% 1: 82.9%; 2: 84.2%; 3: 84.8%; 4: 84.2%; 5: 84.2% 1.9% 1: 70.0%; 2: 71.9%; 3: 71.6%; 4: 71.8%; 5: 70.1% 1: 75.000; 2: 75.000; 3: 74.000; 4: 75.000; 5: 75.000
45 2,455 Κάναστρον 5 5 7.7% 1: 32.0%; 2: 33.0%; 3: 25.3%; 4: 30.1%; 5: 32.5% 11.2% 1: 67.2%; 2: 69.0%; 3: 58.4%; 4: 65.5%; 5: 69.6% 6.6% 1: 63.3%; 2: 62.5%; 3: 58.9%; 4: 63.1%; 5: 65.5% 1: 56.000; 2: 53.000; 3: 53.000; 4: 53.000; 5: 52.000
46 2,465 Κάνωπος 5 5 12.1% 1: 46.9%; 2: 42.1%; 3: 54.2%; 4: 45.7%; 5: 49.2% 6.9% 1: 80.7%; 2: 77.0%; 3: 84.0%; 4: 78.5%; 5: 78.3% 7.1% 1: 69.4%; 2: 67.4%; 3: 74.5%; 4: 68.3%; 5: 70.4% 1: 78.000; 2: 78.000; 3: 79.000; 4: 80.000; 5: 83.000
47 2,468 Καπετώλιον 5 5 5.7% 1: 24.6%; 2: 23.6%; 3: 20.9%; 4: 21.5%; 5: 26.6% 5.3% 1: 63.2%; 2: 60.6%; 3: 62.4%; 4: 57.9%; 5: 61.1% 4.9% 1: 51.4%; 2: 48.2%; 3: 48.0%; 4: 47.6%; 5: 52.5% 1: 131.000; 2: 116.000; 3: 128.000; 4: 121.000; 5: 127.000
48 2,470 Καππαδοκία 5 5 11.3% 1: 30.0%; 2: 28.1%; 3: 18.7%; 4: 26.4%; 5: 23.0% 8.9% 1: 84.3%; 2: 80.3%; 3: 75.4%; 4: 77.9%; 5: 78.9% 6.2% 1: 61.1%; 2: 59.2%; 3: 54.9%; 4: 56.4%; 5: 59.5% 1: 72.000; 2: 69.000; 3: 70.000; 4: 68.000; 5: 74.000
49 2,477 Καρδαμύλη 5 5 23.3% 1: 34.2%; 2: 52.2%; 3: 57.5%; 4: 53.6%; 5: 50.1% 11.4% 1: 70.5%; 2: 75.9%; 3: 81.8%; 4: 75.3%; 5: 73.6% 11.9% 1: 70.1%; 2: 79.0%; 3: 81.9%; 4: 78.0%; 5: 76.2% 1: 45.000; 2: 44.000; 3: 45.000; 4: 42.000; 5: 44.000
50 2,484 Καρία 5 5 4.5% 1: 39.6%; 2: 41.5%; 3: 42.0%; 4: 44.2%; 5: 42.8% 0.8% 1: 71.3%; 2: 72.0%; 3: 71.6%; 4: 71.5%; 5: 71.9% 1.7% 1: 64.9%; 2: 65.2%; 3: 65.4%; 4: 66.6%; 5: 66.6% 1: 235.000; 2: 238.000; 3: 233.000; 4: 239.000; 5: 239.000
51 2,597 Καρπασία 5 5 5.5% 1: 53.3%; 2: 49.1%; 3: 50.2%; 4: 50.7%; 5: 47.8% 9.4% 1: 73.0%; 2: 75.8%; 3: 72.9%; 4: 80.4%; 5: 71.0% 3.5% 1: 75.7%; 2: 73.4%; 3: 74.0%; 4: 75.6%; 5: 72.2% 1: 110.000; 2: 107.000; 3: 102.000; 4: 102.000; 5: 105.000
52 2,599 Καρπήσιοι 5 3 40.4% 1: 32.6%; 2: 63.4%; 3: 63.4%; 4: 23.0%; 5: 63.4% 19.0% 1: 66.7%; 2: 76.2%; 3: 76.2%; 4: 57.1%; 5: 76.2% 30.1% 1: 69.9%; 2: 82.2%; 3: 82.2%; 4: 52.1%; 5: 82.2% 1: 10.000; 2: 10.000; 3: 10.000; 4: 10.000; 5: 10.000
53 2,602 Καρύανδα 5 5 8.7% 1: 61.3%; 2: 65.6%; 3: 62.7%; 4: 56.8%; 5: 63.2% 5.1% 1: 82.9%; 2: 85.7%; 3: 82.4%; 4: 81.2%; 5: 80.6% 5.2% 1: 76.6%; 2: 79.7%; 3: 78.6%; 4: 74.5%; 5: 79.6% 1: 36.000; 2: 36.000; 3: 34.000; 4: 35.000; 5: 33.000
54 2,603 Κάρυστος 5 5 8.5% 1: 49.7%; 2: 43.3%; 3: 43.1%; 4: 41.2%; 5: 45.0% 6.4% 1: 75.9%; 2: 71.3%; 3: 69.5%; 4: 69.5%; 5: 71.1% 5.2% 1: 72.6%; 2: 67.5%; 3: 68.9%; 4: 67.4%; 5: 70.3% 1: 186.000; 2: 173.000; 3: 182.000; 4: 179.000; 5: 182.000
55 2,604 Καρχηδών 5 5 4.3% 1: 33.7%; 2: 37.1%; 3: 38.0%; 4: 34.3%; 5: 34.3% 1.3% 1: 69.1%; 2: 68.5%; 3: 68.3%; 4: 69.6%; 5: 68.8% 3.5% 1: 66.6%; 2: 68.0%; 3: 67.0%; 4: 66.4%; 5: 64.5% 1: 127.000; 2: 135.000; 3: 127.000; 4: 128.000; 5: 128.000
56 2,605 Κάσιον 5 5 9.2% 1: 52.5%; 2: 55.7%; 3: 53.6%; 4: 56.9%; 5: 47.7% 4.9% 1: 78.3%; 2: 77.2%; 3: 76.5%; 4: 79.6%; 5: 74.8% 4.4% 1: 74.4%; 2: 76.1%; 3: 75.1%; 4: 77.2%; 5: 72.8% 1: 59.000; 2: 58.000; 3: 59.000; 4: 57.000; 5: 59.000
57 2,607 Κάσος 5 5 13.4% 1: 40.1%; 2: 41.1%; 3: 36.0%; 4: 49.4%; 5: 37.0% 4.5% 1: 78.6%; 2: 78.3%; 3: 77.2%; 4: 74.8%; 5: 79.3% 8.7% 1: 66.1%; 2: 67.1%; 3: 64.8%; 4: 73.5%; 5: 65.6% 1: 60.000; 2: 58.000; 3: 57.000; 4: 58.000; 5: 59.000
58 2,609 Κάσπειρος 5 5 9.0% 1: 43.0%; 2: 46.1%; 3: 38.8%; 4: 37.1%; 5: 41.5% 4.0% 1: 69.7%; 2: 68.4%; 3: 66.4%; 4: 65.7%; 5: 68.7% 5.3% 1: 68.1%; 2: 69.0%; 3: 64.0%; 4: 63.7%; 5: 66.0% 1: 132.000; 2: 128.000; 3: 136.000; 4: 130.000; 5: 133.000
59 2,620 Κάσταξ 5 5 18.8% 1: 44.2%; 2: 55.2%; 3: 36.4%; 4: 46.7%; 5: 42.9% 13.1% 1: 76.9%; 2: 90.0%; 3: 84.2%; 4: 84.2%; 5: 84.2% 16.2% 1: 64.3%; 2: 75.4%; 3: 59.3%; 4: 67.2%; 5: 66.7% 1: 19.000; 2: 20.000; 3: 18.000; 4: 18.000; 5: 18.000
60 2,621 Κάστνιον 5 5 17.9% 1: 57.9%; 2: 59.0%; 3: 71.7%; 4: 53.9%; 5: 61.6% 14.6% 1: 78.4%; 2: 78.4%; 3: 86.3%; 4: 71.7%; 5: 79.2% 8.7% 1: 78.6%; 2: 81.9%; 3: 86.4%; 4: 77.7%; 5: 81.2% 1: 26.000; 2: 26.000; 3: 26.000; 4: 28.000; 5: 28.000
61 2,622 Καστωλοῦ πεδίον 5 5 21.5% 1: 52.9%; 2: 64.9%; 3: 62.9%; 4: 46.8%; 5: 43.5% 7.9% 1: 84.3%; 2: 89.4%; 3: 89.4%; 4: 81.5%; 5: 84.7% 13.8% 1: 72.7%; 2: 79.1%; 3: 78.5%; 4: 70.2%; 5: 65.2% 1: 41.000; 2: 43.000; 3: 43.000; 4: 39.000; 5: 43.000
62 2,623 Κασώριον 5 5 14.7% 1: 32.1%; 2: 18.7%; 3: 18.7%; 4: 33.4%; 5: 19.6% 0.0% 1: 73.7%; 2: 73.7%; 3: 73.7%; 4: 73.7%; 5: 73.7% 16.0% 1: 68.3%; 2: 54.1%; 3: 52.3%; 4: 65.6%; 5: 55.6% 1: 18.000; 2: 18.000; 3: 18.000; 4: 18.000; 5: 18.000
63 2,624 Κατάβαθμος 5 1 0.0% 1: 67.1%; 2: 67.1%; 3: 67.1%; 4: 67.1%; 5: 67.1% 0.0% 1: 89.5%; 2: 89.5%; 3: 89.5%; 4: 89.5%; 5: 89.5% 0.0% 1: 86.4%; 2: 86.4%; 3: 86.4%; 4: 86.4%; 5: 86.4% 1: 18.000; 2: 18.000; 3: 18.000; 4: 18.000; 5: 18.000
64 2,625 Κατακεκαυμένη 5 5 13.2% 1: 60.0%; 2: 51.7%; 3: 62.2%; 4: 54.2%; 5: 64.9% 14.3% 1: 81.7%; 2: 67.4%; 3: 80.9%; 4: 68.8%; 5: 79.1% 11.4% 1: 78.6%; 2: 67.2%; 3: 74.3%; 4: 70.9%; 5: 76.6% 1: 47.000; 2: 46.000; 3: 43.000; 4: 47.000; 5: 45.000
65 2,627 Κατάνειρα 5 4 1.5% 1: 41.2%; 2: 39.7%; 3: 41.2%; 4: 41.2%; 5: 41.2% 4.1% 1: 83.7%; 2: 83.7%; 3: 83.7%; 4: 87.8%; 5: 87.8% 1.7% 1: 72.1%; 2: 71.1%; 3: 72.0%; 4: 72.7%; 5: 72.7% 1: 22.000; 2: 22.000; 3: 22.000; 4: 20.000; 5: 20.000
66 2,626 Κατάνη 5 5 9.4% 1: 47.3%; 2: 50.8%; 3: 50.5%; 4: 49.2%; 5: 41.4% 3.0% 1: 73.5%; 2: 74.0%; 3: 72.0%; 4: 73.4%; 5: 71.0% 4.7% 1: 66.6%; 2: 67.3%; 3: 66.7%; 4: 68.5%; 5: 63.8% 1: 90.000; 2: 86.000; 3: 91.000; 4: 93.000; 5: 88.000
67 2,629 Καταννοί 5 1 0.0% 1: 81.5%; 2: 81.5%; 3: 81.5%; 4: 81.5%; 5: 81.5% 0.0% 1: 90.9%; 2: 90.9%; 3: 90.9%; 4: 90.9%; 5: 90.9% 0.0% 1: 90.1%; 2: 90.1%; 3: 90.1%; 4: 90.1%; 5: 90.1% 1: 11.000; 2: 11.000; 3: 11.000; 4: 11.000; 5: 11.000
68 2,628 Καταονία 5 5 21.6% 1: 21.2%; 2: 35.3%; 3: 42.8%; 4: 29.1%; 5: 36.2% 13.6% 1: 64.0%; 2: 77.6%; 3: 77.6%; 4: 72.0%; 5: 65.3% 15.8% 1: 53.6%; 2: 68.2%; 3: 69.4%; 4: 66.3%; 5: 67.4% 1: 26.000; 2: 25.000; 3: 25.000; 4: 26.000; 5: 25.000
69 2,630 Κάτρη 5 4 10.2% 1: 78.0%; 2: 78.0%; 3: 74.4%; 4: 67.8%; 5: 67.8% 4.3% 1: 91.3%; 2: 91.3%; 3: 88.9%; 4: 87.0%; 5: 87.0% 3.8% 1: 87.4%; 2: 87.5%; 3: 85.3%; 4: 83.7%; 5: 83.7% 1: 23.000; 2: 23.000; 3: 22.000; 4: 23.000; 5: 23.000
70 3,258 Κεκρυφάλεια 5 5 23.0% 1: 77.1%; 2: 77.1%; 3: 60.3%; 4: 54.1%; 5: 68.3% 8.4% 1: 94.1%; 2: 94.1%; 3: 88.0%; 4: 85.7%; 5: 92.0% 13.6% 1: 89.5%; 2: 89.4%; 3: 79.3%; 4: 75.9%; 5: 84.3% 1: 25.000; 2: 25.000; 3: 24.000; 4: 23.000; 5: 24.000
71 3,288 Κορώνεια 5 5 9.4% 1: 37.8%; 2: 32.8%; 3: 36.1%; 4: 42.3%; 5: 38.6% 6.7% 1: 69.6%; 2: 69.7%; 3: 67.5%; 4: 74.2%; 5: 70.9% 3.1% 1: 68.0%; 2: 66.5%; 3: 66.6%; 4: 69.6%; 5: 68.3% 1: 113.000; 2: 110.000; 3: 117.000; 4: 110.000; 5: 109.000
72 3,496 Κοτιάειον 5 5 5.4% 1: 38.8%; 2: 37.9%; 3: 42.1%; 4: 43.4%; 5: 41.0% 7.2% 1: 68.1%; 2: 63.4%; 3: 69.6%; 4: 70.6%; 5: 68.7% 2.4% 1: 62.1%; 2: 61.1%; 3: 61.5%; 4: 62.5%; 5: 60.1% 1: 64.000; 2: 71.000; 3: 64.000; 4: 65.000; 5: 63.000
73 3,513 Κρανίδες 5 1 0.0% 1: 87.3%; 2: 87.3%; 3: 87.3%; 4: 87.3%; 5: 87.3% 0.0% 1: 100.0%; 2: 100.0%; 3: 100.0%; 4: 100.0%; 5: 100.0% 0.0% 1: 96.6%; 2: 96.6%; 3: 96.6%; 4: 96.6%; 5: 96.6% 1: 15.000; 2: 15.000; 3: 15.000; 4: 15.000; 5: 15.000
74 3,530 Κριώα 5 4 10.7% 1: 48.6%; 2: 48.5%; 3: 38.0%; 4: 38.1%; 5: 48.6% 4.1% 1: 77.6%; 2: 77.6%; 3: 73.5%; 4: 73.5%; 5: 77.6% 5.6% 1: 73.3%; 2: 75.0%; 3: 71.1%; 4: 69.4%; 5: 73.3% 1: 23.000; 2: 23.000; 3: 23.000; 4: 23.000; 5: 23.000
75 7,242 Κύρβη 5 1 0.0% 1: 86.1%; 2: 86.1%; 3: 86.1%; 4: 86.1%; 5: 86.1% 0.0% 1: 96.3%; 2: 96.3%; 3: 96.3%; 4: 96.3%; 5: 96.3% 0.0% 1: 92.2%; 2: 92.2%; 3: 92.2%; 4: 92.2%; 5: 92.2% 1: 13.000; 2: 13.000; 3: 13.000; 4: 13.000; 5: 13.000
76 7,243 Κύρη 5 1 0.0% 1: 82.2%; 2: 82.2%; 3: 82.2%; 4: 82.2%; 5: 82.2% 0.0% 1: 93.0%; 2: 93.0%; 3: 93.0%; 4: 93.0%; 5: 93.0% 0.0% 1: 91.2%; 2: 91.2%; 3: 91.2%; 4: 91.2%; 5: 91.2% 1: 21.000; 2: 21.000; 3: 21.000; 4: 21.000; 5: 21.000
77 7,244 Κυρήνη 5 5 1.8% 1: 50.1%; 2: 49.7%; 3: 49.6%; 4: 49.3%; 5: 48.3% 2.7% 1: 75.0%; 2: 76.9%; 3: 76.9%; 4: 75.0%; 5: 77.7% 2.3% 1: 72.2%; 2: 73.0%; 3: 73.6%; 4: 72.6%; 5: 71.3% 1: 50.000; 2: 50.000; 3: 50.000; 4: 50.000; 5: 49.000
78 7,245 Κύρης 5 1 0.0% 1: 72.6%; 2: 72.6%; 3: 72.6%; 4: 72.6%; 5: 72.6% 0.0% 1: 100.0%; 2: 100.0%; 3: 100.0%; 4: 100.0%; 5: 100.0% 0.0% 1: 89.3%; 2: 89.3%; 3: 89.3%; 4: 89.3%; 5: 89.3% 1: 13.000; 2: 13.000; 3: 13.000; 4: 13.000; 5: 13.000
79 7,246 Κύρις 5 4 11.5% 1: 65.8%; 2: 65.8%; 3: 76.5%; 4: 77.3%; 5: 77.3% 5.3% 1: 84.2%; 2: 84.2%; 3: 84.2%; 4: 89.5%; 5: 89.5% 4.8% 1: 79.9%; 2: 79.9%; 3: 83.9%; 4: 84.7%; 5: 84.7% 1: 18.000; 2: 18.000; 3: 18.000; 4: 18.000; 5: 18.000
80 7,247 Κύρνος 5 5 8.4% 1: 45.0%; 2: 44.4%; 3: 39.0%; 4: 47.5%; 5: 39.9% 3.2% 1: 72.9%; 2: 75.0%; 3: 73.7%; 4: 75.5%; 5: 72.3% 3.4% 1: 64.8%; 2: 67.9%; 3: 65.7%; 4: 67.5%; 5: 64.5% 1: 46.000; 2: 46.000; 3: 45.000; 4: 48.000; 5: 44.000
81 7,248 Κύρου πόλις 5 5 6.3% 1: 33.5%; 2: 27.4%; 3: 32.6%; 4: 33.7%; 5: 33.7% 4.9% 1: 65.7%; 2: 63.8%; 3: 68.7%; 4: 68.7%; 5: 65.7% 2.1% 1: 66.9%; 2: 65.9%; 3: 68.0%; 4: 66.6%; 5: 67.9% 1: 35.000; 2: 37.000; 3: 35.000; 4: 35.000; 5: 35.000
82 7,249 Κύρρος 5 5 8.4% 1: 51.3%; 2: 53.5%; 3: 50.9%; 4: 51.2%; 5: 59.3% 4.7% 1: 72.1%; 2: 72.3%; 3: 72.1%; 4: 72.1%; 5: 76.7% 5.9% 1: 67.4%; 2: 65.4%; 3: 67.3%; 4: 67.7%; 5: 71.3% 1: 41.000; 2: 38.000; 3: 41.000; 4: 41.000; 5: 41.000
83 7,250 Κυρταία 5 5 11.9% 1: 52.0%; 2: 51.6%; 3: 63.6%; 4: 60.0%; 5: 54.7% 8.7% 1: 76.3%; 2: 79.5%; 3: 85.0%; 4: 85.0%; 5: 81.0% 8.4% 1: 72.4%; 2: 75.9%; 3: 80.7%; 4: 80.8%; 5: 77.2% 1: 36.000; 2: 38.000; 3: 40.000; 4: 40.000; 5: 39.000
84 7,251 Κύρτος 5 5 8.4% 1: 42.7%; 2: 49.3%; 3: 51.1%; 4: 44.4%; 5: 49.3% 5.4% 1: 76.8%; 2: 77.2%; 3: 80.0%; 4: 74.6%; 5: 77.2% 3.0% 1: 66.6%; 2: 66.3%; 3: 68.1%; 4: 65.1%; 5: 65.4% 1: 59.000; 2: 61.000; 3: 59.000; 4: 59.000; 5: 61.000
85 7,252 Κύρτωνες 5 5 28.4% 1: 59.3%; 2: 45.6%; 3: 68.9%; 4: 74.0%; 5: 52.0% 20.5% 1: 87.3%; 2: 74.1%; 3: 90.9%; 4: 94.5%; 5: 82.1% 17.9% 1: 78.9%; 2: 68.5%; 3: 85.5%; 4: 86.4%; 5: 73.7% 1: 28.000; 2: 26.000; 3: 28.000; 4: 28.000; 5: 29.000
86 7,253 Κυρτώνιος 5 4 13.1% 1: 32.9%; 2: 44.0%; 3: 45.6%; 4: 32.5%; 5: 32.9% 6.8% 1: 65.0%; 2: 70.0%; 3: 71.8%; 4: 65.0%; 5: 65.0% 6.9% 1: 64.6%; 2: 68.5%; 3: 69.3%; 4: 62.5%; 5: 64.6% 1: 22.000; 2: 22.000; 3: 21.000; 4: 22.000; 5: 22.000
87 7,254 Κύτα 5 5 9.4% 1: 44.9%; 2: 44.3%; 3: 53.2%; 4: 47.7%; 5: 53.6% 8.0% 1: 70.9%; 2: 69.8%; 3: 77.8%; 4: 74.4%; 5: 74.9% 8.0% 1: 71.0%; 2: 66.8%; 3: 73.3%; 4: 72.4%; 5: 74.8% 1: 91.000; 2: 85.000; 3: 83.000; 4: 88.000; 5: 87.000
88 7,255 Κυτέριον 5 4 5.5% 1: 44.9%; 2: 46.2%; 3: 48.0%; 4: 50.5%; 5: 44.9% 1.4% 1: 70.6%; 2: 72.0%; 3: 70.6%; 4: 70.6%; 5: 70.6% 2.1% 1: 73.4%; 2: 74.3%; 3: 74.9%; 4: 75.5%; 5: 73.4% 1: 29.000; 2: 28.000; 3: 29.000; 4: 29.000; 5: 29.000
89 7,256 Κύτινα 5 2 6.9% 1: 88.4%; 2: 88.4%; 3: 95.3%; 4: 88.4%; 5: 88.4% 3.1% 1: 93.8%; 2: 93.8%; 3: 96.9%; 4: 93.8%; 5: 93.8% 2.7% 1: 94.6%; 2: 94.6%; 3: 97.3%; 4: 94.6%; 5: 94.6% 1: 32.000; 2: 32.000; 3: 32.000; 4: 32.000; 5: 32.000
90 7,257 Κυτώνιον 5 5 19.0% 1: 68.9%; 2: 77.3%; 3: 63.9%; 4: 82.9%; 5: 82.9% 12.5% 1: 80.9%; 2: 91.7%; 3: 79.2%; 4: 91.7%; 5: 91.7% 12.9% 1: 77.8%; 2: 87.1%; 3: 76.6%; 4: 89.4%; 5: 89.5% 1: 22.000; 2: 23.000; 3: 23.000; 4: 23.000; 5: 23.000
91 7,258 Κύτωρος 5 5 16.0% 1: 62.4%; 2: 62.6%; 3: 72.6%; 4: 78.3%; 5: 71.9% 3.2% 1: 87.1%; 2: 88.5%; 3: 90.3%; 4: 90.0%; 5: 90.0% 6.9% 1: 85.1%; 2: 85.2%; 3: 89.4%; 4: 91.9%; 5: 87.7% 1: 32.000; 2: 31.000; 3: 32.000; 4: 30.000; 5: 30.000
92 7,259 Κύφος 5 5 19.4% 1: 56.2%; 2: 36.8%; 3: 56.2%; 4: 51.4%; 5: 52.5% 11.1% 1: 91.1%; 2: 80.0%; 3: 91.1%; 4: 85.0%; 5: 87.5% 9.7% 1: 80.2%; 2: 70.5%; 3: 80.1%; 4: 76.3%; 5: 76.9% 1: 58.000; 2: 56.000; 3: 58.000; 4: 59.000; 5: 58.000
93 7,260 Κυχρεῖος πάγος 5 5 8.6% 1: 45.5%; 2: 46.7%; 3: 44.1%; 4: 41.5%; 5: 38.1% 5.8% 1: 68.8%; 2: 65.6%; 3: 67.2%; 4: 63.0%; 5: 64.5% 5.2% 1: 67.7%; 2: 69.5%; 3: 68.5%; 4: 69.5%; 5: 64.3% 1: 64.000; 2: 64.000; 3: 64.000; 4: 66.000; 5: 63.000
94 7,261 Κύψελα 5 5 10.4% 1: 69.8%; 2: 62.9%; 3: 66.1%; 4: 59.4%; 5: 62.9% 8.5% 1: 86.2%; 2: 83.1%; 3: 83.1%; 4: 77.6%; 5: 83.1% 4.4% 1: 81.1%; 2: 78.4%; 3: 79.5%; 4: 76.6%; 5: 78.8% 1: 31.000; 2: 31.000; 3: 31.000; 4: 33.000; 5: 31.000
95 7,262 Κῶβρυς 5 4 34.1% 1: 72.9%; 2: 56.7%; 3: 72.9%; 4: 66.1%; 5: 90.7% 16.7% 1: 90.5%; 2: 81.0%; 3: 90.5%; 4: 90.5%; 5: 97.7% 17.8% 1: 86.5%; 2: 76.9%; 3: 86.5%; 4: 81.5%; 5: 94.7% 1: 20.000; 2: 20.000; 3: 20.000; 4: 20.000; 5: 21.000
96 7,263 Κώθων 5 3 19.7% 1: 100.0%; 2: 90.4%; 3: 100.0%; 4: 80.3%; 5: 100.0% 4.5% 1: 100.0%; 2: 100.0%; 3: 100.0%; 4: 95.5%; 5: 100.0% 8.5% 1: 100.0%; 2: 96.5%; 3: 100.0%; 4: 91.5%; 5: 100.0% 1: 22.000; 2: 22.000; 3: 22.000; 4: 22.000; 5: 22.000
97 7,264 Κωλιάς 5 5 13.3% 1: 43.3%; 2: 56.6%; 3: 51.3%; 4: 56.3%; 5: 54.2% 7.7% 1: 72.0%; 2: 79.7%; 3: 73.8%; 4: 79.3%; 5: 74.8% 6.2% 1: 70.0%; 2: 75.8%; 3: 72.9%; 4: 76.2%; 5: 73.0% 1: 64.000; 2: 62.000; 3: 61.000; 4: 60.000; 5: 62.000
98 7,265 Κῶλοι 5 5 39.4% 1: 88.4%; 2: 54.4%; 3: 70.7%; 4: 49.0%; 5: 79.7% 10.5% 1: 93.9%; 2: 83.3%; 3: 85.7%; 4: 83.3%; 5: 91.7% 21.5% 1: 87.7%; 2: 68.4%; 3: 75.9%; 4: 66.2%; 5: 83.8% 1: 24.000; 2: 23.000; 3: 24.000; 4: 23.000; 5: 23.000
99 7,266 Κώμη 5 5 6.9% 1: 21.1%; 2: 16.5%; 3: 14.3%; 4: 14.2%; 5: 14.4% 7.4% 1: 48.1%; 2: 51.0%; 3: 53.4%; 4: 55.4%; 5: 51.6% 1.2% 1: 48.7%; 2: 49.9%; 3: 49.9%; 4: 49.7%; 5: 48.9% 1: 75.000; 2: 78.000; 3: 82.000; 4: 69.000; 5: 80.000
100 7,267 Κωνώπη 5 5 9.4% 1: 63.0%; 2: 63.0%; 3: 60.9%; 4: 64.6%; 5: 55.2% 4.6% 1: 83.9%; 2: 83.9%; 3: 83.9%; 4: 85.2%; 5: 80.6% 2.5% 1: 78.0%; 2: 78.3%; 3: 78.2%; 4: 78.2%; 5: 75.8% 1: 60.000; 2: 60.000; 3: 60.000; 4: 58.000; 5: 60.000

Experiment Coverage

This table only covers active prompt-comparison experiments. Retired temperature attempts and Parallage prompt-spectrum translations are excluded from the measured website because they are not part of the paper-facing metric comparison.

FamilyVariantsEvaluated pairsNotes
Main ChatGPT paper prompts 3 300 Core v1/v2/v3 comparison.
External Claude variants 9 900 Imported from external workspaces; rows stay non-public by default.
v4 reasoning/mini experiments 6 600 Active slow experiment lanes; several still have open requests. Repeated runs are reported separately above.

Tracked Prompt Variant Status

Prompt Active API mode Reasoning Requested runs Completed runs Completed lemmas Evaluated Kappa pairs Open requests Status
claude_fable_5 v1 yes chat_completions 1 100 100 100 0 External Claude import complete for the Kappa corpus.
claude_fable_5 v2 yes chat_completions 1 100 100 100 0 External Claude import complete for the Kappa corpus.
claude_fable_5 v3 yes chat_completions 1 100 100 100 0 External Claude import complete for the Kappa corpus.
claude_opus_4_8 v1 yes chat_completions 1 100 100 100 0 External Claude import complete for the Kappa corpus.
claude_opus_4_8 v2 yes chat_completions 1 100 100 100 0 External Claude import complete for the Kappa corpus.
claude_opus_4_8 v3 yes chat_completions 1 100 100 100 0 External Claude import complete for the Kappa corpus.
claude_sonnet_5 v1 yes chat_completions 1 100 100 100 0 External Claude import complete for the Kappa corpus.
claude_sonnet_5 v2 yes chat_completions 1 100 100 100 0 External Claude import complete for the Kappa corpus.
claude_sonnet_5 v3 yes chat_completions 1 100 100 100 0 External Claude import complete for the Kappa corpus.
gpt-4.1-2025-04-14 v1 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-4.1-2025-04-14 v2 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-4.1-2025-04-14 v3 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-4o-2024-05-13 v1 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-4o-2024-05-13 v2 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-4o-2024-05-13 v3 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-4o-2024-08-06 v1 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-4o-2024-08-06 v2 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-4o-2024-08-06 v3 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-4o-2024-11-20 v1 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-4o-2024-11-20 v2 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-4o-2024-11-20 v3 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-4-turbo-2024-04-09 v1 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-4-turbo-2024-04-09 v2 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-4-turbo-2024-04-09 v3 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-5 v1 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-5 v2 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-5 v3 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-5.1 v1 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-5.1 v2 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-5.1 v3 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-5.2 v1 yes chat_completions 1 113 109 100 0 Tracked prompt profile.
gpt-5.2 v2 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-5.2 v3 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-5.3-chat-latest v1 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-5.3-chat-latest v2 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-5.3-chat-latest v3 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-5.4 v1 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-5.4 v2 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-5.4 v3 yes chat_completions 1 100 100 100 0 Tracked prompt profile.
gpt-5.5 v1 no chat_completions 1 101 101 100 0 Main ChatGPT prompt series for the paper.
gpt-5.5 v2 no chat_completions 1 102 102 100 0 Main ChatGPT prompt series for the paper.
gpt-5.5 v3 yes chat_completions 1 2,700 779 100 0 Main ChatGPT prompt series for the paper.
gpt-5.5_v4_mini v1 yes responses low 1 101 101 100 0 Active Responses API experiment with reasoning effort set on the profile.
gpt-5.5_v4_mini_high v1 yes responses high 1 101 101 100 0 Active Responses API experiment with reasoning effort set on the profile.
gpt-5.5_v4_mini_medium v1 yes responses medium 1 101 101 100 0 Active Responses API experiment with reasoning effort set on the profile.
gpt-5.5_v4_reasoning v1 yes responses low 1 101 101 100 0 Active Responses API experiment with reasoning effort set on the profile.
gpt-5.5_v4_reasoning_high v1 yes responses high 1 101 101 100 0 Active Responses API experiment with reasoning effort set on the profile.
gpt-5.5_v4_reasoning_medium v1 yes responses medium 1 101 101 100 0 Active Responses API experiment with reasoning effort set on the profile.
gpt-5.6-sol v1 yes responses medium 1 100 100 100 0 Tracked prompt profile.
gpt-5.6-sol v2 yes responses medium 1 100 100 100 0 Tracked prompt profile.
gpt-5.6-sol v3 yes responses medium 1 100 100 100 0 Tracked prompt profile.

OpenAI Model Timeline

The dedicated timeline analysis compares 12 OpenAI model releases across 3 fixed Stephanos prompt versions on the same 100-row Kappa paper corpus. 36 of 36 model-prompt sets are complete.

Open the model-timeline charts, projections, and detailed table.

R^2 by prompt version
R^2 by prompt version with best-fit line.
Mean BLEU-4 by prompt version
Mean BLEU-4 by prompt version with best-fit line.
Length slope by prompt version
Length slope by prompt version with best-fit line.

Metric vs Passage Length Patterns

Passage length is measured as the source Greek token count when source text is available, falling back to human translation word count only when a source passage has no Greek tokens. Each row regresses one metric against passage length for one prompt version.

Evaluable regressions605
Positive45
Negative560
Significant positive0
Significant negative478

Across 605 evaluable metric/prompt regressions, negative correlations are more common: 45 positive, 560 negative, and 0 flat. Using p < 0.05, 0 are significantly positive and 478 are significantly negative.

Open the full metric vs passage length page.

Synthetic comparison to Zainaldi et al Galen translation

Zainaldi et al.'s Galen translation is represented here by its reported mean passage length of 220.5 words. The Stephanos values below are raw ordinary-least-squares predictions from the metric-vs-passage-length regressions above; they are not clamped to metric bounds.

Synthetic Stephanos prompt scores and Zainaldin aggregates
Synthetic Stephanos prompt scores and Zainaldin aggregates.
Synthetic minus Zainaldin aggregate score differences
Synthetic minus Zainaldin aggregate score differences.

Synthetic Stephanos metrics at 220.5 words

Prompt Synthetic passage words Observed source word range Extrapolated? BLEU-4chrF++METEORROUGE-LBERTScoreCOMETBLEURT
claude_fable_5 v1 220.5 5.000-181.000 yes 20.5%53.0%49.8%52.0%87.8%67.7%35.5%
claude_fable_5 v2 220.5 5.000-181.000 yes 6.7%43.1%42.5%48.4%88.9%64.2%32.6%
claude_fable_5 v3 220.5 5.000-181.000 yes 6.6%43.5%48.4%50.3%89.6%64.6%29.4%
claude_opus_4_8 v1 220.5 5.000-181.000 yes 19.9%53.9%47.3%49.4%88.4%72.8%35.5%
claude_opus_4_8 v2 220.5 5.000-181.000 yes -2.1%38.3%38.1%40.7%87.6%63.3%28.8%
claude_opus_4_8 v3 220.5 5.000-181.000 yes 0.5%41.0%39.1%42.7%88.7%63.7%28.7%
claude_sonnet_5 v1 220.5 5.000-181.000 yes 24.9%54.2%49.4%48.8%87.4%69.8%33.4%
claude_sonnet_5 v2 220.5 5.000-181.000 yes 9.0%45.7%34.0%42.0%88.8%66.2%32.7%
claude_sonnet_5 v3 220.5 5.000-181.000 yes 1.4%41.7%41.6%42.2%88.9%64.0%31.0%
gpt-4-turbo-2024-04-09 v1 220.5 5.000-181.000 yes 20.9%51.6%35.3%46.0%88.0%66.8%23.0%
gpt-4-turbo-2024-04-09 v2 220.5 5.000-181.000 yes -18.0%27.8%16.0%24.4%84.8%60.8%14.5%
gpt-4-turbo-2024-04-09 v3 220.5 5.000-181.000 yes -2.7%38.0%25.8%32.3%86.6%65.2%23.9%
gpt-4.1-2025-04-14 v1 220.5 5.000-181.000 yes 24.4%58.3%45.6%48.7%88.2%71.5%30.9%
gpt-4.1-2025-04-14 v2 220.5 5.000-181.000 yes 7.5%44.2%36.6%40.4%87.2%64.5%28.5%
gpt-4.1-2025-04-14 v3 220.5 5.000-181.000 yes 4.6%41.5%35.4%37.4%86.6%63.3%24.1%
gpt-4o-2024-05-13 v1 220.5 5.000-181.000 yes 14.3%35.4%24.8%29.2%85.2%56.6%25.5%
gpt-4o-2024-05-13 v2 220.5 5.000-181.000 yes 1.7%35.1%26.7%32.4%85.7%61.6%22.0%
gpt-4o-2024-05-13 v3 220.5 5.000-181.000 yes -0.9%33.8%25.1%31.5%86.6%61.0%20.0%
gpt-4o-2024-08-06 v1 220.5 5.000-181.000 yes 16.2%49.7%38.2%41.0%87.3%68.4%24.1%
gpt-4o-2024-08-06 v2 220.5 5.000-181.000 yes 2.1%38.7%28.1%35.5%85.7%63.0%19.6%
gpt-4o-2024-08-06 v3 220.5 5.000-181.000 yes -2.2%37.4%31.1%32.7%86.2%62.8%24.6%
gpt-4o-2024-11-20 v1 220.5 5.000-181.000 yes 11.2%48.5%30.3%36.5%86.8%69.7%29.0%
gpt-4o-2024-11-20 v2 220.5 5.000-181.000 yes 1.9%39.0%27.9%38.1%86.6%63.8%24.8%
gpt-4o-2024-11-20 v3 220.5 5.000-181.000 yes -0.2%41.5%31.5%34.2%86.4%65.3%25.4%
gpt-5 v1 220.5 5.000-181.000 yes 25.2%54.6%49.5%53.0%89.2%70.9%29.1%
gpt-5 v2 220.5 5.000-181.000 yes -2.7%35.8%32.1%44.2%86.4%59.9%12.5%
gpt-5 v3 220.5 5.000-181.000 yes 3.7%41.0%31.2%42.0%88.3%63.1%26.4%
gpt-5.1 v1 220.5 5.000-181.000 yes 30.1%58.1%54.4%50.0%88.0%72.4%30.1%
gpt-5.1 v2 220.5 5.000-181.000 yes 7.3%44.1%37.7%45.9%87.2%63.4%24.4%
gpt-5.1 v3 220.5 5.000-181.000 yes 8.6%45.4%37.9%41.2%87.7%64.4%28.7%
gpt-5.2 v1 220.5 5.000-181.000 yes 15.7%47.2%42.6%50.7%88.1%71.4%26.2%
gpt-5.2 v2 220.5 5.000-181.000 yes -3.3%33.0%34.4%43.7%86.8%59.7%19.1%
gpt-5.2 v3 220.5 5.000-181.000 yes 7.8%44.4%47.4%50.6%87.5%65.0%26.5%
gpt-5.3-chat-latest v1 220.5 5.000-181.000 yes 24.9%55.2%57.3%56.0%87.9%65.5%25.5%
gpt-5.3-chat-latest v2 220.5 5.000-181.000 yes 1.2%37.3%36.1%45.0%86.9%61.5%22.6%
gpt-5.3-chat-latest v3 220.5 5.000-181.000 yes 6.4%41.6%44.9%46.9%88.3%64.7%27.8%
gpt-5.4 v1 220.5 5.000-181.000 yes 30.6%55.3%51.6%53.0%88.7%70.0%29.3%
gpt-5.4 v2 220.5 5.000-181.000 yes 3.8%42.2%39.6%42.6%87.1%62.6%24.3%
gpt-5.4 v3 220.5 5.000-181.000 yes 3.6%44.5%44.9%47.8%88.4%64.4%28.6%
gpt-5.5 v1 220.5 5.000-181.000 yes 24.9%53.2%54.1%55.2%88.3%67.6%29.6%
gpt-5.5 v2 220.5 5.000-181.000 yes -3.1%36.2%40.7%45.5%87.5%62.6%26.6%
gpt-5.5 v3 220.5 5.000-181.000 yes 9.7%43.6%49.8%51.8%89.5%65.1%27.5%
gpt-5.5_v4_mini v1 220.5 5.000-181.000 yes -7.1%33.1%23.5%31.1%85.7%60.3%19.7%
gpt-5.5_v4_mini_high v1 220.5 5.000-181.000 yes -1.4%39.5%32.1%35.8%87.8%63.9%27.3%
gpt-5.5_v4_mini_medium v1 220.5 5.000-181.000 yes 3.6%40.3%32.7%38.3%87.7%62.9%27.6%
gpt-5.5_v4_reasoning v1 220.5 5.000-181.000 yes 0.0%36.1%44.3%46.2%88.0%61.3%25.9%
gpt-5.5_v4_reasoning_high v1 220.5 5.000-181.000 yes 2.2%41.9%44.2%45.4%89.3%64.9%30.2%
gpt-5.5_v4_reasoning_medium v1 220.5 5.000-181.000 yes -6.0%36.4%38.9%42.1%88.2%63.5%24.2%
gpt-5.6-sol v1 220.5 5.000-181.000 yes 15.8%53.2%44.8%50.3%88.5%68.9%33.2%
gpt-5.6-sol v2 220.5 5.000-181.000 yes 1.4%38.3%40.7%46.3%87.5%62.3%26.4%
gpt-5.6-sol v3 220.5 5.000-181.000 yes -2.0%39.0%42.7%46.5%89.0%65.7%31.6%
legacy_scholarly v3 220.5 5.000-181.000 yes 2.1%40.7%42.1%45.5%88.6%66.2%26.1%
paper_guidance_ablation_gpt56 v1 220.5 5.000-181.000 yes 3.4%39.4%40.2%46.9%88.3%63.7%30.0%
paper_guidance_ablation_gpt56 v2 220.5 5.000-181.000 yes -4.0%35.7%36.1%42.3%88.7%66.3%29.3%
paper_guidance_ablation_gpt56 v3 220.5 5.000-181.000 yes 1.4%39.7%43.6%46.7%89.1%66.1%34.4%

Zainaldin et al. reported metrics

Table 1 of Zainaldin et al. 2026 reports these values as mean scores multiplied by 100; the table below displays the same scale as percentages.

Text Model BLEU-4chrF++METEORROUGE-LBERTScoreCOMETBLEURT
Mix. ChatGPT 31.4%53.4%46.4%50.9%91.0%79.9%49.8%
Mix. Claude 34.2%55.4%48.5%55.3%91.6%79.8%50.4%
Mix. Gemini 34.2%57.0%50.0%56.0%91.5%80.7%51.3%
Mix. Aggregate 33.3%55.3%48.3%54.1%91.4%80.1%50.5%
Comp. ChatGPT 15.7%47.4%40.1%45.7%89.1%75.1%42.6%
Comp. Claude 16.7%49.4%42.9%47.8%89.7%76.5%46.2%
Comp. Gemini 19.0%51.2%44.4%47.8%89.9%77.3%45.8%
Comp. Aggregate 17.1%49.3%42.5%47.1%89.5%76.3%44.9%

Prompt Version Summary

Prompt First translation Pairs Lemmas Slope Intercept R^2 Slope p |slope - 1| BLEU-4 chrF++ METEOR ROUGE-L BERTScore COMET BLEURT Trigram precision Trigram recall Trigram F1 Trigram Jaccard Mean abs residual
claude_fable_5 v1 2026-07-05 100 100 1.040 1.213 0.982 9.78e-87 0.040 27.5% 58.3% 66.0% 67.9% 93.6% 73.7% 68.3% 25.5% 27.3% 26.4% 15.2% 3.855
claude_fable_5 v2 2026-07-05 100 100 0.909 2.460 0.985 2.28e-91 0.091 54.3% 74.4% 78.1% 79.1% 96.8% 80.5% 77.5% 44.1% 42.4% 43.2% 27.6% 2.869
claude_fable_5 v3 2026-07-03 100 100 0.958 1.137 0.990 4.94e-99 0.042 58.2% 77.4% 81.9% 82.1% 97.1% 81.5% 78.9% 49.9% 49.0% 49.4% 32.8% 2.592
claude_opus_4_8 v1 2026-07-05 100 100 1.126 2.917 0.975 5.91e-80 0.126 20.5% 53.7% 61.5% 61.3% 92.0% 71.8% 64.6% 18.9% 22.7% 20.6% 11.5% 5.150
claude_opus_4_8 v2 2026-08-22 100 100 0.966 1.155 0.989 8.68e-98 0.034 50.7% 72.4% 77.8% 78.3% 96.3% 80.0% 75.7% 41.0% 40.7% 40.9% 25.7% 2.507
claude_opus_4_8 v3 2026-07-05 100 100 0.957 1.190 0.988 2.67e-95 0.043 54.1% 75.0% 80.8% 81.4% 96.8% 80.8% 77.3% 46.6% 45.8% 46.2% 30.1% 2.672
claude_sonnet_5 v1 2026-07-03 100 100 1.023 2.775 0.979 2.57e-84 0.023 21.0% 53.0% 62.3% 62.2% 92.7% 73.1% 66.0% 20.6% 22.5% 21.5% 12.1% 3.829
claude_sonnet_5 v2 2026-07-03 100 100 0.919 1.765 0.984 6.85e-90 0.081 47.2% 69.6% 75.3% 76.6% 96.1% 79.4% 74.6% 40.4% 38.7% 39.5% 24.6% 2.870
claude_sonnet_5 v3 2026-07-05 100 100 0.954 1.018 0.990 8.01e-100 0.046 54.6% 74.8% 81.5% 81.8% 96.8% 81.0% 77.5% 48.5% 47.4% 48.0% 31.5% 2.439
gpt-4-turbo-2024-04-09 v1 2026-07-16 100 100 0.898 6.911 0.964 1.04e-72 0.102 17.5% 47.9% 53.0% 53.8% 91.5% 71.1% 62.2% 15.6% 16.5% 16.0% 8.7% 4.561
gpt-4-turbo-2024-04-09 v2 2026-07-16 100 100 0.888 3.076 0.982 9.56e-87 0.112 40.0% 64.5% 68.7% 70.7% 94.9% 77.7% 71.3% 31.0% 29.6% 30.3% 17.9% 3.356
gpt-4-turbo-2024-04-09 v3 2026-07-16 100 100 0.921 3.589 0.976 4.10e-81 0.079 35.8% 63.0% 68.1% 68.6% 94.4% 76.9% 70.0% 28.3% 28.3% 28.3% 16.5% 4.128
gpt-4.1-2025-04-14 v1 2026-07-16 100 100 0.999 4.615 0.977 7.20e-82 0.001 19.6% 51.2% 56.9% 58.7% 92.2% 72.7% 65.2% 17.7% 19.7% 18.7% 10.3% 4.568
gpt-4.1-2025-04-14 v2 2026-07-16 100 100 0.948 1.757 0.988 2.53e-95 0.052 41.2% 66.0% 72.4% 73.1% 95.4% 78.2% 72.2% 35.0% 34.6% 34.8% 21.1% 2.918
gpt-4.1-2025-04-14 v3 2026-07-16 100 100 0.977 0.980 0.989 3.91e-98 0.023 43.7% 68.4% 75.6% 75.7% 95.6% 78.6% 72.9% 38.1% 38.0% 38.1% 23.5% 2.973
gpt-4o-2024-05-13 v1 2026-07-16 100 100 0.637 16.785 0.594 6.89e-21 0.363 19.8% 50.2% 55.3% 57.2% 92.3% 72.4% 65.3% 17.5% 17.8% 17.7% 9.7% 11.343
gpt-4o-2024-05-13 v2 2026-07-16 100 100 0.835 4.383 0.914 4.78e-54 0.165 39.7% 64.3% 69.5% 71.8% 95.1% 77.3% 71.1% 33.7% 31.4% 32.5% 19.4% 4.523
gpt-4o-2024-05-13 v3 2026-07-16 100 100 0.880 3.606 0.913 9.98e-54 0.120 41.5% 66.9% 72.7% 74.3% 95.2% 78.0% 71.8% 36.9% 35.4% 36.1% 22.0% 4.433
gpt-4o-2024-08-06 v1 2026-07-16 100 100 0.965 5.570 0.977 4.46e-82 0.035 18.4% 49.7% 54.3% 56.1% 92.1% 72.9% 64.5% 15.6% 17.1% 16.3% 8.9% 4.211
gpt-4o-2024-08-06 v2 2026-07-16 100 100 0.922 2.240 0.983 6.39e-89 0.078 38.7% 64.7% 70.8% 72.3% 95.2% 77.7% 71.0% 31.6% 30.7% 31.2% 18.5% 3.183
gpt-4o-2024-08-06 v3 2026-07-16 100 100 0.939 1.866 0.982 7.31e-88 0.061 42.4% 67.2% 73.5% 74.6% 95.3% 77.9% 71.6% 36.7% 36.0% 36.4% 22.2% 3.633
gpt-4o-2024-11-20 v1 2026-07-16 100 100 1.050 4.802 0.966 4.63e-74 0.050 16.5% 49.0% 54.7% 54.6% 91.9% 72.7% 64.7% 13.2% 15.4% 14.3% 7.7% 5.150
gpt-4o-2024-11-20 v2 2026-07-16 100 100 0.900 3.578 0.975 1.46e-80 0.100 40.2% 65.8% 71.4% 72.4% 95.4% 78.2% 71.9% 33.1% 32.4% 32.8% 19.6% 3.650
gpt-4o-2024-11-20 v3 2026-07-16 100 100 0.982 0.907 0.988 2.58e-95 0.018 42.5% 67.3% 73.4% 73.9% 95.3% 78.4% 72.5% 35.1% 35.1% 35.1% 21.3% 3.117
gpt-5 v1 2026-07-15 100 100 0.981 2.837 0.980 8.03e-85 0.019 20.7% 51.9% 60.4% 61.8% 92.3% 71.8% 63.4% 21.0% 22.0% 21.5% 12.0% 4.084
gpt-5 v2 2026-07-15 100 100 0.821 4.469 0.968 2.60e-75 0.179 47.7% 70.0% 74.5% 76.2% 96.0% 78.7% 73.5% 40.4% 37.2% 38.7% 24.0% 3.641
gpt-5 v3 2026-07-15 100 100 0.902 2.070 0.986 2.93e-92 0.098 49.1% 72.3% 78.2% 79.2% 96.2% 79.9% 75.1% 45.1% 42.7% 43.9% 28.1% 2.875
gpt-5.1 v1 2026-07-15 100 100 1.131 0.345 0.987 5.31e-94 0.131 20.3% 51.9% 59.5% 60.2% 92.2% 71.9% 63.8% 20.6% 23.5% 21.9% 12.3% 3.802
gpt-5.1 v2 2026-07-15 100 100 0.966 1.024 0.990 1.67e-99 0.034 45.3% 68.7% 73.5% 74.6% 95.7% 78.8% 73.2% 37.9% 37.5% 37.7% 23.2% 2.670
gpt-5.1 v3 2026-07-15 100 100 1.005 0.807 0.989 4.57e-97 0.005 46.2% 70.7% 76.8% 76.7% 95.6% 79.0% 73.4% 39.8% 40.7% 40.3% 25.2% 3.060
gpt-5.2 v1 2026-02-14 100 100 1.011 5.096 0.983 1.12e-88 0.011 23.4% 53.9% 58.7% 58.5% 91.9% 71.5% 63.6% 18.2% 20.6% 19.3% 10.7% 3.993
gpt-5.2 v2 2026-07-15 100 100 0.922 1.802 0.988 1.29e-95 0.078 48.1% 70.4% 75.6% 76.0% 95.9% 79.0% 74.2% 40.0% 38.4% 39.2% 24.4% 2.701
gpt-5.2 v3 2026-07-15 100 100 0.980 0.697 0.990 3.82e-100 0.020 46.6% 69.9% 77.1% 77.3% 95.7% 79.0% 73.5% 42.0% 41.8% 41.9% 26.5% 2.643
gpt-5.3-chat-latest v1 2026-07-15 100 100 0.987 3.014 0.962 3.74e-71 0.013 23.0% 52.8% 59.5% 61.1% 92.6% 72.6% 65.6% 22.1% 23.4% 22.7% 12.8% 4.012
gpt-5.3-chat-latest v2 2026-07-15 100 100 0.889 3.029 0.984 5.01e-90 0.111 48.1% 69.8% 75.2% 76.2% 95.9% 79.1% 74.2% 40.8% 39.0% 39.9% 24.9% 3.182
gpt-5.3-chat-latest v3 2026-07-15 100 100 0.932 2.214 0.987 5.68e-94 0.068 48.3% 70.1% 76.7% 77.4% 95.8% 79.3% 74.4% 42.9% 42.1% 42.5% 26.9% 3.182
gpt-5.4 v1 2026-07-14 100 100 0.978 2.550 0.988 4.38e-95 0.022 23.2% 52.7% 57.5% 60.1% 92.4% 71.4% 63.0% 21.0% 21.7% 21.3% 11.9% 3.238
gpt-5.4 v2 2026-07-14 100 100 0.940 1.708 0.984 1.12e-89 0.060 46.8% 69.7% 76.5% 77.2% 96.0% 79.1% 73.7% 40.5% 39.6% 40.1% 25.1% 3.023
gpt-5.4 v3 2026-07-14 100 100 0.963 1.328 0.989 4.03e-97 0.037 52.7% 74.1% 79.9% 79.6% 96.5% 80.1% 75.9% 45.6% 45.3% 45.5% 29.4% 2.927
gpt-5.5 v1 2026-06-17 100 100 1.003 2.607 0.985 1.94e-91 0.003 25.1% 53.7% 56.0% 58.4% 92.3% 72.2% 63.6% 20.1% 21.4% 20.7% 11.6% 3.562
gpt-5.5 v2 2026-06-07 100 100 0.888 2.957 0.981 4.12e-86 0.112 51.9% 72.4% 77.3% 78.0% 96.4% 79.9% 76.1% 43.3% 41.3% 42.3% 26.8% 3.084
gpt-5.5 v3 2026-05-07 100 100 0.929 2.247 0.986 2.62e-93 0.071 57.6% 77.2% 80.8% 81.2% 97.0% 81.4% 78.7% 50.0% 49.0% 49.5% 32.9% 2.986
gpt-5.5_v4_mini v1 2026-06-25 100 100 0.937 1.347 0.989 2.58e-97 0.063 42.4% 67.0% 72.7% 74.4% 95.2% 77.5% 71.4% 36.3% 35.1% 35.7% 21.7% 2.841
gpt-5.5_v4_mini_high v1 2026-06-28 100 100 0.892 2.395 0.985 1.38e-91 0.108 46.6% 70.0% 76.0% 77.8% 95.9% 79.1% 73.8% 41.0% 38.7% 39.8% 24.8% 2.990
gpt-5.5_v4_mini_medium v1 2026-06-27 100 100 0.898 2.083 0.985 1.31e-90 0.102 45.6% 69.2% 75.7% 77.3% 95.7% 78.6% 73.2% 40.8% 38.4% 39.6% 24.7% 2.846
gpt-5.5_v4_reasoning v1 2026-06-21 100 100 0.916 1.800 0.959 1.28e-69 0.084 55.5% 74.9% 80.2% 80.5% 96.5% 80.4% 77.7% 48.7% 47.2% 48.0% 31.5% 3.522
gpt-5.5_v4_reasoning_high v1 2026-06-24 100 100 0.942 1.665 0.989 1.30e-98 0.058 56.5% 76.2% 80.6% 80.6% 96.8% 81.1% 78.6% 47.5% 46.5% 47.0% 30.7% 2.695
gpt-5.5_v4_reasoning_medium v1 2026-06-23 100 100 0.934 1.773 0.985 1.55e-91 0.066 57.5% 76.6% 80.8% 81.3% 96.9% 81.2% 78.6% 47.5% 46.3% 46.9% 30.6% 2.919
gpt-5.6-sol v1 2026-07-14 100 100 0.998 3.126 0.974 1.50e-79 0.002 23.3% 51.8% 56.0% 57.7% 92.1% 71.6% 63.1% 18.7% 20.1% 19.4% 10.7% 4.295
gpt-5.6-sol v2 2026-07-14 100 100 0.925 2.075 0.988 1.19e-96 0.075 52.3% 72.9% 77.4% 77.4% 96.4% 80.6% 77.0% 42.7% 41.4% 42.0% 26.6% 2.711
gpt-5.6-sol v3 2026-07-14 100 100 0.925 2.557 0.985 2.53e-91 0.075 55.5% 75.4% 80.4% 80.4% 96.8% 81.4% 78.8% 47.0% 46.1% 46.6% 30.3% 3.006
legacy_scholarly v3 2026-05-07 100 100 0.926 1.967 0.986 4.54e-93 0.074 52.7% 73.3% 76.4% 78.0% 96.2% 79.7% 76.1% 42.6% 41.3% 41.9% 26.5% 2.765
paper_guidance_ablation_gpt56 v1 2026-07-18 100 100 0.919 2.272 0.987 1.42e-94 0.081 51.9% 72.7% 77.0% 77.6% 96.4% 80.4% 77.1% 42.7% 41.4% 42.0% 26.6% 2.790
paper_guidance_ablation_gpt56 v2 2026-07-18 100 100 0.909 2.955 0.983 2.24e-88 0.091 51.4% 72.4% 76.6% 77.3% 96.2% 80.0% 76.2% 41.7% 40.6% 41.1% 25.9% 3.072
paper_guidance_ablation_gpt56 v3 2026-07-18 100 100 0.947 1.719 0.989 1.20e-97 0.053 55.9% 75.6% 81.5% 80.8% 96.8% 81.2% 78.7% 47.8% 47.2% 47.5% 31.1% 2.719

Downloadable Tables

Generated by generate_translation_prompt_evaluation.py.