| Model A | Model B | W | L | T |
|---|---|---|---|---|
| FireRed-OCR | DeepSeek-OCR | 35 | 15 | 0 |
| FireRed-OCR | LightOnOCR-2-1B | 6 | 38 | 0 |
| FireRed-OCR | NuExtract3 | 15 | 35 | 0 |
| FireRed-OCR | dots.ocr | 49 | 1 | 0 |
| FireRed-OCR | GLM-OCR | 10 | 38 | 2 |
| DeepSeek-OCR | LightOnOCR-2-1B | 6 | 37 | 1 |
| DeepSeek-OCR | NuExtract3 | 15 | 35 | 0 |
| DeepSeek-OCR | dots.ocr | 47 | 3 | 0 |
| DeepSeek-OCR | GLM-OCR | 7 | 43 | 0 |
| LightOnOCR-2-1B | NuExtract3 | 20 | 24 | 0 |
| LightOnOCR-2-1B | dots.ocr | 44 | 0 | 0 |
| LightOnOCR-2-1B | GLM-OCR | 19 | 25 | 0 |
| NuExtract3 | dots.ocr | 45 | 5 | 0 |
| NuExtract3 | GLM-OCR | 23 | 27 | 0 |
| dots.ocr | GLM-OCR | 1 | 49 | 0 |
1 of 720
→
LightOnOCR-2-1B
$\text{X.205.2.}$
$\text{Engelofried, Britannica}$
$\text{19th edition. 1771: belonged}$
$\text{to my friend father, S. P. Sullivan}$
$\text{b. 1747 - died 1815: lives}$
$\text{his signature in Little Paris}$
$\text{W.D.}$
GLM-OCR
Englehoven and Bittmannen
first edition. 1770: belonged
to my grandfather Jan. Collection
begun 1747. died 1815: Index
his signature on Title Page
Judge: A
· You: tie
· soft disagree
"Output A correctly captures the visible text including the top-right identifier 'X.205.2.' and the handwritten note on the label, with reasonable accuracy despite some minor transcription ambiguities. Output B hallucinates entirely different content (e.g., 'Englehoven and Bittmannen', 'first edition', 'Jan. Collection') that does not appear in the image, violating the faithfulness criterion severely."
12 votes
·
92% agree