ICDAR2017 dataset results
| Model | CER | WER | WER BoW |
|---|---|---|---|
| The Text Titan I | 14.40% | 29.47% | 24.69% |
| Gpt-4o-mini-2024-07-18 | 58.94% | 82.08% | 70.68% |
| Gpt-4o-2024-08-06 | 60.98% | 76.64% | 70.35% |
| Claude-3-5-sonnet-20240620 | 41.19% | 60% | 51.69% |
| MinicpmV-2 6 | 71.16% | 92.95% | 89.95% |
| Qwen2-VL-7B | 58% | 81.55% | 72.53% |
| Pixtral-12B | 71.88% | 95.40% | 82.05% |
| InternVL2-8B | 81.82% | 99.65% | 97.80% |
| Phi-3-mini-128k-instruct | 85.46% | 97.40% | 95.88% |
| Model | CER | WER | WER BoW |
|---|---|---|---|
| The Text Titan I | |||
| Gpt-4o-mini-2024-07-18 | 58.94% | 82.08% | 70.68% |
| Gpt-4o-2024-08-06 | 60.98% | 76.64% | 70.35% |
| Claude-3-5-sonnet-20240620 | 41.19% | 60% | 51.69% |
| MinicpmV-2 6 | 71.16% | 92.95% | 89.95% |
| Qwen2-VL-7B | 58% | 81.55% | 72.53% |
| Pixtral-12B | 71.88% | 95.40% | 82.05% |
| InternVL2-8B | 81.82% | 99.65% | 97.80% |
| Phi-3-mini-128k-instruct | 85.46% | 97.40% | 95.88% |