READ dataset results
| Model | CER | WER | WER BoW |
|---|---|---|---|
| The Text Titan I | 40.63% | 64.28% | 61.29% |
| Gpt-4o-mini-2024-07-18 | 78.51% | 98.27% | 95.77% |
| Gpt-4o-2024-08-06 | 80.20% | 98.08% | 95.46% |
| Claude-3-5-sonnet-20240620 | 71.17% | 95.39% | 92.01% |
| MinicpmV-2 6 | 81.33% | 99.39% | 98.84% |
| Qwen2-VL-7B | 76.37% | 97.91% | 96.84% |
| Pixtral-12B | 77.88% | 99.48% | 98.20% |
| InternVL2-8B | 81.62% | 99.76% | 99.08% |
| Phi-3-mini-128k-instruct | 92.32% | 99.95% | 99.71% |
| Model | CER | WER | WER BoW |
|---|---|---|---|
| The Text Titan I | |||
| Gpt-4o-mini-2024-07-18 | 78.51% | 98.27% | 95.77% |
| Gpt-4o-2024-08-06 | 80.20% | 98.08% | 95.46% |
| Claude-3-5-sonnet-20240620 | 71.17% | 95.39% | 92.01% |
| MinicpmV-2 6 | 81.33% | 99.39% | 98.84% |
| Qwen2-VL-7B | 76.37% | 97.91% | 96.84% |
| Pixtral-12B | 77.88% | 99.48% | 98.20% |
| InternVL2-8B | 81.62% | 99.76% | 99.08% |
| Phi-3-mini-128k-instruct | 92.32% | 99.95% | 99.71% |