IAM dataset results
| Model | CER | WER | WER BoW |
|---|---|---|---|
| The Text Titan I | 9.13% | 23.38% | 17.88% |
| Gpt-4o-mini-2024-07-18 | 1.71% | 3.34% | 2.33% |
| Gpt-4o-2024-08-06 | 1.75% | 3.59% | 2.49% |
| Claude-3-5-sonnet-20240620 | 1.75% | 3.55% | 2.57% |
| MinicpmV-2 6 | 2.02% | 3.23% | 2.42% |
| Qwen2-VL-7B | 2.30% | 4.20% | 2.43% |
| Pixtral-12B | 2.92% | 5.39% | 3.54% |
| InternVL2-8B | 25.15% | 39.95% | 33.05% |
| Phi-3-mini-128k-instruct | 3.85% | 6.40% | 4.46% |
| Model | CER | WER | WER BoW |
|---|---|---|---|
| The Text Titan I | 9.13% | 23.38% | 17.88% |
| Gpt-4o-mini-2024-07-18 | |||
| Gpt-4o-2024-08-06 | 1.75% | 3.59% | 2.49% |
| Claude-3-5-sonnet-20240620 | 1.75% | 3.55% | 2.57% |
| MinicpmV-2 6 | 2.02% | 3.23% | 2.42% |
| Qwen2-VL-7B | 2.30% | 4.20% | 2.43% |
| Pixtral-12B | 2.92% | 5.39% | 3.54% |
| InternVL2-8B | 25.15% | 39.95% | 33.05% |
| Phi-3-mini-128k-instruct | 3.85% | 6.40% | 4.46% |