IAM dataset results
| Model | CER | WER | WER BoW |
|---|---|---|---|
| Gpt-4o-mini-2024-07-18 | 1.74% | 2.86% | 1.86% |
| Gpt-4o-2024-08-06 | 1.39% | 3.46% | 2.48% |
| Claude-3-5-sonnet-20240620 | 8.55% | 10.28% | 5.62% |
| MinicpmV-2 6 | 2.02% | 3.27% | 2.34% |
| Qwen2-VL-7B | 5.06% | 9% | 3.60% |
| Pixtral-12B | 10.03% | 12.04% | 6.94% |
| InternVL2-8B | 24.74% | 39.11% | 32.82% |
| Phi-3-mini-128k-instruct | 3.66% | 7.09% | 5.08% |
| Model | CER | WER | WER BoW |
|---|---|---|---|
| Gpt-4o-mini-2024-07-18 | 1.74% | ||
| Gpt-4o-2024-08-06 | 3.46% | 2.48% | |
| Claude-3-5-sonnet-20240620 | 8.55% | 10.28% | 5.62% |
| MinicpmV-2 6 | 2.02% | 3.27% | 2.34% |
| Qwen2-VL-7B | 5.06% | 9% | 3.60% |
| Pixtral-12B | 10.03% | 12.04% | 6.94% |
| InternVL2-8B | 24.74% | 39.11% | 32.82% |
| Phi-3-mini-128k-instruct | 3.66% | 7.09% | 5.08% |