Experimental results of various post-processing models and the proposed CREAM framework
| Method | High-error scenario | Low-error scenario | ||||||
|---|---|---|---|---|---|---|---|---|
| AISHELL-1 | TEDLIUM-2 | Libri-other | Libri-clean | AISHELL-1 | TEDLIUM-2 | Libri-other | Libri-clean | |
| N-best reranking method | ||||||||
| CLM | 6.80 | 10.61 | 9.99 | 3.64 | 6.55 | 8.92 | 7.05 | 2.84 |
| MLM (BERT) | 6.05 | 10.37 | 9.91 | 3.58 | 5.55 | 8.44 | 6.86 | 2.73 |
| RescoreBERT | 6.12 | 10.61 | 9.98 | 3.69 | 5.56 | 8.77 | 6.96 | 2.79 |
| PBERT | 5.89 | 10.35 | 9.97 | 3.63 | 5.35 | 8.51 | 6.81 | 2.74 |
| LLM-Reranking (ChatGPT 3.5) | 7.36 | 11.67 | 11.33 | 4.90 | 8.60 | 11.15 | 9.72 | 5.72 |
| Error correction model | ||||||||
| BART | 7.43 | 11.77 | 11.26 | 4.50 | 7.53 | 10.66 | 7.42 | 3.05 |
| FastCorrect | 6.72 | – | – | – | 6.81 | – | – | – |
| LLM-Correction (ChatGPT 3.5) | 7.71 | 13.95 | 12.77 | 6.07 | 7.40 | 14.02 | 10.70 | 6.01 |
| CREAM | ||||||||
| CREAM (BART) | 4.63 | 9.29 | 8.80 | 3.16 | 4.98 | 8.13 | 6.72 | 2.70 |
| CREAM (FastCorrect) | 4.73 | – | – | – | 4.73 | – | – | – |
| Method | High-error scenario | Low-error scenario | ||||||
|---|---|---|---|---|---|---|---|---|
| AISHELL-1 | TEDLIUM-2 | Libri-other | Libri-clean | AISHELL-1 | TEDLIUM-2 | Libri-other | Libri-clean | |
| 6.80 | 10.61 | 9.99 | 3.64 | 6.55 | 8.92 | 7.05 | 2.84 | |
| 6.05 | 10.37 | 9.91 | 3.58 | 5.55 | 8.44 | 6.86 | 2.73 | |
| RescoreBERT | 6.12 | 10.61 | 9.98 | 3.69 | 5.56 | 8.77 | 6.96 | 2.79 |
| 5.89 | 10.35 | 9.97 | 3.63 | 5.35 | 8.51 | 6.81 | 2.74 | |
| LLM-Reranking (ChatGPT 3.5) | 7.36 | 11.67 | 11.33 | 4.90 | 8.60 | 11.15 | 9.72 | 5.72 |
| 7.43 | 11.77 | 11.26 | 4.50 | 7.53 | 10.66 | 7.42 | 3.05 | |
| FastCorrect | 6.72 | – | – | – | 6.81 | – | – | – |
| LLM-Correction (ChatGPT 3.5) | 7.71 | 13.95 | 12.77 | 6.07 | 7.40 | 14.02 | 10.70 | 6.01 |
| 4.63 | 9.29 | 8.80 | 3.16 | 4.98 | 8.13 | 6.72 | 2.70 | |
| 4.73 | – | – | – | 4.73 | – | – | – | |
Sharing content requires targeting cookies to be enabled. Please update your cookie preferences to use this feature.