Emotion Expressiveness Test Results with 95% confidence interval: MUSHRA similarity scores, Mel-Cepstral Distortion (MCD), Pitch/Energy Distortion (Pitch/Energy), and Frame Disturbance (FD). The column “GT or Pred” indicates whether we use ground-truth hierarchical ED (“GT”) or a text-predicted version. In the “TTS Model” column, “VA” and “VA(Multi-Step)” denote the TTS models employing the Single-Step hierarchical ED Variance Adaptor (Figure 4(d)) and the Multi-Step hierarchical ED Variance Adaptor (Figure 4(b)), respectively. Finally, the “Pred Mode” column specifies whether we predict the hierarchical ED progressively from longer to shorter segments (Multi-Step) or in parallel for all segments (Single-Step)
| Hierarchical ED | Emotion Expressiveness | ||||||
|---|---|---|---|---|---|---|---|
| GT or Pred | TTS Model | Pred Mode | MUSHRA () | MCD () | Pitch () | Energy () | FD () |
| GT | External | – | 61.9 2.1 | 5.88 0.10 | 15.6 1.0 | 0.363 0.022 | 24.8 3.4 |
| GT | VA | – | 55.8 2.6 | 6.48 0.23 | 16.1 1.1 | 0.386 0.023 | 25.5 3.6 |
| GT | VA(Multi-Step) | – | 61.9 2.1 | 5.62 0.11 | 15.5 1.1 | 0.348 0.020 | 22.4 2.9 |
| Predicted | External | Single-Step | 47.2 2.3 | 7.59 0.14 | 18.2 1.1 | 0.438 0.027 | 46.3 6.5 |
| Predicted | External | Multi-Step | 51.9 2.2 | 6.89 0.12 | 16.9 1.2 | 0.409 0.024 | 42.6 4.7 |
| Predicted | VA | Single-Step | 48.2 2.5 | 7.23 0.20 | 16.7 1.0 | 0.426 0.025 | 41.4 4.7 |
| Predicted | VA(Multi-Step) | Multi-Step | 49.1 2.2 | 6.91 0.12 | 17.2 1.1 | 0.416 0.025 | 46.3 5.1 |
| Hierarchical | Emotion Expressiveness | ||||||
|---|---|---|---|---|---|---|---|
| Pred Mode | Pitch ( | Energy ( | |||||
| External | – | 5.88 | 15.6 | 0.363 | 24.8 | ||
| – | 55.8 | 6.48 | 16.1 | 0.386 | 25.5 | ||
| VA(Multi-Step) | – | 61.9 | |||||
| Predicted | External | Single-Step | 47.2 | 7.59 | 18.2 | 0.438 | 46.3 |
| Predicted | External | Multi-Step | |||||
| Predicted | Single-Step | 48.2 | 7.23 | 0.426 | |||
| Predicted | VA(Multi-Step) | Multi-Step | 17.2 | 46.3 | |||
Sharing content requires targeting cookies to be enabled. Please update your cookie preferences to use this feature.