Cross-validated accuracy and AUC scores achieved by BERT
| Variable | Accuracy | AUC |
|---|---|---|
| Signed with department | 0.96 | 0.91 |
| Signed with hotel | 0.99 | 0.95 |
| Signed by manager | 0.96 | 0.96 |
| Signed with name | 1 | 1 |
| Signed by staff | 0.98 | 0.93 |
| Tailoring | 0.90 | 0.88 |
| Explanation | 0.85 | 0.80 |
| Invitation for visit | 0.86 | 0.82 |
| Non-verbal cues | 0.98 | – |
| Defensivenessa | 0.93 | 0.94 |
| Variable | Accuracy | AUC |
|---|---|---|
| Signed with department | 0.96 | 0.91 |
| Signed with hotel | 0.99 | 0.95 |
| Signed by manager | 0.96 | 0.96 |
| Signed with name | 1 | 1 |
| Signed by staff | 0.98 | 0.93 |
| Tailoring | 0.90 | 0.88 |
| Explanation | 0.85 | 0.80 |
| Invitation for visit | 0.86 | 0.82 |
| Non-verbal cues | 0.98 | – |
| Defensivenessa | 0.93 | 0.94 |
Note(s): aFor the variable defensiveness, a balanced training set was used (same number of cases for each label)
Source(s): Developed by the authors
Sharing content requires targeting cookies to be enabled. Please update your cookie preferences to use this feature.