Table 6. Out-of-sample validation after... | Emerald Publishing

Table 6.

Out-of-sample validation after random undersampling validation

Method	Accuracy	Specificity	Precision	Recall	F1-score	AUC
Panel A – Random undersampling: financial ratios as input variables (15 features) – Out of sample Validation
RF	0.83	0.82	0.73	0.86	0.79	0.92
GBT	0.84	0.85	0.64	0.82	0.72	0.92
DT	0.80	0.81	0.57	0.79	0.66	0.88
LR	0.51	0.26	0.42	0.95	0.58	0.60
SVM	0.45	0.17	0.39	0.94	0.55	N.A.
Panel B – Random undersampling: raw data of financial ratios as input variables (45 features) – Out of sample validation
RF	0.89	0.87	0.79	0.95	0.86	0.97
GBT	0.89	0.87	0.79	0.92	0.85	0.96
DT	0.86	0.85	0.76	0.88	0.82	0.94
LR	0.81	0.81	0.70	0.80	0.75	0.86
SVM	0.77	0.78	0.65	0.74	0.69	N.A.
Panel C – Random undersampling: raw data as input variables (215 features) – Out of sample validation
RF	0.88	0.79	0.79	0.99	0.88	0.99
GBT	0.97	0.97	0.80	0.97	0.88	0.99
DT	0.85	0.75	0.76	0.98	0.86	0.99
LR	0.92	0.93	0.62	0.90	0.73	0.96
SVM	0.92	0.93	0.62	0.88	0.72	N.A.

Method	Accuracy	Specificity	Precision	Recall	F1-score	AUC
Panel A – Random undersampling: financial ratios as input variables (15 features) – Out of sample Validation
RF	0.83	0.82	0.73	0.86	0.79	0.92
GBT	0.84	0.85	0.64	0.82	0.72	0.92
DT	0.80	0.81	0.57	0.79	0.66	0.88
LR	0.51	0.26	0.42	0.95	0.58	0.60
SVM	0.45	0.17	0.39	0.94	0.55	N.A.
Panel B – Random undersampling: raw data of financial ratios as input variables (45 features) – Out of sample validation
RF	0.89	0.87	0.79	0.95	0.86	0.97
GBT	0.89	0.87	0.79	0.92	0.85	0.96
DT	0.86	0.85	0.76	0.88	0.82	0.94
LR	0.81	0.81	0.70	0.80	0.75	0.86
SVM	0.77	0.78	0.65	0.74	0.69	N.A.
Panel C – Random undersampling: raw data as input variables (215 features) – Out of sample validation
RF	0.88	0.79	0.79	0.99	0.88	0.99
GBT	0.97	0.97	0.80	0.97	0.88	0.99
DT	0.85	0.75	0.76	0.98	0.86	0.99
LR	0.92	0.93	0.62	0.90	0.73	0.96
SVM	0.92	0.93	0.62	0.88	0.72	N.A.