Table 7. Comparison of Spearman’s rank... | Emerald Publishing

Table 7.

Comparison of Spearman’s rank correlation on the proposed method without/with AT compared to the previous methods. The last four rows show our results.Supervised (S) and unsupervised (U) settings were evaluated on STS datasets

Methods	S/U	STS12	STS13	STS14	STS15	STS16	STSB	SICKR	Avg.
SBERT (Reimers and Gurevych, 2019)	S	70.97	76.53	73.19	79.09	74.30	77.03	72.91	74.89
SBERT-flow (Li et al., 2020a)	S	69.78	77.27	74.35	82.01	77.46	79.12	76.21	76.60
SBERT-whitening (Su et al., 2021)	S	69.65	77.57	74.66	82.27	78.39	79.52	76.91	77.00
BERT (Devlin et al., 2019)	U	39.70	59.38	49.67	66.03	66.19	53.87	62.06	56.70
CT-BERT (Carlsson et al., 2021)	U	61.63	76.80	68.47	77.50	76.48	74.31	69.19	72.05
ConSERT (Yan et al., 2021)	U	64.64	78.49	69.07	79.72	75.95	73.97	67.31	72.74
SG-BERT (Kim et al., 2021)	U	66.84	80.13	71.23	81.56	77.17	77.23	68.16	74.62
SimCSE (Gao et al., 2021)	U	68.40	82.41	74.38	80.91	78.56	76.85	72.23	76.25
SimCSE*	U	67.38	81.29	73.15	80.95	78.01	77.04	70.35	75.45
Ours (SimCSE, $p = 0.2$ ⁠)	U	68.79	80.83	73.38	81.60	78.92	78.20	72.89	76.37
Ours (SimCSE, $p_{w} = 0.1, p_{s} = 0.2$ ⁠)	U	70.30	80.97	73.33	82.05	79.35	78.88	71.69	76.65
Ours (SimCSE, $p_{w} = 0, p_{s} = 0.3$ ⁠)	U	70.19	81.97	73.96	81.72	79.24	78.28	71.81	76.74
Ours (AT, $p_{w} = 0, p_{s} = 0.3$ ⁠)	U	71.67	82.45	74.32	82.92	80.02	79.95	73.29	77.80

Methods	S/U	STS12	STS13	STS14	STS15	STS16	STSB	SICKR	Avg.
SBERT (Reimers and Gurevych, 2019)	S	70.97	76.53	73.19	79.09	74.30	77.03	72.91	74.89
SBERT-flow (Li et al., 2020a)	S	69.78	77.27	74.35	82.01	77.46	79.12	76.21	76.60
SBERT-whitening (Su et al., 2021)	S	69.65	77.57	74.66	82.27	78.39	79.52	76.91	77.00
BERT (Devlin et al., 2019)	U	39.70	59.38	49.67	66.03	66.19	53.87	62.06	56.70
CT-BERT (Carlsson et al., 2021)	U	61.63	76.80	68.47	77.50	76.48	74.31	69.19	72.05
ConSERT (Yan et al., 2021)	U	64.64	78.49	69.07	79.72	75.95	73.97	67.31	72.74
SG-BERT (Kim et al., 2021)	U	66.84	80.13	71.23	81.56	77.17	77.23	68.16	74.62
SimCSE (Gao et al., 2021)	U	68.40	82.41	74.38	80.91	78.56	76.85	72.23	76.25
SimCSE*	U	67.38	81.29	73.15	80.95	78.01	77.04	70.35	75.45
Ours (SimCSE, $p = 0.2$ )	U	68.79	80.83	73.38	81.60	78.92	78.20	72.89	76.37
Ours (SimCSE, $p_{w} = 0.1, p_{s} = 0.2$ )	U	70.30	80.97	73.33	82.05	79.35	78.88	71.69	76.65
Ours (SimCSE, $p_{w} = 0, p_{s} = 0.3$ )	U	70.19	81.97	73.96	81.72	79.24	78.28	71.81	76.74
Ours (AT, $p_{w} = 0, p_{s} = 0.3$ )	U	71.67	82.45	74.32	82.92	80.02	79.95	73.29	77.80