Table 4. Ablation study on the proposed...

Table 4.

Ablation study on the proposed self-supervised adversarial training, which is integrated by cross entropy reformulation in equation (10), adversarial training in equation (15), augmentation alignment in equation (15) and adversarial invariant regularization (AIR) in Xu et al. (2023b) where CIFAR-10 was used

Methods	CE reform.	AT	Aug align.	AIR	RA	SA
SimCLR baseline	$\times$	$\times$	$\times$	$\times$	0.03	91.77
+ AT (RoCL)	$\times$	✓	$\times$	$\times$	39.93	78.37
+ CE reformulation	✓	$\times$	$\times$	$\times$	40.98	77.42
+ CE + AT (ours (15))	✓	✓	$\times$	$\times$	48.35	76.34
+ CE + AT + aug alignment	✓	✓	✓	$\times$	51.15	76.90
+ CE + AT + aug alignment + AIR	✓	✓	✓	✓	53.05	77.21

Methods	CE reform.	AT	Aug align.	AIR	RA	SA
SimCLR baseline	$\times$	$\times$	$\times$	$\times$	0.03	91.77
+ AT (RoCL)	$\times$	✓	$\times$	$\times$	39.93	78.37
+ CE reformulation	✓	$\times$	$\times$	$\times$	40.98	77.42
+ CE + AT (ours (15))	✓	✓	$\times$	$\times$	48.35	76.34
+ CE + AT + aug alignment	✓	✓	✓	$\times$	51.15	76.90
+ CE + AT + aug alignment + AIR	✓	✓	✓	✓	53.05	77.21

[ViewLarge]

Sharing Unavailable