Table 4 Hyperparameter Settings of Our... | Emerald Publishing

Table 4

Hyperparameter Settings of Our System.

Module	Configuration item	Parameter
	Encoder layer	8
	Encoder heads	16
Transformer	Encoder dimension	512
	Decoder layer	8
	Decoder heads	16
	Decoder dimension	512
BERT	Layer	12
	Output dimension	768
MLP	Layer	2
	Output dimension	512
Training Detail	Epochs	20
	Batch size	8
	Learning rate	1e-7

Module	Configuration item	Parameter
	Encoder layer	8
	Encoder heads	16
Transformer	Encoder dimension	512
	Decoder layer	8
	Decoder heads	16
	Decoder dimension	512
BERT	Layer	12
	Output dimension	768
MLP	Layer	2
	Output dimension	512
Training Detail	Epochs	20
	Batch size	8
	Learning rate	1e-7