... introduces dynamic modality gate (DMG) and bimodal fusion transformer network to dynamically integrate multimodalities. Moreover, in order to enhance textual modality in videos, two types of textual context from the video are taken as the input of TCE-DBF. One is extracted from video frames in visual...

...-based spatial-temporal graph neural networks. A graph convolutional network is used to extract local spatial-temporal correlations, a channel attention mechanism is used to enhance the influence of nearby spatial-temporal dependencies on decision-making and a transformer mechanism is used to capture...