Our method for action recognition. With the features extracted by encoder f (·), we apply an action classifier C(·) for the downstream task.