... space, action space, reward function and neural network structure of DRL were designed based on the AS's manoeuvring characteristics and control requirements. A deep deterministic policy gradient (DDPG) algorithm was then used to implement the controller. Finally, some representative route segments...