一种无人机自主避障与目标追踪方法

针对无人机自主避障与目标追踪问题，以深度Q网络(DQN)算法为基础，提出一种多经验池深度Q网络(MP DQN)算法，使无人机避障与追踪的成功率和算法的收敛性得到优化。更进一步，赋予无人机环境感知能力，并在奖励函数中设计了方向奖惩函数，提升了无人机对环境的泛化能力以及算法的整体性能。仿真结果表明，相较于DQN和双重DQN(DDQN)算法，MP DQN算法具有更快的收敛速度、更短的追踪路径和更强的环境适应性。

A Method for Autonomous Obstacle Avoidance and Target Tracking of Unmanned Aerial Vehicle

Aiming at the problem of autonomous obstacle avoidance and target tracking of unmanned aerial vehicle (UAV), based on the Deep Q Network (DQN) algorithm, a Multiple Pools Deep Q Network (MP DQN) algorithm is proposed to optimize the success rate of UAV obstacle avoidance and target tracking and the convergence of the algorithm. Furthermore, the environmental perception ability of UAV is given, and the directional reward function is designed in the reward mechanism, which improves the generalization ability of the UAV to the environment and the overall performance of the algorithm. The simulation results show that, compared with DQN and Double Deep Q Network (DDQN) algorithms, MP DQN algorithm has faster convergence speed, shorter tracking path and stronger environmental adaptability.