基于改进DQN的复合模式在轨服务资源分配

针对开展在轨服务前的资源分配非线性多目标优化问题，构建复合服务模式下的在轨资源分配模型，基于对DQN （Deep Q-Network）方法的收敛性和稳定性改进，提出了一种在轨服务资源分配方法。该方法能够应对同时包含"一对多""多对一"的复合服务模式，并在满足预期成功率的前提下优先分配重要服务对象，兼顾资源分配综合效益和总体能耗效率，达到了以期望成功率、较少资源投入尽快完成任务的综合目标。仿真实验表明，改进DQN方法能够在任务执行前依据服务对象重要程度自主分配航天器资源，收敛速度快、训练误差低，在分配效益和总体能耗的优化方面具有明显的比较优势。

Allocation of composite mode on-orbit service resource based on improved DQN

In order to solve the nonlinear multi-objective optimization before on-orbit service, an on-orbit service resource allocation model under the composite service mode is constructed, and an on-orbit service resource allocation method based on Deep Q Network (DQN) convergence and stability improvement was proposed. This approach can cope with a composite service pattern which includes "one to many" and "many to one". This method can prioritize the allocation of important service objects on the premise of satisfying the expected success rate, and at the same time, take into account the comprehensive benefit of resource allocation and the overall energy consumption efficiency, achieving the comprehensive goal of completing the task efficiently and with the expected success rate and less resource input. Simulation results show that improved DQN method can independently allocate spacecraft resources based on the importance of service objects. This method has the advantages of fast convergence, low training error, and obvious comparative advantages in the optimization of distribution benefits and overall energy consumption.