Study on the resolution of multi-aircraft flight conflicts based on an IDQN

With the rapid growth of flight flow, the workload of controllers is increasing daily, and handling flight conflicts is the main workload. Therefore, it is necessary to provide more efficient conflict resolution decision-making support for controllers. Due to the limitations of existing methods, they have not been widely used. In this paper, a Deep Reinforcement Learning(DRL) algorithm is proposed to resolve multi-aircraft flight conflict with high solving efficiency. First, the characteristics ...     

机场终端区容流调配鲁棒优化模型

为解决机场不确定容量条件下的航班进离场流量分配问题,以容流调配策略在各情景下的规划外延误损失或多余延误损失的均值与标准差之和最小为目标,建立了终端区容流调配鲁棒优化模型;采用捕食搜索算法求解模型,以国内某机场终端区运行数据为例进行仿真验证,并与经典终端区容流调配模型进行比较,结果表明,鲁棒优化模型较好地实现了容流调配的鲁棒性,有效减少了不同情景下进离场航班延误的扰动。     

基于航路耦合容量的协同多航路资源分配

针对中国当前航路空域拥挤日益严重的问题,分3个步骤进行解决:第1步,对空域管制单元之间存在的交通流耦合因素进行分析,建立基于空域管制单元耦合因素的航路容量模型;第2步,为反映不同类型航班对计划到达时间变动范围的不同接受程度,定义了航班的延误成本函数和改航成本函数;第3步,在上述两步的基础上,为充分利用可行的航路空域资源...     

大型航空运输企业航班恢复系统(RM)应用研究

随着航空公司机队规模和运营航线的不断扩大,在发生大面积航班延误时,航空公司需要快速计算出最优的航班恢复方案。为了提高运行控制效率,探索一种优化控制的方法,根据经济效益、航班正常等不同的目标要求,计算出最优的运行方案,最终达到快速、高效地调配航班。分析了大型航空运输企业不正常航班恢复的主要场景,在此基础上筛选了制约航班恢复的关键约束条件,设计了航班恢复和校验的基本逻辑,通过应对台风处置的实际案例,验证了某大型航司和美国世博公司的航班恢复系统(RM)在实际案例应用中的效果,总结了该航班恢复系统的优点和存在的风险及短板。实践表明,该系统可缩短2 h航班运行恢复时间,平均每个受影响航班减少延误30 min,减少相应的成本2万元,提升整体航班正常率3%~5%。     

基于空中交通密度的进场航班动态协同排序方法

为适应协同决策（CDM）需要，考虑空管、航空公司和机场的诉求，对进场航班动态协同排序问题进行了系统的研究。设计了一种进场航班动态排序方法，提出了一种时隙交换方法，建立了基于空中交通密度的进场航班协同排序模型，设计了精英保留的遗传算法和带精英策略的快速非支配排序遗传算法以求解所建模型，寻求进场航班动态协同排序的最优解。仿真结果表明，较基于滚动时域控制（RHC）方法，动态协同方法所得结果与排序开始时间无关，所需排序次数平均减少26.4%，且排序效率更高。较先到先服务（FCFS）方法，动态协同方法在高密度条件下各排序阶段最后一个进场航班的落地时间平均提前199.8 s；中密度条件下各排序阶段航班延误总时间平均减少29.9%，航班延误均衡性平均提高34.4%；低密度条件在航班正常率及航班延误公平性得到保证的前提下，满足时隙交换规则的排序阶段均增加了1种进场航班排序模式。所提方法可对进场航班进行优化排序，显著提高跑道容量，有效提升航班延误均衡性和航班延误公平性，契合协同决策理念，可实现三方协同排序。     

多跑道航班进离场动态调度模型与算法

针对民航运输快速发展导致的航班延误频增现象,研究了多跑道航班进离场的动态调度问题。研究时段内航班的总延误成本最小和延误时间均衡为目标,综合考虑根据机型确定的航班进离场调度优先权和管制员负荷,建立多跑道航班进离场调度模型,利用遗传算法对模型进行仿真验证。仿真结果与先到先服务(FCFS)调度方式进行比较,采用遗传算法的航班进离场调度比FCFS的延误成本降低了45.07%,延误时间降低了37.90%,同时有效地均衡了航空公司的延误时间,保障了航空公司的公平性并提高了跑道系统容量,降低了管制员负荷。通过仿真验证了多跑道航班进离场动态调度策略具有较强的优势和可行性。     

考虑优先级的交叉口航班汇聚排序问题研究

为了有效地利用航路资源,减少飞行延误总成本,建立了改进的航路交叉口汇聚排序模型。为加快求解速度,分析了影响航班延误成本的因素,给出了权重赋值表,改进了现有算法,并用FCFS算法与改进算法进行了算例分析。仿真结果表明,改进算法通过对交叉口航班各属性赋权值可有效进行优先等级划分,完成时隙分配和航班排序的快速计算。采用改进给出的优化排序策略可减少延误飞行的总成本,具有一定的实用性。     

Imaginary filtered hindsight experience replay for UAV tracking dynamic targets in large-scale unknown environments

As an advanced combat weapon, Unmanned Aerial Vehicles (UAVs) have been widely used in military wars. In this paper, we formulated the Autonomous Navigation Control (ANC) problem of UAVs as a Markov Decision Process (MDP) and proposed a novel Deep Reinforcement Learning (DRL) method to allow UAVs to perform dynamic target tracking tasks in large-scale unknown environments. To solve the problem of limited training experience, the proposed Imaginary Filtered Hindsight Experience Replay (IFHER) generates successful episodes by reasonably imagining the target trajectory in the failed episode to augment the experiences. The well-designed goal, episode, and quality filtering strategies ensure that only high-quality augmented experiences can be stored, while the sampling filtering strategy of IFHER ensures that these stored augmented experiences can be fully learned according to their high priorities. By training in a complex environment constructed based on the parameters of a real UAV, the proposed IFHER algorithm improves the convergence speed by 28.99% and the convergence result by 11.57% compared to the state-of-the-art Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm. The testing experiments carried out in environments with different complexities demonstrate the strong robustness and generalization ability of the IFHER agent. Moreover, the flight trajectory of the IFHER agent shows the superiority of the learned policy and the practical application value of the algorithm.     

Improving multi-target cooperative tracking guidance for UAV swarms using multi-agent reinforcement learning

Multi-Target Tracking Guidance(MTTG) in unknown environments has great potential values in applications for Unmanned Aerial Vehicle(UAV) swarms. Although Multi-Agent Deep Reinforcement Learning(MADRL) is a promising technique for learning cooperation, most of the existing methods cannot scale well to decentralized UAV swarms due to their computational complexity or global information requirement. This paper proposes a decentralized MADRL method using the maximum reciprocal reward to learn cooper...     

机场终端区跑道配置优化及容流调配模型研究

大型繁忙机场交通需求的持续增长导致的飞行流量与保障能力、机场容量之间的矛盾日益突出。为了充分利用跑道系统资源,合理配置跑道运行容量,优化飞行流,建立非线性0-1整数规划模型解决以下两个问题:确定跑道配置优化序列,匹配进离场飞机流。模型综合考虑机场交通流、跑道配置转换容量折损、跑道容量包络线等约束,以优化区间内航班总延误最小为目标,用LINGO建模求解,使用实际运行数据验证模型的有效性。结果表明,模型实现了跑道资源的优化利用,降低了航班延误。     

不确定性因素下航班延误波及建模与分析

针对机场终端区日益严重的航班延误,提出了一种基于有色－时间Petri网的不确定性因素下航班延误波及分析模型。模型综合考虑航班运行尾流、跑道运行模式、跑道占用时间等运行安全间隔约束,同时根据连续航班间的信息更新,设计进离场航班序列动态调整流程,并由计算模型可得出航班延误总架次及时间。最后,依据历史延误数据分析得出不确定性因素延误的概率分布。选取上海浦东机场为背景对模型进行仿真验证,仿真结果表明,所构建模型可用于战略阶段的航班延误波及程度与过程的评估。     

多元受限下离场时间多目标优化调配模型研究

在空中交通受到多元限制情况下,对航班离场时间的优化调配可以解决空域拥挤,减少航班总体延误成本。采用了基于航班流的公平性指标和基于个体航班延误成本的效率指标作为模型的优化目标,建立了离场时间多目标优化调配模型。通过仿真算例对比了只考虑效率目标的离场时间单目标优化调配模型和同时考虑效率和公平性目标的离场时间多目标优化调配模型,验证了离场时间多目标优化调配模型的有效性。     

基于贝叶斯网络的航班延误传播分析

 由于机场航班之间存在前后衔接关系,每个航班的延误会波及到下游机场及其航班,因此需要一种有效手段来分析航班衔接时的延误传播。贝叶斯网络（BN）是一种有效的传播分析方法,从某个枢纽机场航班延误出发,对其关联机场的衔接航班的延误影响进行分析,提出了基于BN的航班延误传播模型。结合某航空公司实际数据,通过最大期望值算法对模型进行训练,给出了测试结果。实验表明,所提出的方法能有效地分析航班延误从局部到全局的传播。     

Energy-optimal trajectory planning for solar-powered aircraft using soft actor-critic

High-Altitude Long-Endurance (HALE) solar-powered Unmanned Aircraft Vehicles (UAVs) can utilize solar energy as power source and maintain extremely long cruise endurance, which has attracted extensive attentions from researchers. Trajectory optimization is a promising way to achieve superior flight time because of the finite solar energy absorbed in a day. In this work, a method of trajectory optimization and guidance for HALE solar-powered aircraft based on a Reinforcement Learning (RL) framework is introduced. According to flight and environment information, a neural network controller outputs commands of thrust, attack angle, and bank angle to realize an autonomous flight based on energy maximization. The validity of the proposed method was evaluated in a 5-km radius area in simulation, and results have shown that after one day-night cycle, the battery energy of the RL-controller was improved by 31% and 17% compared with those of a Steady-State (SS) strategy with a constant speed and a constant altitude and a kind of state-machine strategy, respectively. In addition, results of an uninterrupted flight test have shown that the endurance of the RL controller was longer than those of the control cases.     

基于二进制粒子群算法的战时航空网络规划研究

领空作为国家资源的一部分,其使用、调配关系到国家的安全与发展,在战时,将更多的空中资源调配给军航使用,有利于保障军事行动的顺利进行。基于此,提出一种基于二进制粒子群算法(BPSO)的战时航空网络规划方法。首先,对航空网络建模,收集航班数据;其次,建立航空网络性能评价体系;然后,以使用尽可能少的民航机场维持预期网络性能为目标,以作战意图和战场环境为约束条件,通过BPSO 算法进行求解;最后,进行仿真分析。结果表明:该方法能够结合作战意图、反映战场环境、合理调配航空资源,为战时航空管制工作提供决策依据。     

基于熵权法改进的航班延误影响因素评估研究

随着航空运输业的不断发展,航班延误问题越来越受到重视,已成为社会的热点问题.通过实际运行的相关统计数据,研究影响航班延误的各项因素,提取主要因子,构建航班延误综合评价指标体系.用熵权法对航班延误的各项影响因子进行客观评价,建立了基于熵权法改进航班延误影响因素的综合评估模型,并利用1 000架次航班实例对模型的有效性进行了验证,研究结果表明评估模型客观、准确、有效.     

基于模仿强化学习的固定翼飞机姿态控制器

研究了基于模仿强化学习的飞机姿态控制器。首先,建立专家经验数据集,并利用行为克隆对控制网络参数初始化;而后,控制网络利用强化学习和监督学习混合模式训练,通过奖励函数塑形和经验数据集监督学习引导强化学习算法快速收敛,使姿态控制器姿态响应优化的同时符合专家经验。控制网络输入为飞机姿态角误差、角速度等状态变量,输出控制增稳系统指令。实验表明,模仿强化学习控制器能够实现不同初始条件下飞机姿态角快速响应并与经验数据相符。     

Effective control allocation using hierarchical multi-objective optimization for multi-phase flight

For different flight phases in an overall flight mission, different control and allocation preferences should be pursued considering lift, drag or maneuverability characteristics. The multi-objective flight control allocation problem for a multi-phase flight mission is studied. For an overall flight mission, different flight phases namely climbing, cruise, maneuver and gliding phases are defined. Firstly, a multi-objective control allocation problem considering drag, lift or control energy preference is constructed. Secondly, considering different control preferences at different flight phases, the analytic hierarchical process method is used to construct a comprehensive performance index from different objectives such as lift or drag preferences. The active set based dynamic programming optimization method is used to solve the real-time optimization problem. For the validation, the Innovative Control Effector (ICE) tailless aircraft nonlinear model and the angular acceleration measurements based adaptive Incremental Backstepping (IBKS) are used to construct the validation platform. Finally, an overall flight mission is simulated to demonstrate the efficiency of the proposed multi-phase and multi-objective flight control allocation method. The results show that the comprehensive performance index for different phases, which are determined from the Analytic Hierarchy Process (AHP) method, can suitably satisfy the preference requirements for different flight phases.     

A geographical and operational deep graph convolutional approach for flight delay prediction

Flight delay prediction has attracted great interest in civil aviation community due to its significant role in airline planning, flight scheduling, airport operation, and passenger service. Flight delay is affected by numerous factors and irregularly propagates in air transportation networks owing to flight connectivity, which brings critical challenges to accurate flight delay prediction. In recent years, Graph Convolutional Networks (GCNs) have become popular in flight delay prediction due to the advantage in extracting complicated relationships. However, most of the existing GCN-based methods have failed to effectively capture the spatial–temporal information in flight delay prediction. In this paper, a Geographical and Operational Graph Convolutional Network (GOGCN) is proposed for multi-airport flight delay prediction. The GOGCN is a GCN-based spatial–temporal model that improves node feature representation ability with geographical and operational spatial–temporal interactions in a graph. Specifically, an operational aggregator is designed to extract global operational information based on the graph structure, while a geographical aggregator is developed to capture the similar nature among spatially close airports. Extensive experiments on a real-world dataset demonstrate that the proposed approach outperforms the state-of-the-art methods with a satisfying accuracy improvement.     

效益和公平性的多跑道航班调度精确算法研究

机场终端区航班拥堵延误现象日趋严重.机场管理者,一方面要减少航班总延迟成本,另一方面也要维持航空公司间竞争公平性.为多跑道航班协同调度问题建立双目标规划模型,为了精确求解优化问题的Pareto前沿,开发出epsilon约束算法.最后通过算例来说明模型的可行性和算法的有效性.利用数学规划理论建模并开发精确求解算法,为机场资源优化研究提供重要参考.