基于深度强化学习的无人机栖落机动控制策略设计

无人机栖落机动飞行是一种无需跑道的降落方法,能够提升无人机在复杂环境下执行任务的适应能力。针对具有高非线性、多约束特性的无人机栖落机动过程,提出了一种基于模仿深度强化学习的控制策略设计方法。首先,建立了固定翼无人机栖落机动的纵向非线性动力学模型,并设计了无人机栖落机动的强化学习环境。其次,针对栖落机动状态动作空间大的特点,为了提高探索效率,通过模仿专家经验的方法对系统进行预训练。然后,以模仿学习得到的权重为基础,采用近端策略优化方法学习构建无人机栖落机动的神经网络控制器。最后,通过仿真验证了上述控制策略设计方法的有效性。     

基于隶属度和LMK-ELM的航空电子部件诊断方法

为提高航空电子部件模块级故障诊断精度，提出一种新的面向"软聚类"的局部多核学习（LMKL）-超限学习机（ELM）离线诊断方法。通过引入模糊C均值聚类对样本空间进行模糊划分，挖掘聚类内部多样性的同时，实现了对过学习的抑制；将模糊划分产生的隶属度信息融入LMKL-ELM的优化过程，运用基于初始-对偶混合优化问题的三步优化策略克服了局部核权重二次非凸的问题，在l₁-范数与l₂-范数约束下分别给出了相应的更新方法。将所提方法应用于某型机前端接收机，结果表明：与4种流行的多核诊断方法相比，该方法可有效避免漏警、抑制虚警，在l₁-范数和l₂-范数约束下，其诊断精度比其他方法的平均值分别提升了4.09%和5.13%。     

Gravity waves generated by thunderstorms: South-East Asia tropical region study

Gravity waves are recognized as an integral part of earth’s atmosphere which are mainly responsible for energy and momentum distribution among different layers and regions in the atmosphere. Various sources present in land, ocean, and atmosphere such as mountains, convection, jets and fronts etc. are responsible for gravity waves generation. Thunderstorms (deep convection) are one of the major sources of gravity waves in the tropical region, capable of generating waves with a wide range of frequencies and scales and significantly affecting the existing waves. Previous numerical studies have characterised the wave properties that are generated from thunderstorms, but there are no statistically quantified studies. In this paper, we have modelled the relationship between the latent heat generated inside a thunderstorm and the gravity wave properties at the geo-collocated points. Gravity waves are identified over Singapore radiosonde station (with data available until 30?km altitude with 12?h temporal resolution) in the stratosphere using wavelet studies. Based on the GROGRAT ray tracing methods to identify the thunderstorm locations, and RAMS cloud-resolving models simulations to obtain the latent heating of the thunderstorm, a regression analysis is performed using 200 cases of gravity waves. Furthermore, cloud-top momentum flux analysis is performed for various cases latent heat. This study is expected to provide more quantified and concrete information on the coupling between the thunderstorm and gravity wave which includes the variance in these relationships due to wave frequency spectrum and generation mechanisms.     

Advanced ensemble modeling method for space object state prediction accounting for uncertainty in atmospheric density

For objects in the low Earth orbit region, uncertainty in atmospheric density estimation is an important source of orbit prediction error, which is critical for space traffic management activities such as the satellite conjunction analysis. This paper investigates the evolution of orbit error distribution in the presence of atmospheric density uncertainties, which are modeled using probabilistic machine learning techniques. The recently proposed “HASDM-ML,” “CHAMP-ML,” and “MSIS-UQ” machine learning models for density estimation (Licata and Mehta, 2022b; Licata et al., 2022b) are used in this work. The investigation is convoluted because of the spatial and temporal correlation of the atmospheric density values. We develop several Monte Carlo methods, each capturing a different spatiotemporal density correlation, to study the effects of density uncertainty on orbit uncertainty propagation. However, Monte Carlo analysis is computationally expensive, so a faster method based on the Kalman filtering technique for orbit uncertainty propagation is also explored. It is difficult to translate the uncertainty in atmospheric density to the uncertainty in orbital states under a standard extended Kalman filter or unscented Kalman filter framework. This work uses the so-called “consider covariance sigma point (CCSP)” filter that can account for the density uncertainties during orbit propagation. As a test-bed for validation purposes, a comparison between CCSP and Monte Carlo methods of orbit uncertainty propagation is carried out. Finally, using the HASDM-ML, CHAMP-ML, and MSIS-UQ density models, we propose an ensemble approach for orbit uncertainty quantification for four different space weather conditions.     

An ensemble deep learning based shoreline segmentation approach (WaterNet) from Landsat 8 OLI images

Shorelines constantly vary due to natural, urbanization and anthropogenic effects such as global warming, population growth, and environmental pollution. Sustainable monitoring of coastal changes is vital in terms of coastal resource management, environmental preservation and planning. Publicly available Landsat 8 OLI (Operational Land Manager) images provide accurate, reliable, temporal and up-to-date information about coastal areas. Recently, the use of machine learning and deep learning algorithms have become widespread. In this study, we used our public Landsat 8 OLI satellite image dataset to create a majority voting method which is an ensemble automatic shoreline segmentation system (WaterNet) to obtain shorelines automatically. For this purpose, different deep learning architectures have been utilized namely as Standard U-Net, Dilated U-Net, Fractal U-Net, FC-DenseNet, and Pix2Pix. Also, we have suggested a novel framework to create labeling data from OpenStreetMap service to create a unique dataset called YTU-WaterNet. According to the results, IoU and F1 scores have been calculated as 99.59% and 99.79% for the WaterNet. The results indicate that the WaterNet method outperforms other methods in terms of shoreline extraction from Landsat 8 OLI satellite images.     

基于机器学习的导弹干扰试验效果评估实证研究

针对复杂电磁环境下导弹干扰试验影响因素众多,难以量化,试验数据采集困难以及实验数据中普遍存在类不平衡等问题,基于机器学习创建导弹试验干扰效果评估模型,采用随机森林、支持向量机、朴素贝叶斯、多层感知机等常见模型对导弹试验干扰效果进行评估。特别针对小数据样本中的类不平衡问题提出 2阶段分类模型,采用过采样方式解决类不平衡问题并采用随机森林进行分类。基于开源的导弹干扰效果评估数据,通过实证研究说明,基于过采样的随机森林模型在干扰效果评估问题中具有较强的泛化能力和鲁棒性,在 AUC指标上,该模型比多层感知机模型在中位数上最多提高 60%,建议在后续的试验中采用该模型进行导弹干扰效果评估。     

测量数据部分丢失的非线性系统迭代学习控制

研究非线性离散系统的迭代学习控制．利用并行分配补偿方法(PDC)确定非线性系统的T-S模型,把非线性模型特换为局部线性模型。假定数据丢失的概率已知,采用满足Bernoulli分布的序列来描述测量数据的丢失,研究具有测量数据部分丢失的线性离散系统的迭代学习控制器的设计。结合T-S模型设计了数据丢失的迭代学习控制器,所设计的迭代学习控制器具有期望收敛特性和二次型性能指标。仿真结果表明了该设计方法的有效性。     

自主空战连续决策方法

未来空战正朝着无人化、自主化方向发展,自主空战决策方法是未来空战的重要支撑手段之一。传统空战决策方法由于维度限制,存在无法处理连续动作与远视决策的问题。基于Actor-Critic 方法提出空战连续决策的统一架构,依据空战训练经验对状态空间、动作空间、奖励及训练科目进行合理设计,测试多种连续动作空间强化学习算法在高不确定性空战场景下的学习效果并进行可视化验证。结果表明：基于本文提出的方法架构,可以实现连续动作下的远视价值寻优,智能体可以在复杂空战态势下做出最优决策,对随机机动飞行目标有较高的击杀率,且空战机动轨迹具有较高的合理性。     

星座碰撞规避的迭代学习构型保持方法CSCD

针对低轨卫星星座运行中地球引力摄动的周期特性,基于迭代学习控制(ILC)方法,提出了星座碰撞规避的迭代学习构型保持方法。该方法由反馈控制和ILC两部分构成,分别抑制卫星运行过程中的非周期摄动和周期摄动对构型保持精度的影响,进而在地球非球形引力摄动未知条件下,通过相对构型的精确保持实现对星座卫星碰撞的有效规避。仿真结果表明,在地球J摄动影响下,与传统反馈控制相比,ILC方法以更小的控制输入实现了轨道保持精度的显著提升,进而在星座卫星轨道高度相近的情形下显著降低了碰撞风险,且控制器可在保证收敛性能的前提下,实现启动时间的灵活选择。     

深空探测中利用静止轨道卫星编队连续导航精度分析

针对我国难以全天候24小时对探测器连续测控和通信，以及建立全球性深空网络困难的问题，提出利用地球静止轨道卫星编队进行深空导航的构想。两个静止轨道卫星编队相距一定角度，可以完成对深空探测器进行全天候连续导航定位。卫星编队采用无源反向导航的方法，多颗卫星协同工作，共同完成导航任务。分析表明该天基导航系统的几何参数精度因子受时间测量误差均方差和基线长度变化影响较大。编队的构型对定位精度有很大影响，其中基线长度不能过小，时间测量误差均方差不能过大，否则定位误差会急剧增加，伴随卫星椭圆轨道偏心率也存在一定界限。增加伴随卫星数量也有利于提高系统的定位精度。