Continual learning fault diagnosis:A dual-branch adaptive aggregation residual network for fault diagnosis with machine increments

As a data-driven approach, Deep Learning(DL)-based fault diagnosis methods need to collect the relatively comprehensive data on machine fault types to achieve satisfactory performance. A mechanical system may include multiple submachines in the real-world. During condition monitoring of a mechanical system, fault data are distributed in a continuous flow of constantly generated information and new faults will inevitably occur in unconsidered submachines, which are also called machine increments....     

攻击角度约束下的分布式强化学习制导方法

为提高导弹在攻击角度约束下对目标的打击效能，提出了一种基于深度确定性策略梯度算法的分布式强化学习制导策略。为了最大限度地减小攻击角度误差，设计了一种新的奖励函数，使导弹在满足视场角约束的同时，视线角向期望值收敛。此外，为了增强强化学习模型的泛化能力，提出了一种分布式探索策略，提高了模型训练过程中对环境的探索效率。仿真结果验证了所提出的分布式强化学习制导方法能够在固定攻击角度约束下实现对目标的精准打击。与传统制导律相比，所提制导方法的攻击角度误差更小，收敛速度更快。     

基于深度学习光流法的荧光油膜全局速度测量

针对基于先验的传统光流法存在前提条件苛刻的问题，提出使用基于深度学习的光流法进行荧光油膜全局速度测量。采用数值仿真试验对基于先验的改进HS光流法和基于深度学习的FlowNet2光流法进行对比，结果显示：在不外加干扰时，改进HS光流法和FlowNet2光流法的平均端点误差分别为0.458 7像素/s和0.381 7像素/s；在亮度变化、噪声干扰或不同的演化时间下，FlowNet2光流法的平均端点误差均明显低于改进HS光流法，平均端点误差差值最大可达5.19像素/s；风洞试验进一步证明，FlowNet2光流法能够获得正确、清晰、定量的荧光油膜全局速度场，较改进HS光流法鲁棒性更高，对风洞工程应用具有一定的参考价值。     

迭代学习方法在PID控制器参数自动调节中的应用及收敛性分析

针对PID控制器参数在具有不确定项或输出干扰项的非线性时变系统中的调节困难,提出了应用迭代学习方法整定PID控制器参数的方法,利用系统的跟踪误差信息自动整定控制器参数,通过理论分析得到此设计方法收敛的充分条件。此方法设计简单且具有普遍性,仿真结果验证了此设计方法的有效性。     

边缘网络下多无人机协同计算和资源分配联合优化策略

针对边缘网络环境下多人机之间存在计算负载不均，造成卸载任务失败的问题，提出了一种多无人机间协作的智能任务卸载方案。通过联合考虑多无人机任务分配、计算资源分配和无人机飞行轨迹，引入公平性指数建立了无人机公平负载最大化和能量消耗最小化问题。基于多智能体深度强化学习框架，提出了融合轨迹规划和任务卸载的分布式算法。仿真结果表明，所提出的多无人机协作方案可以显著提高任务完成率和负载公平度，并且有效适用于大规模用户设备场景。     

Multi-agent Q-Learning control of spacecraft formation flying reconfiguration trajectories

This paper presents a novel approach based on multi-agent reinforcement learning for spacecraft formation flying reconfiguration tracking problems. In this scheme, spacecrafts learn the control strategy via transfer learning. For this matter, a new generalized discounted value function is introduced for the tracking problems. Due to the digital nature of spacecraft computer systems, local optimal controllers are developed for the spacecrafts in discrete-time. The stability of the controller is proven. Two Q-learning algorithms are proposed, in each of which the optimal control solution is learned on-line without knowledge about the system dynamics. In the first algorithm, each agent learns the optimal control independently. In the second one, each agent shares the learned information with other agents. Next, the collision avoidance capability is provided. The effectiveness of the presented schemes is verified through simulations and compared with each other.     

Sea fog detection based on unsupervised domain adaptation

Sea fog detection with remote sensing images is a challenging task. Driven by the different image characteristics between fog and other types of clouds, such as textures and colors, it can be achieved by using image processing methods. Currently, most of the available methods are datadriven and relying on manual annotations. However, because few meteorological observations and buoys over the sea can be realized, obtaining visibility information to help the annotations is difficult. Considering t...     

抽油机故障诊断的分布驱动主动学习算法

抽油机示功图直观显示了抽油机工作情况，但实际工况情况呈现典型的长尾分布特性，类别严重不平衡。传统方法无法准确识别小类别工况，也无法获得井下工作状态准确识别。针对这一问题，提出一种基于分布驱动的多类别长尾数据代价敏感主动学习算法（Cost-sensitive active learning algorithm based on distribution -driven multi-class long-tailed data， CALA）。首先，考虑数据分布特性，以最小化代价为优化目标确定数据的最佳聚类簇数；其次，通过加入预分类误差代价来更新之前得到的最佳聚类簇数；然后，构建集成分类模型作为分类器；最后，通过迭代来平衡数据分布。采用某油田真实的示功图数据进行测试，显著性实验分析证明CALA在小类别工况诊断上具有更好的性能。     

Locally generalised multi-agent reinforcement learning for demand and capacity balancing with customised neural networks

Reinforcement Learning (RL) techniques are being studied to solve the Demand and Capacity Balancing (DCB) problems to fully exploit their computational performance. A locally generalised Multi-Agent Reinforcement Learning (MARL) for real-world DCB problems is proposed. The proposed method can deploy trained agents directly to unseen scenarios in a specific Air Traffic Flow Management (ATFM) region to quickly obtain a satisfactory solution. In this method, agents of all flights in a scenario form a multi-agent decision-making system based on partial observation. The trained agent with the customised neural network can be deployed directly on the corresponding flight, allowing it to solve the DCB problem jointly. A cooperation coefficient is introduced in the reward function, which is used to adjust the agent’s cooperation preference in a multi-agent system, thereby controlling the distribution of flight delay time allocation. A multi-iteration mechanism is designed for the DCB decision-making framework to deal with problems arising from non-stationarity in MARL and to ensure that all hotspots are eliminated. Experiments based on large-scale high-complexity real-world scenarios are conducted to verify the effectiveness and efficiency of the method. From a statistical point of view, it is proven that the proposed method is generalised within the scope of the flights and sectors of interest, and its optimisation performance outperforms the standard computer-assisted slot allocation and state-of-the-art RL-based DCB methods. The sensitivity analysis preliminarily reveals the effect of the cooperation coefficient on delay time allocation.     

Blind identification of space–time block codes based on deep learning

Deep Learning(DL) has important applications to both commercial and military communications, such as software-defined radio, cognitive radio and spectrum surveillance. While DL has been intensively studied for modulation recognition, there are very few investigations for blind identification of Space-Time Block Codes(STBCs). This paper proposes a Residual Network(RN)-based model for identifying 6 kinds of STBC signals with a single receiving antenna, including the same length of coding matrix. I...