引入稀疏原子特征融合的滑动轴承摩擦故障状态监测

从信息融合理论出发，将特征的稀疏表达作为特征融合参数，提出一种结合K奇异值分解(KSVD）和最大相关最小冗余准则(mRMR）的轴承摩擦故障特征融合算法。该算法采用KSVD对信号稀疏化，将稀疏系数对应的字典原子作为特征融合的参数，用以表达非线性故障信息；针对字典原子集的优化选择问题，基于互信息的mRMR提出一种确定最优原子集的原子数目的准则；最后，通过最大化原则融合稀疏系数，提取故障状态监测的有效信息。轴承摩擦故障模拟实验的结果表明，所提方法能够更好地融合不同特征的故障信息，相比于单特征和其他融合特征方法，提高了约12%的故障识别率。      

Space law education in China: Status quo,shortcomings and possible ways out

Space law education has an essential role in the space capacity building of a country because of its importance for human resources development in space law. Comparisons between Canada and China, the European Union and China and the United States of America (USA) and China in space law degree education, course, teaching methodology, institute and practice and communication platform are provided in an attempt to review some issues which exist within the Chinese space law educational system and to seek a better choice for China’s space law education reform. Chinese space law education has achieved noticeable progress over the past two decades. However, it is still limited in comparison to its counterparts in Europe and Northern America. The range of the space law degree education programmes and space-law-related courses is comparatively limited. A gap remains between space law education and practice in China. Chinese space law classes are still dominated by the teacher-centred teaching methodology, although several universities have some new teaching practices. The establishment of seven space law-related research institutes plays an increasingly important role in Chinese space law education, space law and policy research and legal advisory services for the Chinese government and non-governmental sectors. However, these institutes still have a long way to go in comparison with their counterparts in Europe and Northern America. While China has established domestic research platforms for space law communication through international cooperation, it does not provide space law practice platforms for space law education. While international space law does not provide a direct legal foundation for space law education in China, Chinese educational laws can lay a profound legal foundation for Chinese space law education. To promote its national expertise and capacity in space law, based on the three-pillar model and the experiences of its counterparts in North America and Europe, China should adopt a systematic and sustainable regime for its space law education.     

Improving multi-target cooperative tracking guidance for UAV swarms using multi-agent reinforcement learning

Multi-Target Tracking Guidance(MTTG) in unknown environments has great potential values in applications for Unmanned Aerial Vehicle(UAV) swarms. Although Multi-Agent Deep Reinforcement Learning(MADRL) is a promising technique for learning cooperation, most of the existing methods cannot scale well to decentralized UAV swarms due to their computational complexity or global information requirement. This paper proposes a decentralized MADRL method using the maximum reciprocal reward to learn cooper...     

集群多机器人系统建模研究的发展与展望

凭借高效、鲁棒、应用广泛的特性,集群多机器人系统已经成为当今研究的热点课题之一,具有重要的实用价值。首先简述了自顶而下和自底而上两种多机器人系统研究思路的当前研究概况。然后从拟生物集群系统模型引入,进而引出一致性系统模型,针对低阶、高阶、异质、时延等一致性模型进行分析总结,单独阐述了多智能体强化学习系统模型的研究情况,并分别讨论了三种集群多机器人系统自组织建模方法的研究现状与各自存在的问题,总结与分析了集群多机器人系统运动的发生机理。最后,分析了现有集群多机器人系统模型尚待解决的关键问题和面临的挑战,并对其未来发展进行了展望。     

Transfer learning: A new aerodynamic force identification network based on adaptive EMD and soft thresholding in hypersonic wind tunnel

The aerodynamic test in the pulse combustion wind tunnel is very important for the design, evaluation and optimization of aerodynamic characteristics of the hypersonic aircraft. The test accuracy even affects the success or failure of hypersonic aircraft development. In the aerodynamic test of pulse combustion wind tunnel, the aerodynamic signal is disturbed by the inertial force signal, which seriously affects the test accuracy of aerodynamic force. Aiming at the above problems, this paper innovatively proposes an aerodynamic intelligent identification method, that is the transfer learning network based on adaptive Empirical Modal Decomposition (EMD) and Soft Thresholding (TLN-AE&ST). Compared with the existing aerodynamic intelligent identification model based on deep learning technology, this study introduces the transfer learning idea into the aerodynamic intelligent identification model for the first time. The TLN-AE&ST effectively alleviates the problem of scarcity of training samples for intelligent models due to the high cost of wind tunnel tests, and provides a new idea for further implementation of deep learning technology in the field of wind tunnel aerodynamic testing. And this study designed residual attention block with soft threshold and dense block with adaptive EMD in TLN-AE&ST model. Residual attention block with soft threshold module can more effectively suppress the influence of instrument noise signal on model training effect. Dense block with adaptive EMD makes the deep learning model no longer a black box to a certain extent, and has certain physical significance. Finally, a series of wind tunnel tests were carried out in the Φ = 2.4 m pulse combustion wind tunnel of China Aerodynamic Research and Development Center to verify the effectiveness of TLN-AE&ST.     

基于深度强化学习的复杂地形适应机器人设计与实验

针对行星表面轻量化自主探测任务，基于仿生思想设计了一种仿海胆结构的十二足球形机器人，其具备自主改变构型以贴合复杂地形的能力，可实现无倾覆、高容错的全向运动；基于数据驱动方法，对该机器人设计了一种数据高效的无模型强化学习运动策略，可实现无先验知识的从0到1步态训练以及步态的实物样机快速部署。通过在平面地形和非结构化地形中对其进行仿真实验，验证了经过训练的机器人具备自主运动、适应非结构地形等能力；通过与常用基准策略进行对比，证实了本文提出的运动策略具有训练高效、鲁棒性好的优势；最后通过开发原理样机，开展实物实验验证了仿真环境中所生成的步态在真实物理环境中的动力学可行性。     

一种高速可变形飞行器智能变形决策方法

针对一类高速可变形飞行器(HMFV)的变形决策问题，提出一种基于深度确定性策略算法(DDPG)下考虑综合性能指标最优的智能变形决策方法。首先，以一类后掠角可连续变化的高速飞行器为研究对象，给出变形飞行器动力学模型，分析模型特性及变形量与关键气动参数之间的定性关系。其次，基于关键气动数据特征分析，考虑包含气动性能、控制误差在内的综合性能指标，设计一种基于DDPG算法的智能变形决策方案。再者，针对带有标称控制器的HMFV进行变形决策训练，实时获得滑翔过程中不同飞行状态下的最优构型。最后，仿真结果表明所设计的智能变形决策算法收敛效果好，且具备较好的泛化性能。相比于固定外形，可通过变形使得在不同状态下的升阻比保持最优，且与考虑单一决策指标相比，考虑综合指标最优的变形决策可进一步缩小姿态动态跟踪误差。     

Reinforcement learning based dynamic distributed routing scheme for mega LEO satellite networks

Recently, mega Low Earth Orbit (LEO) Satellite Network (LSN) systems have gained more and more attention due to low latency, broadband communications and global coverage for ground users. One of the primary challenges for LSN systems with inter-satellite links is the routing strategy calculation and maintenance, due to LSN constellation scale and dynamic network topology feature. In order to seek an efficient routing strategy, a Q-learning-based dynamic distributed Routing scheme for LSNs (QRLSN) is proposed in this paper. To achieve low end-to-end delay and low network traffic overhead load in LSNs, QRLSN adopts a multi-objective optimization method to find the optimal next hop for forwarding data packets. Experimental results demonstrate that the proposed scheme can effectively discover the initial routing strategy and provide long-term Quality of Service (QoS) optimization during the routing maintenance process. In addition, comparison results demonstrate that QRLSN is superior to the virtual-topology-based shortest path routing algorithm.     

A policy iteration method for improving robot assembly trajectory efficiency

Bolt assembly by robots is a vital and difficult task for replacing astronauts in extra-vehicular activities (EVA), but the trajectory efficiency still needs to be improved during the wrench insertion into hex hole of bolt. In this paper, a policy iteration method based on reinforcement learning (RL) is proposed, by which the problem of trajectory efficiency improvement is constructed as an issue of RL-based objective optimization. Firstly, the projection relation between raw data and state-action space is established, and then a policy iteration initialization method is designed based on the projection to provide the initialization policy for iteration. Policy iteration based on the protective policy is applied to continuously evaluating and optimizing the action-value function of all state-action pairs till the convergence is obtained. To verify the feasibility and effectiveness of the proposed method, a noncontact demonstration experiment with human supervision is performed. Experimental results show that the initialization policy and the generated policy can be obtained by the policy iteration method in a limited number of demonstrations. A comparison between the experiments with two different assembly tolerances shows that the convergent generated policy possesses higher trajectory efficiency than the conservative one. In addition, this method can ensure safety during the training process and improve utilization efficiency of demonstration data.     

Pose matters: Pose guided graph attention network for person re-identification

Person re-Identification (reID), aiming at retrieving a person across different cameras, has been playing a more and more important role in the construction of smart city and social security. For deep-learning-based reID methods, it has been proved that using local feature together with global feature could help to give robust representation for person retrieval. Human pose information can provide the locations of human skeleton to effectively guide the network to pay more attention to these key areas, and can also help to reduce the noise distractions from background or occlusions. Based on human pose, a Pose Guided Graph Attention (PGGA) network is proposed in this paper, which is a multi-branch architecture consisting of one branch for global feature and two branches for local key-point features. A graph attention convolution layer is carefully designed to re-assign the contribution weight of each extracted local feature by modeling the similarity relations. The experimental results demonstrate the effectiveness of our approach on discriminative feature learning. Our model achieves the state-of-the-art performance on several mainstream evaluation datasets. A plenty of ablation studies and different kinds of comparison experiments are conducted to prove the effectiveness of this work, including the tests on occluded datasets and cross-domain datasets. Moreover, we further design supplementary tests in practical scenario to indicate the advantage of our work in real-word applications.