An online data driven actor-critic-disturbance guidance law for missile-target interception with input constraints

In this article, we develop an online robust actor-critic-disturbance guidance law for a missile-target interception system with limited normal acceleration capability. Firstly, the missiletarget engagement is formulated as a zero-sum pursuit-evasion game problem. The key is to seek the saddle point solution of the Hamilton Jacobi Isaacs(HJI) equation, which is generally intractable due to the nonlinearity of the problem. Then, based on the universal approximation capability of Neural Networks(N...     

三维RTPN的追踪导引研究

描述三维RTPN导引的模型是超越非线性微分方程组，不易求解．常规的方法是进行线性化。通过坐标系的变换和引入辅助向量获得了解析的捕获域和截获时间，并在三维空间内对这种追踪导引过程进行了仿真验算。理论分析和仿真表明：所设计的追踪导引律，能使整个追逃过程是在一个由初始相对距离和初始相对速度确定的平面内进行；当导弹采用RTPN导引，目标分别以IPN、RTPN逃逸和非机动飞行时，拦截TPN逃逸导引的目标能量消耗大，截获时间长，捕获域小。     

Cost-equivalencing discretization of a class of bang-bang guidance laws

Bang-bang guidance laws are encountered in several situations like in the saddle-point solution of some continuous-time pursuit-evasion games, and in the solution of time-optimal control problems. For the purpose of digital implementation, these continuous-time bang-bang control laws must be converted into digital control laws. The paper presents a novel technique for optimal digital implementation of a class of bang-bang control laws in linear systems. This technique delivers a discretization of the continuous-time laws and is shown: 1) to achieve the same cost as the optimal sample and hold (SH) approximation of the continuous-time laws, and 2) to be implementable (the optimal SH approximation is not). The cost-equivalencing technique is applied to the digital implementation of the continuous-time DGL/0, DGL/1, and DGL/C game theoretic guidance laws.     

最优策略的导引特性分析

 本文从微分对策理论出发,在考虑了导弹与目标的响应频宽及纵向加速度下,导出了飞行器的三维最优追逃策略;并以此进行了较全面的导引特性分析。分析表明,最优策略实质上是以零控脱靶作为误差信号的反馈控制,在每一采样时刻近似地以平行接近法作为理想运动状态,是一种修正的比例导引方法。当不计飞行器的响应时间、纵向加速度和控制溢出时,蜕化为常规比例导引。本文还定义了飞行器对对局的可控能力,讨论了相应的影响因素;通过对最优增益系数的计算和分析,加深了对最优策略的认识。     

Linear-quadratic and norm-bounded differential game combined guidance strategy against active defense aircraft in three-player engagement

A new type of guidance strategy, combining linear quadratic and norm-bounded game theory, is proposed for the scenario of an attacker against active defense aircraft in three-player engagement. The problem involves three players, an attacker, a defender and a target. The differential game theory and the solution of Hamiltonian equation are utilized to obtain the combined guidance strategy for each player with arbitrary-order dynamics. The game process is divided into 4 phases, C1-C4, according to the switching time. The linear quadratic differential game guidance scheme is employed to reduce the fuel cost in the game parts of C1 and C3. The norm-bounded game guidance strategy is adopted to satisfy the constraint of control input in the game stages C2 and C4. Furthermore, zero-effort miss distance is introduced to meet the constraints of game space and defender’s killing radius in the guidance strategy, which guarantees that the attacker is able to avoid the interception of the defender and hit the target with lower fuel cost and maximum acceleration. And it is proved that the proposed guidance strategy satisfies the Nash equilibrium condition. Finally, the feasibility and superiority of combined guidance strategy are respectively illustrated by nonlinear numerical simulation and verified by comparing with linear quadratic and norm-bounded differential game guidance strategies.     

Direct Intercept Guidance using Differential Geometry Concepts

This paper examines the application of differential geometry to the engagement of both nonmanoeuvring and manoeuvring targets. The kinematics of the engagement for both manoeuvring and nonmanoeuvring target are developed and expressed in differential geometric terms. Two-dimensional geometry is then used to determine the intercept conditions for a straight line target and a constant manoeuvre target. The intercept conditions for both targets are developed for the case when the interceptor missile guides onto a straight line interception. These two cases are shown to have a common set of core conditions such that it enables a unified guidance law to be developed. The guidance law is shown to be globally stable using Lyapunov theory, so that guidance capture is assured for any initial condition. The analysis and guidance law design does not rely on local linearisation and can be shown to produce guidance trajectories that mirror proportional navigation for the straight line interception of a nonmanoeuvring target for which proportional navigation was originally developed. The paper finishes with simulation in two dimensions, illustrating the convergence and solution properties of the approach.     

Cooperative differential games guidance laws for multiple attackers against an active defense target

This paper is concerned with a scenario of multiple attackers trying to intercept a target with active defense. Three types of agents are considered in the guidance: The multiple attackers, the target and the defender, where the attackers aim to pursuit the target from different directions and evade from the defender simultaneously. The guidance engagement is formulated in the framework of a zero-sum two-person differential game between the two opposing teams, such that the measurements on the m...     

三维空间拦截的前置追踪变结构制导律(英文)

This article aims to develop a head pursuit （HP） guidance law for three-dimensional hypervelocity interception, so that the effect of the perturbation induced by seeker detection can be reduced. On the basis of a novel HP three-dimensional guidance model, a nonlinear variable structure guidance law is presented by using Lyapunov stability theory. The guidance law positions the interceptor ahead of the target on its tlight trajectory, and the speed of the interceptor is required to be lower than that of the target, A numerical example of maneuvering ballistic target interception verifies the rightness of the guidance model and the effectiveness of the proposed method.     

基于非线性模型的大气层内拦截弹微分对策制导律

针对新型战术弹道导弹(TBM)和智能巡航导弹等具有高机动性的拦截目标,应用控制受限的非线性对策模型,提出非线性微分对策制导律,并分析了零脱靶量拦截所容许的初始航向误差.目标和拦截弹间的相对运动是非线性的,采用传统线性化模型建立的拦截制导律会因为线性化而带来误差.提出的制导律是在保持拦截弹和目标的非线性运动学关系的基础上...     

基于分支深度强化学习的非合作目标追逃博弈策略求解

为解决航天器与非合作目标的空间交会问题,缓解深度强化学习在连续空间的应用限制,提出了一种基于分支深度强化学习的追逃博弈算法,以获得与非合作目标的空间交会策略。对于非合作目标的空间交会最优控制,运用微分对策描述为连续推力作用下的追逃博弈问题;为避免传统深度强化学习应对连续空间存在维数灾难问题,通过构建模糊推理模型来表征连续空间,提出了一种具有多组并行神经网络和共享决策模块的分支深度强化学习架构。实现了最优控制与博弈论的结合,有效解决了微分对策模型高度非线性且难于利用经典最优控制理论进行求解的难题,进一步提升了深度强化学习对离散行为的学习能力,并通过算例仿真检验了该算法的有效性。     

带有引诱角色的多飞行器协同最优制导方法

考虑我方高价值飞行器面临对方拦截器拦截时,发射两枚防御器对拦截器进行拦截的情形。针对对方拦截器采用扩展比例导引律,在4个飞行器均具有一阶线性动力学特性假设下,基于最优控制理论设计了能在拦截末端施加相对拦截角的显式协同制导律。显式协同制导律将高价值飞行器和两枚防御器三者的协同考虑在内,给出了三者最优控制输入的解析解。仿真结果表明,设计的制导律能使两防御器成功拦截敌方拦截器,且在拦截末端施加一个相对拦截角。通过与只考虑两防御器协同的隐式协同制导律进行比较,可发现显式的协同制导律在控制要求和能量消耗上,要优于隐式的协同制导律。此外,还验证了在不同发射条件下的协同制导律的稳定性。     

现代战机空战对策建模研究

分析了现代战机空战的种类,着重讨论了单机单目标空战对策的建模问题,分别从二维和三维的角度描述了空战双方的几何关系并建立了飞行器相对运动模型.在此基础上,针对单机单目标空战可能出现的两种情况,建立了追-逃微分对策模型和双目标对策模型.     

基于Lyapunov稳定性的扩展比例导引律研究

利用虚拟目标概念和三维空间追逃模型,提出了一种基于Lyapunov稳定性的扩展比例导引律。该导引律能同时满足脱靶量要求和末端落角要求,保证了大空域变轨弹道的各段弹道平滑衔接。利用该导引律引导反舰导弹实现了各种形式的大空域变轨弹道。采用大空域变轨弹道有利于提高反舰导弹的机动能力和突防能力。仿真结果证明了所提出的基于Lyapunov稳定性的扩展比例导引律是很有效的。     

Linear Quadratic Differential Game Strategies with Two-pursuit Versus Single-evader

In order to intercept the future targets that are characterized by high maneuverability, multiple interceptors may be launched and aimed at single target. The scenario of two missiles P and Q intercepting a single target is modeled as a two-pursuit single-evader non-zero-sum linear quadratic differential game. The intercept space is decomposed into three subspaces which are mutually disjoint and their union covers the entire intercept space. The effect of adding the second interceptor arises in the intercept space of both P and Q (PQ-intercept space). A guidance law is derived from the Nash equilibrium strategy set (NESS) of the game. Simulation studies are focused on the PQ-intercept space. It is indicated that 1) increasing the target’s maneuverability will enlarge PQ-intercept space; 2) the handover conditions will be released if the initial zero-effort-miss (ZEM) of both interceptors has opposite sign; 3) overvaluation of the target’s maneuverability by choosing a small weight coefficient will generate robust performance with respect to the target maneuvering command switch time and decrease the fuel requirement; and 4) cooperation between interceptors increases the interception probability.     

基于打靶法的战机攻击导引方法研究

在以往战机空战攻击导引研究中, 仅考虑如何导引载机使之与目标的相对距离达到武器发射射程, 没有同时考虑拦截角度的需求; 或只考虑拦截角而不考虑相对距离的需求。针对这一不足, 本文在深入分析战机攻击导引理论问题的基础上, 创新地用打靶法, 同时考虑追击距离与拦截角度两末端约束, 进行攻击轨迹优化设计。大量仿真研究表明, 所设计的攻击导引方法, 不仅能很好地满足所需的相对距离和拦截角两末端约束, 而且具有较好的可实现性。本研究可为新一代战机导引攻击系统的研制与某型飞机的国产化设计提供参考。     

A novel cooperative mid-course guidance scheme for multiple intercepting missiles

In the interception engagement,if the target movement information is not accurate enough for the mid-course guidance of intercepting missiles,the interception mission may fail as a result of large handover errors.This paper proposes a novel cooperative mid-course guidance scheme for multiple missiles to intercept a target under the condition of large detection errors.Under this scheme,the launch and interception moments are staggered for different missiles.The earlier launched missiles can obtain a relatively accurate detection to the target during their terminal guidance,based on which the latter missiles are permitted to eliminate the handover error in the mid-course guidance.A significant merit of this scheme is that the available resources are fully exploited and less missiles are needed to achieve the interception mission.To this end,first,the design of cooperative handover parameters is formulated as an optimization problem.Then,an algorithm based on Monte Carlo sampling and stochastic approximation is proposed to solve this optimization problem,and the convergence of the algorithm is proved as well.Finally,simulation experiments are carried out to validate the effectiveness of the proposed cooperative scheme and algorithm.     

自适应动态规划算法在飞行器追逃中的应用

针对飞行器追逃对抗的二人零和微分对策问题,提出基于数据的积分策略迭代自适应动态规划算法,以求解数学模型未知系统的控制律.该算法利用固定时段内有效的状态和输入信息,建立数据模型,并对其进行基于值函数和控制策略的算法迭代,在平面拦截系统完全未知的情况下得到追逃双方的近似最优策略.仿真结果表明,所得到的双方控制策略能在有限界内无限接近最优解,验证了所提出算法的有效性.     

自主空战机动决策方法综述

自主空战机动决策是基于数学优化、人工智能等方法,模拟飞行员空战决策,自动生成飞行控制指令的过程。它在空战仿真、飞行员辅助决策和无人战斗机自主飞行等领域广泛运用。根据求解思路的不同,综合论述了两类自主空战机动决策方法:针对基于对策的空战决策方法,阐述了从追逃对策到双目标对策的发展脉络和内在联系,并着重分析了两类重要的双目标对策模型——矩阵对策和影响图对策;针对基于人工智能的空战决策方法,系统论述了基于专家系统的机动决策、基于遗传学习系统的机动决策、基于人工免疫系统的机动决策和基于神经网络的机动决策,明确了各种决策的建模方法、适用条件、改进途径等问题。总结了各个空战机动决策方法的优点及不足,指出了自主空战机动决策的进一步研究思路。     

轨道拦截问题的一种精确初制导方法研究

对于轨道拦截问题,给出了一种基于速度增益制导和状态转移矩阵的精确初制导方法。该初制导方法能补偿制导方法误差和轨道摄动对拦截脱靶量的影响。仿真结果表明,所提出的精确初制导方法合理、有效,能在增加较小燃料消耗的情况下,大大提高轨道拦截的制导精度。     

Optimal terminal guidance for exoatmospheric interception

In this study, two optimal terminal guidance (OTG) laws, one of which takes into account the final velocity vector constraint, are developed for exoatmospheric interception using optimal control theory. In exoatmospheric interception, because the proposed guidance laws give full consideration to the effect of gravity, they consume much less fuel than the traditional guidance laws while requiring a light computational load. In the development of the guidance laws, a unified optimal guidance problem is put forward, where the final velocity vector constraint can be consid-ered or neglected by properly adjusting a parameter in the cost function. To make this problem ana-lytically solvable, a linear model is used to approximate the gravity difference, the difference of the gravitational accelerations of the target and interceptor. Additionally, an example is provided to show that some achievements of this study can be used to significantly improve the fuel efficiency of the pulsed guidance employed by the interceptor whose divert thrust level is fixed.