Prior-guided GAN-based interactive airplane engine damage image augmentation method

Deep learning-based methods have achieved remarkable success in object detection, but this success requires the availability of a large number of training images. Collecting sufficient training images is difficult in detecting damages of airplane engines. Directly augmenting images by rotation, flipping, and random cropping cannot further improve the generalization ability of existing deep models. We propose an interactive augmentation method for airplane engine damage images using a prior-guided GAN to augment training images. Our method can generate many types of damages on arbitrary image regions according to the strokes of users. The proposed model consists of a prior network and a GAN. The Prior network generates a shape prior vector, which is used to encode the information of user strokes. The GAN takes the shape prior vector and random noise vectors to generate candidate damages. Final damages are pasted on the given positions of background images with an improved Poisson fusion. We compare the proposed method with traditional data augmentation methods by training airplane engine damage detectors with state-of-the-art object detectors, namely, Mask R-CNN, SSD, and YOLO v5. Experimental results show that training with images generated by our proposed data augmentation method achieves a better detection performance than that by traditional data augmentation methods.     

基于条件随机场的遥感图像语义标注

遥感图像包含的信息丰富,纹理复杂,而遥感图像语义标注又为后续的目标识别、检测、场景分析及高层语义的提取提供了重要信息和线索,这使其成为遥感图像理解领域中一个关键且极具挑战性的任务。首先针对遥感图像语义标注问题,提出采用条件随机场(CRF)框架对遥感图像的底层特征和上下文信息建模的方法,将Texton纹理特征与CRF中的自相关势能结合来捕捉遥感图像中的纹理信息及其上下文分布,采用组合Boosting算法进行Texton纹理特征选择和参数学习;然后将Lab空间中的颜色信息与CRF中的互相关势能结合来描述颜色上下文;最后用Graph Cut算法对CRF进行推导求解,得到图像自动语义标注结果。同时,建立了可见光遥感图像数据库Google-4,并对全部图像进行了人工标注。Google-4上的实验结果表明:采用CRF框架与Texton纹理特征和颜色特征相结合对遥感图像建模的方法与基于支持向量机(SVM)的方法相比较,能够取得更准确的语义标注结果。     

Ship detection and classification from optical remote sensing images: A survey

Considering the important applications in the military and the civilian domain, ship detection and classification based on optical remote sensing images raise considerable attention in the sea surface remote sensing filed. This article collects the methods of ship detection and classification for practically testing in optical remote sensing images, and provides their corresponding feature extraction strategies and statistical data. Basic feature extraction strategies and algorithms are analyzed associated with their performance and application in ship detection and classification. Furthermore, publicly available datasets that can be applied as the benchmarks to verify the effectiveness and the objectiveness of ship detection and classification methods are summarized in this paper. Based on the analysis, the remaining problems and future development trends are provided for ship detection and classification methods based on optical remote sensing images.     

基于遥感图像分块直线特征检测的机场跑道检测方法

针对遥感图像机场跑道检测问题,提出了一种基于图像分块直线特征检测的机场跑道检测方法。首先,针对遥感图像数据量大带来的计算处理问题,设计了基于直线分割检测子（LSD）的遥感图像分块直线特征检测环节;然后,在总结归纳机场跑道数学特性的基础上,对提取的直线特征进行平行线分组、直线生长、平行线合并,并以Radon变换为基础,找出候选机场跑道区域;最后,使用灰度统计信息并结合梯度方向直方图对候选区域进行处理,筛选出最终的机场道路区域。实验结果表明,在能够提取出有效直线特征的情况下,该方法可以对多类机场跑道进行有效定位。     

GroupNet: Learning to group corner for object detection in remote sensing imagery

Due to the attractive potential in avoiding the elaborate definition of anchor attributes,anchor-free-based deep learning approaches are promising for object detection in remote sensing imagery. Corner Net is one of the most representative methods in anchor-free-based deep learning approaches. However, it can be observed distinctly from the visual inspection that the Corner Net is limited in grouping keypoints, which significantly impacts the detection performance. To address the above problem, ...     

Target localization based on cross-view matching between UAV and satellite

Matching remote sensing images taken by an unmanned aerial vehicle (UAV) with satellite remote sensing images with geolocation information. Thus, the specific geographic location of the target object captured by the UAV is determined. Its main challenge is the considerable differences in the visual content of remote sensing images acquired by satellites and UAVs, such as dramatic changes in viewpoint, unknown orientations, etc. Much of the previous work has focused on image matching of homologous data. To overcome the difficulties caused by the difference between these two data modes and maintain robustness in visual positioning, a quality-aware template matching method based on scale-adaptive deep convolutional features is proposed by deeply mining their common features. The template size feature map and the reference image feature map are first obtained. The two feature maps obtained are used to measure the similarity. Finally, a heat map representing the probability of matching is generated to determine the best match in the reference image. The method is applied to the latest UAV-based geolocation dataset (University-1652 dataset) and the real-scene campus data we collected with UAVs. The experimental results demonstrate the effectiveness and superiority of the method.     

Improving EGT sensing data anomaly detection of aircraft auxiliary power unit

The reliability of the on-wing aircraft Auxiliary Power Unit (APU) decides the cost and the comfort of flight to a large degree. The most important function of APU is to help start main engines by providing compressed air. Especially on the condition of sudden shutdown in the air, APU can offer additional thrust for landing. Therefore, its condition monitoring has drawn much attention from the academic and industrial field. Among the on-wing sensing data which can reflect its condition, Exhaust Gas Temperature (EGT) is one of the most important parameters. To ensure the reliability of EGT, one kind of data-driven anomaly detection framework for EGT sensing data is proposed based on the Gaussian Process Regression and Kernel Principal Component Analysis. The situations of one-dimensional and two-dimensional input data for EGT anomaly detection are considered, respectively. The cross-validation experiments are carried out by utilizing the real condition data of APU, which are provided by China Southern Airlines Company Limited Shenyang Maintenance Base. The anomalous stuck condition of EGT sensing data is also detected. Experimental results show that the proposed EGT sensing data anomaly detection method can achieve better performance of false positive ratio, false negative ratio and accuracy.     

基于CenterNet 的航空遥感图像目标检测

为实现高精度的航空图像目标检测，将Anchor free 的目标检测算法CenterNet 应用到检测中，同时 使用Resnet50 主干网络，并引入CIoU 损失替代原有损失函数对网络模型做出了改进。改进后的算法在RSOD 与DIOR 数据集上进行测试，结果显示在保证网络轻量化的前提下检测精度有明显的提高，证明了算法在航空 目标检测方面的可行性与准确性。     

Aerial-BiSeNet: A real-time semantic segmentation network for high resolution aerial imagery

The aircraft system has recently gained its reputation as a reliable and efficient tool for sensing and parsing aerial scenes. However, accurate and fast semantic segmentation of high-resolution aerial images for remote sensing applications is still facing three challenges: the requirements for limited processing resources and low-latency operations based on aerial platforms, the balance between high accuracy and real-time efficiency for model performance, and the confusing objects with large intra-class variations and small inter-class differences in high-resolution aerial images. To address these issues, a lightweight and dual-path deep convolutional architecture, namely Aerial Bilateral Segmentation Network (Aerial-BiSeNet), is proposed to perform real-time segmentation on high-resolution aerial images with favorable accuracy. Specifically, inspired by the receptive field concept in human visual systems, Receptive Field Module (RFM) is proposed to encode rich multi-scale contextual information. Based on channel attention mechanism, two novel modules, called Feature Attention Module (FAM) and Channel Attention based Feature Fusion Module (CAFFM) respectively, are proposed to refine and combine features effectively to boost the model performance. Aerial-BiSeNet is evaluated on the Potsdam and Vaihingen datasets, where leading performance is reported compared with other state-of-the-art models, in terms of both accuracy and efficiency.     

一种针对多光谱遥感图像的桥梁快速识别算法

提出了一种针对多光谱图像中桥梁的识别算法。首先,根据水体和背景地物在不同光谱波段的亮度差异,计算多光谱图像的水体指数得到水体增强图,搜索其具有明显双峰的直方图得到最优阈值,实现河流的完整提取；其次,利用桥梁的存在会导致局部水体的光谱异常,沿河流中间线进行潜在桥梁区域的快速提取；再进一步利用桥梁长度以及与河流的空间关系进行鉴别,有效剔除虚警。利用 SPOT4遥感影像进行实验,结果表明本文算法运算量小,对于多个桥梁的识别具有很好的实用性。     

Pre-locate net for object detection in high-resolution images

Small-object detection has long been a challenge. High-megapixel cameras are used to solve this problem in industries. However, current detectors are inefficient for high-resolution images. In this work, we propose a new module called Pre-Locate Net, which is a plug-and-play structure that can be combined with most popular detectors. We inspire the use of classification ideas to obtain candidate regions in images, greatly reducing the amount of calculation, and thus achieving rapid detection in high-resolution images. Pre-Locate Net mainly includes two parts, candidate region classification and behavior classification. Candidate region classification is used to obtain a candidate region, and behavior classification is used to estimate the scale of an object. Different follow-up processing is adopted according to different scales to balance the variance of the network input. Different from the popular candidate region generation method, we abandon the idea of regression of a bounding box and adopt the concept of classification, so as to realize the prediction of a candidate region in the shallow network. We build a high-resolution dataset of aircraft and landing gears covering complex scenes to verify the effectiveness of our method. Compared to state-of-the-art detectors (e.g., Guided Anchoring, Libra-RCNN, and FASF), our method achieves the best mAP of 94.5 on 1920 × 1080 images at 16.7 FPS.     

基于改进HOG特征的空间非合作目标检测

传统的非合作目标检测方法大都基于一定的匹配模板,这不仅需要预先指定先验信息,进而设计合适的检测模板,而且同一模板只能对具有相似形状的目标进行检测,不易直接用于检测形状未知的非合作目标。为降低检测过程中对目标形状等先验信息的要求,借鉴基于规范化梯度的物体区域估计方法,提出一种基于改进方向梯度直方图特征的目标检测方法,首先构建包含有自然图像和目标图像的训练数据集;然后提取标记区域的改进方向梯度直方图特征,以更好地保持局部特征的结构性,并根据级联支持向量机训练模型,从数据集中自动学习目标物体的判别特征;最后,将训练后的模型用于检测测试集图像中的目标。实验结果表明,算法在由4953幅和100幅图像构成的测试集中分别取得94.5%和94.2%的检测率,平均每幅图像的检测时间约为0.031 s,具有较低的时间开销,且对目标的旋转及光照变化具有一定的鲁棒性。     

Bayesian edge detector for SAR imagery using discontinuity-adaptive Markov random feld modeling

Synthetic aperture radar（SAR）image is severely affected by multiplicative speckle noise,which greatly complicates the edge detection.In this paper,by incorporating the discontinuityadaptive Markov random feld（DAMRF）and maximum a posteriori（MAP）estimation criterion into edge detection,a Bayesian edge detector for SAR imagery is accordingly developed.In the proposed detector,the DAMRF is used as the a priori distribution of the local mean reflectivity,and a maximum a posteriori estimation of it is thus obtained by maximizing the posteriori energy using gradient-descent method.Four normalized ratios constructed in different directions are computed,based on which two edge strength maps（ESMs）are formed.The fnal edge detection result is achieved by fusing the results of two thresholded ESMs.The experimental results with synthetic and real SAR images show that the proposed detector could effciently detect edges in SAR images,and achieve better performance than two popular detectors in terms of Pratt＇s fgure of merit and visual evaluation in most cases.     

基于深度学习的小目标检测研究进展

随着深度学习方法的快速发展,目标检测作为计算机视觉领域中最基本、最具有挑战性的任务之一,已取得了令人瞩目的进展。现有的算法大多针对于具有一定尺寸或比例的大中型目标,但由于待测目标尺寸小、特征弱等原因,对小目标的检测性能还远远不能令人满意。小目标检测（SOT）作为一种广泛应用于室外远程拍摄和航空遥感场景的技术,近年来受到了广泛的关注,各种方法层出不穷,但是目前对该问题的全面综述较少。从问题定义、算法分析、应用介绍、方向展望等方面对基于深度学习的小目标检测研究进展进行了综述。首先,给出了小目标检测问题的定义,阐述了其技术难点及在实际应用中面临的挑战;接着,从8个不同角度分析了检测器对小目标检测精度较低的主要原因及相应的改进方法,详细归纳总结了小目标检测在各技术方面的研究工作;然后介绍了几个特定场景下小目标检测算法的典型应用;最后,对小目标检测未来的发展趋势进行展望,提出可行的研究方向,期望为该领域的研究工作提供可借鉴和参考的思路。     

基于注意力机制和特征匹配的空对地多目标检测与跟踪算法

多目标跟踪算法是实现无人机自主导航的关键技术，为解决现有方法存在的小目标检测能力弱、计算能耗大、鲁棒性差等问题，提出一种基于注意力机制和特征匹配的多目标空对地跟踪算法，以实现航拍视角下对目标的精准高效跟踪。首先，引入通道可分离卷积，实现目标检测模型的轻量化；其次，构造融合空间注意力机制的小目标检测分支，提高对小微目标的检测精度，最后，优化目标跟踪算法的外观重识别网络，提高多目标跟踪效率。使用Visdrone2019-MOT数据集对所提算法进行验证，实验结果表明，所提算法的MOTA值提高了0.６%，FPS值为21.31帧/s，在模型大小和跟踪精度上实现了较好的平衡。     

基于改进的克隆选择算法的多用户检测技术

 根据克隆选择原理的免疫机理，提出了一种改进的克隆选择算法(CSA),进而设计了2种码分多址（CDMA） 多用户检测器：一种方法是混合Hopfield神经网络和克隆选择算法；另一种方法是把多阶段检测器MSD嵌入到克隆选择算法的每一代中。通过混合MSD到克隆选择算法中，可以加快克隆选择算法的收敛速度，减少计算复杂度。另外，克隆选择算法所提供的好的初值可以改善MSD的性能，嵌入的MSD还改善了克隆选择算法的性能。仿真结果证明了该方法无论抗多址干扰能力和抗远近效应能力都优于传统方法和一些应用优化算法的多用户检测器。     

基于流体网络拓扑的航空发动机及燃气轮机整机性能建模方法

为了快速、灵活、自由地搭建航空发动机及燃气轮机不同构型整机性能仿真模型,提出了一种基于流体网络拓扑的发动机整机性能仿真模型方案。从发动机部件及整机性能模型建模基本原理出发,在现有面向对象的部件性能建模及通用仿真系统总体框架基础上,采用迭代变量和平衡方程组与发动机部件模型和部件模型计算顺序相关联技术,建立了适用于不同航空发动机和燃气轮机类型的稳态性能仿真模型,并将该模型计算结果与成熟的商用仿真软件计算结果进行了对比分析。结果表明：该方案、模型可以实现发动机计算模型/拓扑自动构建,以及迭代变量与平衡方程组自动构建,提高了仿真系统的适用性。     

Calculating the performance of linear and square-law detectors

A method is presented for calculating the performance of linear and square-law detectors in detection schemes that employ noncoherent integration. The method consists of transforming the coherent characteristic function, which is usually easy to obtain to a noncoherent moment generating function describing the test statistic of a linear or square-law detector. The method provides a single mathematical framework for many signal models (both classical and new) and can be implemented using standard numerical routines. Although the method is not always optimum in terms of computing speed for specific classical models, its common approach for all signal models makes it very efficient in term of learning and implementation times. Classical results as well as results for an extended set of target models consisting of an arbitrary number of constant amplitude random phase returns are presented to demonstrate the technique. It is shown for the signal parameters considered that the performance difference between the linear and square-law detectors is relatively insignificant     

改进的基于神经网络的卫星遥感图像去条带方法

由于焦平面阵列的非均匀性影响,线阵列推扫所成的遥感图像表现出规律的条带失真,严重地影响图像质量。本文介绍一种基于神经网络的条带消除方法,以及利用该方法对实际遥感图像校正的结果。     

飞机结构X射线裂纹图像智能评定

飞机结构X 射线图像评定过程存在复杂背景下裂纹分割不准、检出难等问题。基于高效层聚合网络提出一种飞机结构X 射线裂纹图像智能评定模型（ELAN-Seg）,将ELAN-Seg 模型和DeepLabv3+模型的射线图像裂纹分割能力进行对比,结合图像处理技术对模型分割的裂纹长度进行评估,利用飞机强度试验及外场维护过程采集的X 射线图像对模型进行验证。结果表明：分割的最小裂纹长度约为3 mm,ELAN-Seg 模型对复杂背景射线图像裂纹分割更加准确,裂纹漏检率小于3.8%,该模型具有工程适用性。