基于Kinect三维重建的地下井室可视化方法研究

针对现有地下井室病害探测与维护方法的不足,提出了一种基于Kinect三维重建的地下井室可视化方法,以实现其三维可视化探测与维护.还提出了一种基于多项式曲面拟合的Kinect深度测量误差修正方法,利用联合双边滤波算法对深度图像数据进行预处理;结合SIFT特征匹配和改进的RANSAC算法获取相邻点云间的初始位姿,并利用基于邻域特征的ICP算法进一步实现不同视角点云的精确配准,从而获取全局一致的稠密三维点云.最后,在三维稠密点云的基础上进行曲面重建和纹理贴图,以实现地下井室真实三维重建.实验结果表明:所提方法可有效修正Kinect深度相机的深度测量误差,在0.5～4.5m的测距范围内,其三维重建精度可达2cm;在4.5～7m的测距范围内,精度也可以保持在4.5cm以内.所提重建方法可实现地下井室真实场景的三维可视化,为地下井室的探测和维护提供了技术支持.     

基于视觉SLAM的飞机模拟座舱三维地图构建

针对飞机座舱副驾驶的研究需要,为使得机械臂能够在飞机座舱完成导航任务,旨在构建一个可用于机械臂导航的飞机模拟座舱三维地图。 针对特征点分布情况对即时定位与地图构建( simultaneous localization and mapping,简称 SLAM)的建图精度的影响,通过实验对比,验证了 ORB-SLAM 改进的 ORB( oriented FAST and rotated BRIEF)特征检测算法相对于 OpenCV 库中 SIFT,SURF 和 ORB 算法检测提取的特征点分布更加均匀,更适用于 SLAM。 采用 Kinect V2. 0 作为深度信息图像和彩色图像的数据采集设备,在飞机模拟座舱真实的环境下,结合 ROS 系统和 ORBSLAM2 系统框架,构建了飞机座舱内的三维稠密点云地图。 针对点云地图存在数据大和难以实现导航等问题,采用了 OctoMap 数据模型,该数据模型能够压缩点云,调节分辨率和判断空间是否被占据,将点云地图转化为八叉树地图,最终获得数据小和适用于导航的三维八叉树地图。     

Sea fog detection based on unsupervised domain adaptation

Sea fog detection with remote sensing images is a challenging task. Driven by the different image characteristics between fog and other types of clouds, such as textures and colors, it can be achieved by using image processing methods. Currently, most of the available methods are datadriven and relying on manual annotations. However, because few meteorological observations and buoys over the sea can be realized, obtaining visibility information to help the annotations is difficult. Considering t...     

基于微机的塔台管制模拟系统中三维场景的建立

在塔台管制模拟训练系统中,由于需要模拟机场平面上的复杂的三维场景,其中涉及到众多复杂的三维对象,包括不同类型飞机、跑道、跑道灯、滑行道、塔台、候机楼、机库、远处建筑物、地面车辆、天空和云彩等三维对象。对于如此众多的场景元素,根据各自的特点,将它们进行分类,按照不同的方式进行绘制,并且提供一个比较合理的三维场景组织方式。     

ICP配准算法的影响因素及评价指标分析

基于3D激光雷达传感器的同时定位与地图构建(SLAM)技术,是机器人自主定位解决方案的核心。三维点云配准环节是3D激光雷达SLAM实现自身定位与地图构建的关键所在。重点围绕ICP算法在三维激光点云配准中的应用开展研究,首先对ICP算法的配准原理及其求解过程进行详细分析,其次介绍了ICP的影响因素并提出了相应的评价指标,最后测试了ICP算法在不同角度和位移下的配准效果并进行了实验分析。     

Accurate 3D Target Positioning in Close Range Photogrammetry with Implicit Image Correction

Accurate three-dimensional (3D) target positioning is of great importance in many industrial applications. Although various methods for reconstructing 3D information from a set of images have been available in the literature, few of them pay enough attention to the indispensable procedures, such as target extraction from images and image correction having strong influences upon the 3D positioning accuracy. This article puts forward a high-precision ellipse center (target point) extraction method and a new image correction approach which has been integrated into the 3D reconstruction pipeline with a concise implicit model to accurately compensates for the image distortion. The methods are applied to a copyright-reserved close range photogrammetric system. Real measuring experiments and industrial applications have evidenced the proposed methods, which can significantly improve the 3D positioning accuracy.     

A point cloud deep neural network metamodel method for aerodynamic prediction

Aiming to reduce the high expense of 3-Dimensional (3D) aerodynamics numerical simulations and overcome the limitations of the traditional parametric learning methods, a point cloud deep learning non-parametric metamodel method is proposed in this paper. The 3D geometric data, corresponding to the object boundaries, are chosen as point clouds and a deep learning neural network metamodel fed by the point clouds is further established based on the PointNet architecture. This network can learn an end-to-end mapping between spatial positions of the object surface and CFD numerical quantities. With the proposed aerodynamic metamodel approach, the point clouds are constructed by collecting the coordinates of grid vertices on the object surface in a CFD domain, which can maintain the boundary smoothness and allow the network to detect small changes between geometries. Moreover, the point clouds are easily accessible from 3D sensors. The point cloud deep learning neural network, which employs re-sampling technique, the spatial transformer network and the fully connected layer, is developed to predict the aerodynamic characteristics of 3D geometry. The effectiveness of the proposed metamodel method is further verified by aerodynamic prediction and robust shape optimization of the ONERA M6 wing. The results show that the proposed method can achieve more satisfactory agreement with the experimental measurements compared to the parametric-learning-based deep neural network.     

基于局部几何特征的稠密点云配准方法

针对现有的稠密点云配准方法依赖初始位置设定、计算成本高、配准成功率不高等问题，提出了一种基于点云局部几何特征的稠密点云配准方法。采用深度卷积网络模型提取点云的局部几何特征，从而减少了三维点云数据的噪声、低分辨率和不完备性等带来的影响。在此基础上，使用K维树搜索完成局部几何特征描述子的关联工作。最后，通过随机采样一致算法对点云的相对位姿进行鲁棒的估计。通过对开源数据集上5个典型场景中的数据测试表明，该方法的配准成功率达到92.5%，配准精度达到0.0434m，配准时间相对最邻点迭代配准算法缩短了74.7%，实验结果验证了该方法的有效性、实时性和鲁棒性。     

基于平面模板自由拍摄的双目立体测量系统的现场标定

 摄像机标定是基于光学摄像的立体测量技术中的一个十分重要的步骤，标定精度直接影响系统测量的精度和稳定性。本文提出并实现了一种简便易行的双目立体测量系统现场标定方法：利用一块特殊设计的具有不同大小圆形特征点的平面标定板，在无需控制任何运动参数的情况下，双目测量系统只需对标定板在不同角度自由拍摄一组图像即可方便地实现系统标定。该方法在已有单摄像机标定算法的基础上，加入对双摄像机相对位置和姿态的优化，同时考虑了镜头的非线性畸变，达到了较好的标定结果。另外，提出的图像点与其空间点的对应算法具有良好的稳定性，即使由于环境或摄像机摆放位置等因素的影响，一些标定板上的特征点不能被摄像机拍摄到，或者不能被正确识别时，仍然能进行标定工作。标定实验和系统标定后的三维重建结果验证了该方法的有效性。     

三维激光成像系统的点云模型真彩色处理方法

三维激光成像系统获得的点云数据精度高并且保有高精度的高程信息,然而特征信息不明显,没有保留全部的点和点的拓扑关系,无法直接判读地面物体;影像数据空间分辨率和精度低,并且缺少高程信息,然而其影像的特征连续,光谱信息丰富.因此,进行点云数据与影像数据融合方法的研究是目前三维激光成像系统研制的前沿性课题.针对点云数据与影像数据融合方法的研究,提出了一种三维激光成像系统点云模型真彩色处理的方法.实验结果显示,采用所提出的方法,不仅能够获得被扫描物体的位置信息和大小信息,而且能够得到被扫描物体的表面纹理细节信息.     

一种固体发动机光线投射体绘制加速方法

固体发动机ICT断层图像构成的体数据场规模大、空体素比例小,现有的光线投射加速方法效果不明显,并且在其三维可视化故障诊断中,不是体数据场中的所有信息都对内部故障检测有意义,三维重建出所有体数据大大增加了计算量.为此,提出一种在同体发动机体数据分割基础上的光线投射加速方法.该方法利用分割结果,建立分割信息体数据场,结合现...     

三维随机图象模型及其空间关系

为了用随机的方法对三维图象进行处理,在二维 Markov场图象模型的基础上,建立了三维 Markov场图象模型。把定义在平面域上随机场的邻域系、集簇和势函数等概念推广到三维空间域,给出了三维邻域系、集簇的空间分布规律和势函数的具体表达式,解释了其空间关系和概率分布,从理论上解决了三维建模的问题,并为三维图象的计算机处理,提供了一种可以实际进行操作的随机方法。     

基于加权的可见光与红外光图像融合算法

红外图像所含边缘等细节偏少、可见光又容易受外部环境干扰,融合图像可以提供更全面的信息,符合人或机器的视觉特性,为图像进一步分析、识别等提供基础。提出一种比值与梯度加权的可见光与红外光图像融合算法,结合小波变换在图像分解中的特性及信号集中的特点,将小波变换应用于红外光和可见光图像融合中可以提高融合信息的理解能力。针对分解获得的低频系数主要反映图像细节信息的特点,对低频系数采用比值加权分析融合规则;针对分解获得的高频系数主要反映图像边缘信息特征的特点,对高频系数采用改进边缘检测算子梯度加权的融合规则。选取多组图像进行了不同融合规则实验对比分析,通过客观评价指标进行评价,改进的融合算法可以获得较清晰的融合图像,可以增加图像的互补信息,并能较好地提高融合图像的清晰度。     

Exploring 2D projection and 3D spatial information for aircraft 6D pose

The 6D pose estimation is important for the safe take-off and landing of the aircraft using a single RGB image. Due to the large scene and large depth, the exiting pose estimation methods have unstratified performance on the accuracy. To achieve precise 6D pose estimation of the aircraft, an end-to-end method using an RGB image is proposed. In the proposed method, the 2D and 3D information of the keypoints of the aircraft is used as the intermediate supervision, and 6D pose information of the aircraft in this intermediate information will be explored. Specifically, an off-the-shelf object detector is utilized to detect the Region of the Interest (RoI) of the aircraft to eliminate background distractions. The 2D projection and 3D spatial information of the pre-designed keypoints of the aircraft is predicted by the keypoint coordinate estimator (KpNet). The proposed method is trained in an end-to-end fashion. In addition, to deal with the lack of the related datasets, this paper builds the Aircraft 6D Pose dataset to train and test, which captures the take-off and landing process of three types of aircraft from 11 views. Compared with the latest Wide-Depth-Range method on this dataset, our proposed method improves the average 3D distance of model points metric (ADD) and 5° and 5 m metric by 86.8% and 30.1%, respectively. Furthermore, the proposed method gets 9.30 ms, 61.0% faster than YOLO6D with 23.86 ms.     

基于单数码相机自由拍摄的空间点定位

 提出并实现了一种空间点定位方法。该方法仅用一台数码相机围绕目标进行多角度自由拍摄获得多帧图像，采用一套具有身份唯一性的标记点实现多图像间点的稳定匹配；在此基础上根据多视图几何约束，精确计算各次拍摄时的相机姿态和位置；进而求解目标点的三维位置信息，并对结果进行优化。实验表明空间点定位的相对误差优于0.03%。该方法所用设备十分简单，操作方式非常灵活，适用于大型物体多视角测量的拼合、某些情况下的装配检查等，也可直接用于较规则构型物体的三维数据获取与CAD模型重建。     

航空发动机零件加工装夹过程可视化文件生成

目前在航空发动机制造企业中,加工人员通常根据工艺规程完成零件的加工装夹,缺乏专门的加工装夹过程指导性文件,易导致装夹信息表达不直观,产生工件和夹具错装、漏装的现象,针对此类问题,提出一种基于Tecnomatix和3D PDF技术的零件加工装夹过程可视化文件生成方法。该方法首先基于3D PDF开发了加工装夹过程可视化文件模板,并基于Tecnomatix开发了零件加工工艺信息生成模块,然后将加工工艺信息生成模块产生的XML文档和Tecnomatix生成的装夹过程动画导入到可视化模板中,最终生成零件加工装夹过程可视化文件,可实现二维信息与三维装夹动画的实时交互响应,提高零件加工装夹的效率和准确性。     

雷达罩的综合优化设计

在分析对比现有的雷达罩设计方法基础上，针对某型直升机机栽雷达罩，研究了雷达罩设计过程中的基本问题、关键技术和综合优化设计方法，运用三维射线追踪法进行了计算机辅助设计，给出了布设防雷击部件的经验公式，讨论了吸波材料选择与喷涂的基本准则。电测结果表明：加罩后的功率传输系数、反射瓣、雷达辐射特性等指标的实测数据与计算值符合较好，满足了设计要求。     

Prior-guided GAN-based interactive airplane engine damage image augmentation method

Deep learning-based methods have achieved remarkable success in object detection, but this success requires the availability of a large number of training images. Collecting sufficient training images is difficult in detecting damages of airplane engines. Directly augmenting images by rotation, flipping, and random cropping cannot further improve the generalization ability of existing deep models. We propose an interactive augmentation method for airplane engine damage images using a prior-guided GAN to augment training images. Our method can generate many types of damages on arbitrary image regions according to the strokes of users. The proposed model consists of a prior network and a GAN. The Prior network generates a shape prior vector, which is used to encode the information of user strokes. The GAN takes the shape prior vector and random noise vectors to generate candidate damages. Final damages are pasted on the given positions of background images with an improved Poisson fusion. We compare the proposed method with traditional data augmentation methods by training airplane engine damage detectors with state-of-the-art object detectors, namely, Mask R-CNN, SSD, and YOLO v5. Experimental results show that training with images generated by our proposed data augmentation method achieves a better detection performance than that by traditional data augmentation methods.     

单柱地轨型三坐标机立柱的研究

结合单柱地轨型三坐标机的结构特点，通过对横梁的分析进而对立柱进行了详尽的研究，这些研究对立柱的结构分析，受力分析和误差分析，最后指出由立柱弹性引起的测量误差可以和由其它因素引起垢测量误差相迭加，并可进行软件修正。     

Multi-scale simulation model of air system based on cross-dimensional data transmission method

The Secondary Air System (SAS) plays an important role in the safe operation and performance of aeroengines. The traditional 1D-3D coupling method loses information when used for secondary air systems, which affects the calculation accuracy. In this paper, a Cross-dimensional Data Transmission method (CDT) from 3D to 1D is proposed by introducing flow field uniformity into the data transmission. First, a uniformity index was established to quantify the flow field parameter distribution characteristics, and a uniformity index prediction model based on the locally weighted regression method (Lowess) was established to quickly obtain the flow field information. Then, an information selection criterion in 3D to 1D data transmission was established based on the Spearman rank correlation coefficient between the uniformity index and the accuracy of coupling calculation, and the calculation method was automatically determined according to the established criterion. Finally, a modified function was obtained by fitting the ratio of the 3D mass-average parameters to the analytical solution, which are then used to modify the selected parameters at the 1D-3D interface. Taking a typical disk cavity air system as an example, the results show that the calculation accuracy of the CDT method is greatly improved by a relative 53.88% compared with the traditional 1D-3D coupling method. Furthermore, the CDT method achieves a speedup of 2 to 3 orders of magnitude compared to the 3D calculation.