Video surveillance applications using multiple views of a scene

Automatic video surveillance techniques are used to detect intruders within a scene. This task is mostly reduced to the problem of detecting moving objects evaluating image sequences of a monocular camera. An essential problem of this monocular approach is its inability to measure the 3D-size and 3D-position of objects reliably, as object size and velocity are estimated within the 2D-image plane. To include 3D-information about the scene an approach using a second camera is proposed in this paper which combines the evaluation of the measurement data of the two cameras using an efficient 3D-scene model. Here, two cameras are used with an overlapping field of view, which represents an installation often used in existing video surveillance applications. It is shown that using the combined evaluation of the two cameras, the false detection rate in the case of moving shadows, leaves, birds and insects or blindings can be further reduced compared to a pure monocular evaluation     

基于局部单应性矩阵的图像拼接与定位算法研究

针对单个摄像机的视野范围有限导致在大场景下监控效果不够理想的问题,提出了一种改进的图像拼接与目标定位算法。该算法以多个摄像机获取的具有共视区域的监控图像为基础,通过对图像进行网格划分后分别计算多个局部单应性矩阵完成初步对准,然后对网格顶点进行微调优化完成最后配准。最后对图像进行融合形成无缝、自然的大视角图像,并利用场景信息在获取的全景图像上对目标进行快速定位,以满足监控人员对场景中目标的全景捕捉分析功能。实验结果表明,该算法能显著提高大场景下图像拼接结果的质量并实现目标的快速定位。     

Surface Measurement Based on Instantaneous Random Illumination

This article introduces a surface measurement system which is able to take a measurement in an extremely short period of less than 2 milliseconds. It is composed of two cameras together with a specifically designed projector that projects an instantaneous random image pattern onto the objective surface. With the aid of the projected pattern, a match of image with corresponding sub-pixel is steadily established and a cluster of dense 3D points is obtained at the same time. A detailed discussion about the design and implementation of hardware is presented. A system calibration algorithm taking into account the possible geometric error of the planar calibration board is also put forward. Experiments are carried out to evaluate the system accuracy and its capability of capturing details of complex surfaces.     

Characterization of Multiband Imager Aboard SELENE

The Multiband Imager (MI) is a high-resolution, multi-spectral imaging instrument for lunar exploration. It consists of two cameras, VIS and NIR, and is carried on the SELenological and ENgineering Explorer (SELENE), launched on Sep. 14, 2007. During the observation from January 2008 to June 2009, MI acquired about 450,000 scenes of multispectral image. The radiometric properties of the cameras were characterized using the pre-flight data derived in laboratory experiments with a calibrated integrating sphere. Twelve light source sets were used to examine the S/N ratio, linearity, and saturation level of the cameras. The dark field signal is quite stable in both cameras, having a noise level of less than 1 DN (VIS) and 2 DN (NIR). The fluctuation in the light field is also low (<2 DN), indicating that the spatial nonuniformity in the camera responses can be removed using a flat field. In order to remove the smear signals due to the frame transfer in the VIS data, we developed an iterate algorithm using all bands in the VIS camera. The S/N ratio, which is critical to the precision of the product, is estimated to exceed 160 for the VIS bands and 400 for the NIR bands under low illumination conditions (5% of lunar surface reflectance). Based on the S/N ratio, the radiometric error due to the noise is calculated to be less than 0.7% for VIS and 0.2% for NIR. The relationship between input and output of the VIS camera is linear with a residual of less than 0.6 DN, corresponding to a radiometric error of 0.3%. The NIR exhibits a non-linear response to the input radiance. A cubic function best fits the pre-flight data with an average residual of 8 DN (corresponds to an error of 0.8%). Validation using in-flight data indicated that the instability of the dark output has not changed, but the level of dark output has slightly changed in the NIR bands (less than 6 DN). The pixel-to-pixel sensitivity variation in the orbit has been changed from that in the pre-flight experiment. The difference between the in-flight data and the pre-flight data ranges within ±2%. There is also a small (less than ±1%) but nonnegligible difference between in-flight data of different cycles in both the VIS and NIR bands, suggesting that the coefficient for spatial ununiformity correction needs to be calculated for each cycle.     

基于平面模板自由拍摄的双目立体测量系统的现场标定

 摄像机标定是基于光学摄像的立体测量技术中的一个十分重要的步骤，标定精度直接影响系统测量的精度和稳定性。本文提出并实现了一种简便易行的双目立体测量系统现场标定方法：利用一块特殊设计的具有不同大小圆形特征点的平面标定板，在无需控制任何运动参数的情况下，双目测量系统只需对标定板在不同角度自由拍摄一组图像即可方便地实现系统标定。该方法在已有单摄像机标定算法的基础上，加入对双摄像机相对位置和姿态的优化，同时考虑了镜头的非线性畸变，达到了较好的标定结果。另外，提出的图像点与其空间点的对应算法具有良好的稳定性，即使由于环境或摄像机摆放位置等因素的影响，一些标定板上的特征点不能被摄像机拍摄到，或者不能被正确识别时，仍然能进行标定工作。标定实验和系统标定后的三维重建结果验证了该方法的有效性。     

一种月球车视觉系统的匹配算法

 对采用双目视觉来实现月球车自主导航提出了一种快速匹配的方法。首先,对相机的内外参数进行精确地标定,通过两相机的外参数对图像进行核线纠正,生成消除上下视差的核线;然后,在核线图像上,采用相关系数法进行由少到多的粗匹配,对匹配结果进行多重的检验,接着用最小二乘方法进行亚像素的精确匹配;最后,在匹配的像点间构建Delaunay三角网,建立两图像重叠区域的匹配关系,实现稠密匹配。对该方法进行了多组实验,实验结果表明:该方法可以快速、可靠地实现稠密的图像匹配。     

运动单阵元被动合成阵列波达方向估计

 提出了一种运动单阵元被动合成阵列波达方向(DOA)估计算法。该算法基于被动合成阵列(PSA)的概念,结合空间谱估计的思想构建了运动单阵元被动合成阵列模型,通过多次不同速度合成阵列过程实现对信号DOA的无模糊估计。通过对单次匀速合成阵列过程进行分析得到,在假设信号频率已知条件下,合成阵列算法能够达到与同孔径实阵列多重信号分类（MUSIC）算法相当的DOA估计性能。仿真验证了被动合成阵列与同孔径实阵列的渐近等效性及算法的有效性。     

Detection of obstacles in the flight path of an aircraft

The National Aeronautics and Space Administration (NASA), along with members of the aircraft industry, recently developed technologies for a new supersonic aircraft. One of the technological areas considered for this aircraft is the use of video cameras and image-processing equipment to aid the pilot in detecting other aircraft in the sky. The detection techniques should provide high detection probability for obstacles that can vary from subpixel to a few pixels in size, while maintaining a low false alarm probability in the presence of noise and severe background clutter. Furthermore, the detection algorithms must be able to report such obstacles in a timely fashion, imposing severe constraints on their execution time. Approaches are described here to detect airborne obstacles on collision course and crossing trajectories in video images captured from an airborne aircraft. In both cases the approaches consist of an image-processing stage to identify possible obstacles followed by a tracking stage to distinguish between true obstacles and image clutter, based on their behavior. For collision course object detection, the image-processing stage uses morphological filter to remove large-sized clutter. To remove the remaining small-sized clutter, differences in the behavior of image translation and expansion of the corresponding features is used in the tracking stage. For crossing object detection, the image-processing stage uses low-stop filter and image differencing to separate stationary background clutter. The remaining clutter is removed in the tracking stage by assuming that the genuine object has a large signal strength, as well as a significant and consistent motion over a number of frames. The crossing object detection algorithm was implemented on a pipelined architecture from DataCube and runs in real time. Both algorithms have been successfully tested on flight tests conducted by NASA.     

On-line Vehicle Motion Estimation from Visual Terrain Information Part II: Ground Velocity and Position Estimation

An algorithm, combining velocity/height estimates, obtained from an airborne body fixed image shift estimator with auxiliary on-board measurements and sparsely stored terrain profile information constitutes an entirely passive autonomous navigation system suitable for moderate-g flight missions. Two versions are addressed. The "naive estimator," in which altitude estimates are multiplied by velocity/height estimaters, yields ground velocity. Position, obtained by integration, diverges with time. The "extended Kalman filter" (EKF) version, in which velocity and position are defined as state space components, locks on the stored terrain profile and does not diverge with time. It degenerates into the "naive estimator" if the terrain is completely flat. Numerical examples indicate excellent performance potential of the EKF estimator.     

分布式光电经纬仪测量系统信息传输设计

由于光电经纬仪测量系统中,测量摄影机越来越多地由高速电视所替代,信号传输在原来只有数据信息的基础上又增加了高速图像信息,从而使得信息传输量大大增加。就光电经纬仪测量系统中使用的导电环和经纬仪专用通讯系统接口在信息传输中的能力缺陷,分别寻找出多路空间互连光旋转连接器和光纤以太网的解决途径,为经纬仪的旋转平台和静止平台之间以及各经纬仪之间的信息传输,提出一种新的设计方案。     

Error analysis of combined optical-flow and stereo passive ranging

Optical-flow ranging in which the stream of two-dimensional images obtained from a forward-looking forward-moving passive sensor is used to compute range to points in the field of view, and triangulation based on stereo images obtained from at least two stationary sensors are combined. The potential accuracies of the combined optical flow and stereo passive-ranging system are analyzed in the context of helicopter nap-of-the-earth obstacle avoidance. The Cramer-Rao lower bound (CRLB) is developed for the combined system under the assumption of a random angular misalignment common to both cameras of a stereo pair. It is shown that the range accuracy degradations caused by misalignment are negligible compared to those for a monocular optical-flow system     

基于倾斜角的多目标测向无源定位技术

对多目标测向无源定位问题进行了研究。虽然无源观测站不同,针对同一目标的方位角和俯仰角数据也不同,但它们有共同的倾斜角。基于此,提出了基于倾斜角的多目标测向无源定位算法。该算法分别计算一组与多个目标对应的倾斜角,然后利用倾斜角最接近原则对这2组数据进行关联判断,解决多目标测向数据的关联和定位问题,并通过仿真实验,对算法的有效性和可行性进行了验证。     

A fusion and learning algorithm for landing aircraft tracking:compensating for exhaust plume disturbance

An algorithm is presented for tracking a landing aircraft using fusion of two different passive sensors, a laser range finder (LRF) and a forward-looking infrared (FLIR) camera. The main feature of this algorithm is its ability to identify and compensate for an exhaust plume disturbance. The algorithm is based on the extended Kalman filter (EKF) and the filtering confidence function (FCF) which introduces a learning approach to the tracking problem. The results of a simulation using the learning tracking algorithm and the EKF alone are presented and compared     

基于序贯关联算法的多目标无源跟踪

基于序贯关联算法,对多目标无源跟踪问题进行了研究。在只有角度信息可以利用的情况下,首先,利用波门技术对各个无源传感器角度测量数据进行关联和滤波,形成参数航迹;然后,将各个无源传感器的参数航迹送到融合中心进行关联配对,并在关联过程中通过构造关联质量函数对参数航迹的关联历史情况进行度量,解决参数航迹关联模糊问题;最后,通过对关联成功的参数航迹进行交叉定位,给出多个不同目标的位置信息,实现分布式无源系统对多目标的数据关联和跟踪,并通过仿真分析,对算法的有效性和可行性进行验证。     

The visible imaging system (VIS) for the polar spacecraft

The Visible Imaging System (VIS) is a set of three low-light-level cameras to be flown on the POLAR spacecraft of the Global Geospace Science (GGS) program which is an element of the International Solar-Terrestrial Physics (ISTP) campaign. Two of these cameras share primary and some secondary optics and are designed to provide images of the nighttime auroral oval at visible wavelengths. A third camera is used to monitor the directions of the fields-of-view of these sensitive auroral cameras with respect to sunlit Earth. The auroral emissions of interest include those from N ₂ ⁺ at 391.4 nm, Oi at 557.7 and 630.0 nm, Hi at 656.3 nm, and Oii at 732.0 nm. The two auroral cameras have different spatial resolutions. These resolutions are about 10 and 20 km from a spacecraft altitude of 8R _e . The time to acquire and telemeter a 256×256-pixel image is about 12 s. The primary scientific objectives of this imaging instrumentation, together with thein-situ observations from the ensemble of ISTP spacecraft, are (1) quantitative assessment of the dissipation of magnetospheric energy into the auroral ionosphere, (2) an instantaneous reference system for thein-situ measurements, (3) development of a substantial model for energy flow within the magnetosphere, (4) investigation of the topology of the magnetosphere, and (5) delineation of the responses of the magnetosphere to substorms and variable solar wind conditions.     

Adaptive suppression of passive intermodulation in digital satellite transceivers

For the performance issues of satellite transceivers suffering passive intermodulation interference,a novel and effective digital suppression algorithm is presented in this paper.In con trast to analog approaches,digital passive intermodulation (PIM) suppression approaches can be easily reconfigured and therefore are highly attractive for future satellite communication systems.A simplified model of nonlinear distortion from passive microwave devices is established in consid eration of the memory effect.The multiple high-order PIM products falling into the receiving band can be described as a bilinear predictor function.A suppression algorithm based on a bilinear poly nomial decorrelated adaptive filter is proposed for baseband digital signal processing.In consideration of the time-varying characteristics of passive intermodulation,this algorithm can achieve the rapidness of online interference estimation and low complexity with less consumption of resources.Numerical simulation results show that the algorithm can effectively compensate the passive intermodulation interference,and achieve a high signal-to-interference ratio gain.     

Security applications of computer vision

In an age which bears witness to a proliferation of Closed Circuit Television (CCTV) cameras for security and surveillance monitoring, the use of image processing and computer vision techniques which were provided as top end bespoke solutions can now be realised using desktop PC processing. Commercial Video Motion Detection (VMD) and Intelligent Scene Monitoring (ISM) systems are becoming increasingly sophisticated, aided, in no small way, by a technology transfer from previously exclusively military research sectors. Image processing is traditionally concerned with pre-processing operations such as Fourier filtering, edge detection and morphological operations. Computer vision extends the image processing paradigm to include understanding of scene content, tracking and object classification. Examples of computer vision applications include Automatic Number Plate Recognition (ANPR), people and vehicle tracking, crowd analysis and model based vision. Often image processing and computer vision techniques are developed with highly specific applications in mind and the goal of a more global understanding computer vision system remains, at least for now, outside the bounds of present technology. This paper will review some of the most recent developments in computer vision and image processing for challenging outdoor perimeter security applications. It also describes the efforts of development teams to integrate some of these advanced ideas into coherent prototype development systems     

传感器位置误差条件下仅用到达频率差的无源定位性能分析

传感器自身的位置误差对辐射源的无源定位精度可能有较大影响,详细分析并推导了在存在传感器位置误差条件下,仅使用到达频率差(FDOA)参数对辐射源定位时,定位精度的克拉美罗下限(CRLB)和均方误差(MSE).在传感器位置误差条件下,提出仅用FDOA来同时估计辐射源和传感器位置的泰勒级数方法,并证明该定位方法理论上的MSE...     

空中运动目标的识别和跟踪控制

针对空中运动目标的识别和跟踪,提出图像匹配算法和连通域算法相结合的方法。该方法主要用图像匹配算法获得目标的位置信息,当图像匹配算法失效时,则采用连通域算法重新捕获目标、获得图像模板。同时,为提高跟踪的实时性,采用最小二乘线性预测法来预测目标的运动轨迹。在实验室的目标跟踪系统平台上,该方法能够对运动目标进行稳定的识别和跟踪。