Synergism of binocular and motion stereo for passive ranging

Range measurements to objects in the world relative to mobile platforms such as ground or air vehicles are critical for visually aided navigation and obstacle detection/avoidance. An approach is presented that consists of a synergistic combination of two types of passive ranging method: binocular stereo and motion stereo. We show a new way to model the errors in binocular and motion stereo in conjunction with an inertial navigation system (INS) and derive the appropriate Kalman filter to refine the estimates from these two stereo ranging techniques. We present results using laboratory images that show that refined estimates can be optimally combined to give range values which are more accurate than any one of the individual estimates from binocular and motion stereo. By incorporating a blending filter, the approach has the potential of providing accurate, dense range measurements for all the pixels in the field of view (FOV)     

Model-based segmentation of FLIR images

The use of gray-scale intensities together with the edge information present in a forward-looking infrared (FLIR) image to obtain a precise and accurate segmentation of a target is presented. A model of FLIR images based on gray-scale and edge information is incorporated in a gradient relaxation technique which explicitly maximizes a criterion function based on the inconsistency and ambiguity of classification of pixels with respect to their neighbors. Four variations of the basic technique which provide automatic selection of thresholds to segment FLIR images are considered. These methods are compared, and several examples of segmentation of ship images are given     

A system for obstacle detection during rotorcraft low altitudeflight

An airborne vehicle such as a rotorcraft must avoid obstacles like antennas, towers, poles, fences, tree branches, and wires strung across the flight path. Automatic detection of the obstacles and generation of appropriate guidance and control actions for the vehicle to avoid these obstacles would facilitate autonomous navigation. The requirements of an obstacle detection system for rotorcraft in low-altitude Nap-of-the-Earth (NOE) flight based on various rotorcraft motion constraints is analyzed here in detail. It is argued that an automated obstacle detection system for the rotorcraft scenario should include both passive and active sensors to be effective. Consequently, it introduces a maximally passive system which involves the use of passive sensors (TV, FLIR) as well as the selective use of an active (laser) sensor. The passive component is concerned with estimating range using optical flow-based motion analysis and binocular stereo. The optical flow-based motion analysis that is combined with on-board inertial navigation system (INS) to compute ranges to visible scene points is described. Experimental results obtained using land vehicle data illustrate the particular approach to motion analysis     

Adaptive image segmentation using genetic and hybrid search methods

This paper describes an adaptive approach for the important image processing problem of image segmentation that relies on learning from experience to adapt and improve the segmentation performance. The adaptive image segmentation system incorporates a feedback loop consisting of a machine learning subsystem, an image segmentation algorithm, and an evaluation component which determines segmentation quality. The machine learning component is based on genetic adaptation and uses (separately) a pure genetic algorithm (GA) and a hybrid of GA and hill climbing (HC). When the learning subsystem is based on pure genetics, the corresponding evaluation component is based on a vector of evaluation criteria. For the hybrid case, the system employs a scalar evaluation measure which is a weighted combination of the different criteria. Experimental results for pure genetic and hybrid search methods are presented using a representative database of outdoor TV imagery. The multiobjective optimization demonstrates the ability of the adaptive image segmentation system to provide high quality segmentation results in a minimal number of generations     

Image understanding research for automatic target recognition

Automatic target recognition (ATR) is an important capability for defense applications. Many aspects of image understanding (IU) research are traditionally used to solve ATR problems. The authors discuss ATR applications and problems in developing real-world ATR systems and present the status of technology for these systems. They identify several IU problems that need to be resolved in order to enhance the effectiveness of ATR-based weapon systems. They conclude that technological gains in developing robust ATR systems will lead to significant advances in many other areas of applications of image understanding     

Predicting an upper bound on SAR ATR performance

We present a method for predicting a tight upper bound on performance of a vote-based approach for automatic target recognition (ATR) in synthetic aperture radar (SAR) images. In such an approach, each model target is represented by a set of SAR views, and both model and data views are represented by locations of scattering centers. The proposed method considers data distortion factors such as uncertainty, occlusion, and clutter, as well as model factors such as structural similarity. Firstly, we calculate a measure of the similarity between a given model view and each view in the model set, as a function of the relative transformation between them. Secondly we select a subset of possible erroneous hypotheses that correspond to peaks in similarity functions obtained in the first step. Thirdly, we determine an upper bound on the probability of correct recognition by computing the probability that every selected hypothesis gets less votes than those for the model view under consideration. The proposed method is validated using MSTAR public SAR data, which are obtained under different depression angles, configurations, and articulations     

Automatic Target Recognition: State of the Art Survey

In this paper a review of the techniques used to solve the automatic target recognition (ATR) problem is given. Emphasis is placed on algorithmic and implementation approaches. ATR algorithms such as target detection, segmentation, feature computation, classification, etc. are evaluated and several new quantitative criteria are presented. Evaluation approaches are discussed and various problems encountered in the evaluation of algorithms are addressed. Strategies used in the data base design are outlined. New techniques such as the use of contextual cues, semantic and structural information, hierarchical reasoning in the classification and incorporation of multisensors in ATR systems are also presented.