An application of embedology to spatio-temporal pattern recognition

The theory of embedded time series is shown applicable for determining a reasonable lower bound on the length of test sequence required for accurate classification of moving objects. Sequentially recorded feature vectors of a moving object form a training trajectory in feature space. Each of the sequences of feature vector components is a time series, and under certain conditions, each of these time series has approximately the same fractal dimension. The embedding theorem may be applied to this fractal dimension to establish a sufficient number of observations to determine the feature space trajectory of the object. It is argued that this number is a reasonable lower bound on test sequence length for use in object classification. Experiments with data corresponding to five military vehicles (observed following a projected Lorenz trajectory on a viewing sphere) show that this bound is indeed adequate     

Spatio-temporal pattern recognition using hidden Markov models

A spatio-temporal method for identifying objects contained in an image sequence is presented. The Hidden Markov Model (HMM) technique is used as the classification algorithm, making classification decisions based on a spatio-temporal sequence of observed object features. A five class problem is considered. Classification accuracies of 100% and 99.7%, are obtained for sequences of images generated over two separate regions of viewing positions. HMMs trained on image sequences of the objects moving in opposite directions showed a 98.1% successful classification rate by class and direction of movement. The HMM technique proved robust to image corruption with additive correlated noise and had a higher accuracy than a single-look nearest neighbor method. A real image sequence of one of the objects used was successfully recognized with the HMMs trained on synthetic data. This study shows the temporal changes that observed feature vectors undergo due to object motion hold information that can yield superior classification accuracy when compared with single-frame techniques