|Missile Route Planning using Image based GPS Localization
|Collaborators: Fahd Rafi, Saad M. Khan|
- Algorithmic Steps
- Related Links
Currently, most cruise missiles use terrain reference navigation
for aided INS (Inertial Navigation System). In this approach, the
terrain information of a pre-determined area is digitized and is saved
in a database. During the mission planning the targeteer defines a
special trajectory for the missile to follow in order to hit the target.
During the missile flight, the Radar Terrain Sensor (RTS) and Reference
Altitude Sensor (RAS) on the missile can provide an accurate information
for its current position and attitude. With the help of terrain contour
matching algorithm, the differential correction is computed to control
the flying missile. Upon reaching close to the target, the missile
switches to a terminal guidance system to choose the point of impact.
The point of impact is often pre-programmed by the GPS. In case of
moving targets, a Digital Scene Matching Area Correlation module is
used to find the target in the images obtained by the on-board camera.
In this project, we explored the possibility of using image based
approach to geo-locate the missile in the absence of GPS information.
Such a situation often arises when the GPS signal is disabled through
a deployment of GPS jammers. The proposed approach is based on the
method developed for `Where am I - ICCV 2005' challenge contest. The
approach requires a number of reference images (with known GPS locations), using which our approach will be able
to locate the GPS of the current image transmitted by the on-board
In this section, for the sake of completion, we describe the algorithm for geo-locating the missile. For a detailed description of the algorithm, see the
Related Links section at the bottom of the page. The steps are:
- Find feature correspondence between the image obtained from the on-board camera, and the reference images
using the SIFT matching algorithm. Pick two reference images that return the highest number of matches.
- Find the image triplet (two reference images and image from the on-board camera) that has the best pair-wise matching among all groups of reference images.
- Using the computed correspondences, find the fundamental matrices between each pair of three images.
- Given three fundamental matrices, compute the internal parameters K of the camera and corresponding essential matrices.
- Apply Homography test for the image pairs to test for zero translation case.
- Apply triangulation to image triplets (two reference images and
one current image) to recover the GPS.
The algorithm is tested in a simulation setting. A collection of images (1000) is used to construct the scenario.
These images were taken at the UCF campus, and their distribution over the testing area is shown in the figure. Few of these
images were marked as the reference images. The trajectory of the missile is simulated by selecting the start location and
the target location (GPS). The missile is then steered through the testing area by computing the GPS at each time instant, and making
the missile to move in the direction that minimizes the distance to the target. A sanpshot of the simulation software, developed in Matlab,
is shown in the figure.
Distribution of the complete collection of images over the testing site.
2005 Challenge Contest - Where Am I
Hakeem, Roberto Vezzani, Mubarak Shah, and Rita Cucchiara, Estimating
Geospatial Trajectory of a Moving Camera, ICPR 2006.