Real-time video mosaicking robust to dynamic scenes

Nan Jiang, Glen Abousleman, Jennie Si

Research output: Chapter in Book/Report/Conference proceedingConference contribution


This paper presents a system for creating a mosaic image from a sequence of images with moving objects present in the scene. This system first uses SIFT-based image registration on the entire image to obtain the initial global projection matrix. After image segmentation, the global motion model is applied to each region for evaluation. The transformation matrix is refined for best projection in each region, and a more precise global transformation matrix is calculated based upon local projections on majority of coherent regions. As a consequence this method is robust to disturbances to the projection model induced by moving objects and motion parallax. In the image blending stage, pixels in coherent regions are weighted by their distances from the overlapping edges to achieve a seamless panorama, while heterogeneous regions are cut and pasted to avoid ghosting or blurring. The most recent information regarding location, shape, and size of the moving foreground objects is therefore reflected in the panorama. Constructed mosaics are presented to demonstrate the performance and robustness of the proposed algorithm.

Original languageEnglish (US)
Title of host publicationAirborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications III
StatePublished - Aug 29 2006
EventAirborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications III - Kissimmee, FL, United States
Duration: Apr 19 2006Apr 20 2006

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
ISSN (Print)0277-786X


OtherAirborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications III
Country/TerritoryUnited States
CityKissimmee, FL


  • Feature points
  • Image registration
  • Video mosaic

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'Real-time video mosaicking robust to dynamic scenes'. Together they form a unique fingerprint.

Cite this