Probabilistic image-based rendering with Gaussian mixture model

Wenfeng Li, Baoxin Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations


One major challenge in traditional image-based rendering is 3D scene reconstruction by estimating accurate dense depth map, which suffers from the ambiguities in textureless or periodically textured regions. Alternatively, statistical methods may be used to estimate a most likely color for each pixel for photorealistic rendering from multiple views of the same scene. Such statistical methods normally require a relatively large number of input images to achieve reasonable quality for the synthesized image, if the estimation is purely nonparametric. In this paper, based on some reasonable assumptions on the configuration of the multiple views, we propose to use a two-component Gaussian mixture model for the appearance of a given pixel in all the views so that both the problem of occlusion and the problem of noise can be considered simultaneously. Then we use the Expectation-Maximization algorithm to estimate the model parameters. The virtual pixel is given as a maximum likelihood estimate for one of the mixture components. Experiments shows that reasonable performance can be obtained even with only a few input images.

Original languageEnglish (US)
Title of host publicationProceedings - 18th International Conference on Pattern Recognition, ICPR 2006
Number of pages4
StatePublished - Dec 1 2006
Event18th International Conference on Pattern Recognition, ICPR 2006 - Hong Kong, China
Duration: Aug 20 2006Aug 24 2006

Publication series

NameProceedings - International Conference on Pattern Recognition
ISSN (Print)1051-4651


Other18th International Conference on Pattern Recognition, ICPR 2006
CityHong Kong

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition


Dive into the research topics of 'Probabilistic image-based rendering with Gaussian mixture model'. Together they form a unique fingerprint.

Cite this