TY - GEN
T1 - Virtual view specification and synthesis in free viewpoint television application
AU - Li, Wenfeng
AU - Zhou, Jin
AU - Li, Baoxin
AU - Sezan, M. Ibrahim
PY - 2006
Y1 - 2006
N2 - In conventional TV, users can get only a single view of a real 3D world. The view is determined not by a user but by the camera position during acquisition. Free viewpoint television (FTV) is a new concept which aims at giving viewers the flexibility to select a novel viewpoint by employing multiple video streams as the input. Current proposed solutions for FTV include those based on ray-space sampling and interpolation. Most existing work makes the assumption that the cameras are calibrated. Moreover, virtual view specification is done in ways that would not be practical for actual use (e.g., some methods specify the virtual view by a rotation matrix and a translation vector). This paper proposes a framework for FTV based on image-based rendering, complete with key algorithms for color-based segmentation and correspondence, and multiple-image-based virtual view synthesis from uncalibrated cameras. Moreover, we propose an intuitive approach to specifying the virtual viewpoint, based on any two views chosen by the user. This makes the specification of the virtual view very intuitive and thus practical for the FTV application. Experiments with real video streams were performed to validate the proposed approaches.
AB - In conventional TV, users can get only a single view of a real 3D world. The view is determined not by a user but by the camera position during acquisition. Free viewpoint television (FTV) is a new concept which aims at giving viewers the flexibility to select a novel viewpoint by employing multiple video streams as the input. Current proposed solutions for FTV include those based on ray-space sampling and interpolation. Most existing work makes the assumption that the cameras are calibrated. Moreover, virtual view specification is done in ways that would not be practical for actual use (e.g., some methods specify the virtual view by a rotation matrix and a translation vector). This paper proposes a framework for FTV based on image-based rendering, complete with key algorithms for color-based segmentation and correspondence, and multiple-image-based virtual view synthesis from uncalibrated cameras. Moreover, we propose an intuitive approach to specifying the virtual viewpoint, based on any two views chosen by the user. This makes the specification of the virtual view very intuitive and thus practical for the FTV application. Experiments with real video streams were performed to validate the proposed approaches.
UR - http://www.scopus.com/inward/record.url?scp=47249133376&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=47249133376&partnerID=8YFLogxK
U2 - 10.1109/3DPVT.2006.145
DO - 10.1109/3DPVT.2006.145
M3 - Conference contribution
AN - SCOPUS:47249133376
SN - 0769528252
SN - 9780769528250
T3 - Proceedings - Third International Symposium on 3D Data Processing, Visualization, and Transmission, 3DPVT 2006
SP - 464
EP - 471
BT - Proceedings - 3rd International Symposium on 3D Data Processing, Visualization, and Transmission, 3DPVT 2006
PB - IEEE Computer Society
T2 - 3rd International Symposium on 3D Data Processing, Visualization, and Transmission, 3DPVT 2006
Y2 - 14 June 2006 through 16 June 2006
ER -