TY - GEN
T1 - Synchronizing disparate video streams from laparoscopic operations in simulation-based surgical training
AU - Wang, Zheshen
AU - Li, Baoxin
PY - 2010
Y1 - 2010
N2 - In this paper, we propose a novel approach for synchronizing multiple videos captured from common laparoscopic operations in simulation-based surgical training. The disparate video sources include two hand-view sequences and one tool-view sequence that does not contain any visual overlap with the hand views. The synchronization of the video is essential for further visual analysis tasks. To the best of our knowledge, there is no prior work dealing with synchronization of completely different visual streams capturing different aspects of the same physical event. In the proposed approach, histograms of dominant motion (HoDM) are extracted and used as features for each frame. Multi-view sequence correlation (MSC), computed as accumulated products of pairwise correlations of HoDM magnitudes and co-occurrence rate of pairwise HoDM orientation patterns, is proposed for ranking possible configurations of temporal alignment. The final relative shifts for synchronizing the videos are determined by maximizing both the overlap length of all sequences and the MSC scores through a coarse-to-fine search procedure. Experiments were performed on 41 groups of videos of two laparoscopic operations, and the performance was compared to start-of-the-art method, demonstrating the effectiveness of the proposed approach.
AB - In this paper, we propose a novel approach for synchronizing multiple videos captured from common laparoscopic operations in simulation-based surgical training. The disparate video sources include two hand-view sequences and one tool-view sequence that does not contain any visual overlap with the hand views. The synchronization of the video is essential for further visual analysis tasks. To the best of our knowledge, there is no prior work dealing with synchronization of completely different visual streams capturing different aspects of the same physical event. In the proposed approach, histograms of dominant motion (HoDM) are extracted and used as features for each frame. Multi-view sequence correlation (MSC), computed as accumulated products of pairwise correlations of HoDM magnitudes and co-occurrence rate of pairwise HoDM orientation patterns, is proposed for ranking possible configurations of temporal alignment. The final relative shifts for synchronizing the videos are determined by maximizing both the overlap length of all sequences and the MSC scores through a coarse-to-fine search procedure. Experiments were performed on 41 groups of videos of two laparoscopic operations, and the performance was compared to start-of-the-art method, demonstrating the effectiveness of the proposed approach.
UR - http://www.scopus.com/inward/record.url?scp=79956271929&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=79956271929&partnerID=8YFLogxK
U2 - 10.1109/AIPR.2010.5759691
DO - 10.1109/AIPR.2010.5759691
M3 - Conference contribution
AN - SCOPUS:79956271929
SN - 9781424488339
T3 - Proceedings - Applied Imagery Pattern Recognition Workshop
BT - 2010 IEEE 39th Applied Imagery Pattern Recognition Workshop, AIPR 2010
T2 - 2010 IEEE 39th Applied Imagery Pattern Recognition Workshop, AIPR 2010
Y2 - 13 October 2010 through 15 October 2010
ER -