Video-based analysis of motion skills in simulation-based surgical training

Qiang Zhang, Lin Chen, Qiongjie Tian, Baoxin Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Scopus citations


Analysis of motion expertise is an important problem in many domains including sports and surgery. In recent years, surgical simulation has emerged at the forefront of new technologies for improving the education and training of surgical residents. In simulation-based surgical training, a key task is to rate the performance of the operators, which is done currently by senior surgeons. This paper introduces a novel solution to this problem through employing vision-based techniques. We develop an automatic, video-based approach to analyzing the motion skills of a surgeon in simulation-based surgical training, where a surgical action is captured by multiple video cameras with little or no calibration, resulting in multiple video streams of heterogeneous properties. Typical multiple-view vision techniques are inadequate for processing such data. We propose a novel approach that employs both canonical correlation analysis (CCA) and the bag-of-words model to classify the expertise level of the subject based on the heterogeneous video streams capturing both the motion of the subject's hands and the resultant motion of the tools. Experiments were designed and performed to validate the proposed approach using realistic data captured from resident surgeons in local hospitals. The results suggest that the proposed approach may provide a promising practical solution to the real world problem evaluating motion skills in simulation-based surgical training.

Original languageEnglish (US)
Title of host publicationProceedings of SPIE-IS and T Electronic Imaging - Multimedia Content and Mobile Devices
StatePublished - 2013
EventMultimedia Content and Mobile Devices - Burlingame, CA, United States
Duration: Feb 4 2013Feb 6 2013

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
ISSN (Print)0277-786X


OtherMultimedia Content and Mobile Devices
Country/TerritoryUnited States
CityBurlingame, CA


  • Canonical correlation analysis
  • Motion skill analysis
  • Multi-view video analysis
  • Surgical simulation

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'Video-based analysis of motion skills in simulation-based surgical training'. Together they form a unique fingerprint.

Cite this