Influence of Video-Preprocessing on Deep Learning-based Surgical Skill Assessment

Georg Wolf*, Paulina Amelie Geck, Jannis Hagenah, Georg Maennel, Tobias Keck, Philipp Rostalski, Svenja Ipsen, Tobias Keck

*Korrespondierende/r Autor/-in für diese Arbeit


Automatic surgical skill assessment in robotic surgery based on video data is essential in facilitating faster learning curves for trainees while relieving expert surgeons from the time- and cost-intensive feedback process. Recent years have shown several advancements in this area by utilizing deep learning. While current research focuses on novel architectures, the influence of video-preprocessing on their performance remains unknown. In this work, we present the first investigation on the influence of video-preprocessing on deep learning-based surgical skill assessment. Thus, we integrated four preprocessing modules, i.e. Deblurring, Segmentbased Sampling, Optical Flow and the Combination of all of them, into skill assessment on the JIGSAWS dataset using a well-established network architecture. Despite all single preprocessing steps showing no clear improvement, the Combination of all steps showed higher median performance and lower variance. Furthermore, we performed frame-wise investigations on the influence of optical flow artifacts and their reduction in the combined setting. Our results highlight the potential of well-calibrated video-preprocessing for automatic surgical skill assessment.

ZeitschriftCurrent Directions in Biomedical Engineering
Seiten (von - bis)21-24
PublikationsstatusVeröffentlicht - 01.09.2023

Strategische Forschungsbereiche und Zentren

  • Forschungsschwerpunkt: Biomedizintechnik
  • Querschnittsbereich: Intelligente Systeme
  • Zentren: Zentrum für Künstliche Intelligenz Lübeck (ZKIL)


  • 205-25 Allgemein- und Viszeralchirurgie
  • 205-32 Medizinische Physik, Biomedizinische Technik