Deep learning based CT-CBCT image registration for adaptive radio therapy

Sven Kuckertz, Nils Papenberg, Jonas Honegger, Tomasz Morgas, Benjamin Haas, Stefan Heldmann


While deep learning based methods for medical deformable image registration have recently shown significant advances in both speed and accuracy, methods for use in radio therapy are still rarely proposed due to several challenges such as low contrast and artifacts in cone beam CT (CBCT) images or extreme deformations. The aim of image registration in radio therapy is to align a baseline CT and low-dose CBCT images, which allows contours to be propagated and applied doses to be tracked over time. To this end, we present a novel deep learning method for multi-modal deformable CT-CBCT registration. We train a CNN in weakly supervised manner, aiming to optimize an edge-based image similarity and a deformation regularizer including a penalty for local changes of topology and foldings. Additionally, we measure the alignment of given segmentations, facing the problem of extreme deformations. Our method receives only CT and a CBCT images as input and uses ground-truth segmentations exclusively during training. Furthermore, our method is not dependent on the availability of difficult to access ground-truth deformation vector fields. We train and evaluate our method on follow-up image pairs of the pelvis and compare our results to conventional iterative registration algorithms. Our experiments show that the registration accuracy of our deep learning based approach is superior to iterative registration without additional guidance by segmentations and nearly as good as iterative structure guided registration that requires ground-truth segmentations. Furthermore, our deep learning based method runs approximately 100 times faster than the iterative methods.

Original languageEnglish
Title of host publicationMedical Imaging 2020: Image Processing
EditorsIvana Išgum, Bennett A. Landman
Number of pages6
Publication date10.03.2020
Article number2549531
ISBN (Print)978-151063393-3
Publication statusPublished - 10.03.2020
EventMedical Imaging 2020: Image-Guided Procedures, Robotic Interventions, and Modeling - Houston, United States
Duration: 16.02.202019.02.2020
Conference number: 159792


Dive into the research topics of 'Deep learning based CT-CBCT image registration for adaptive radio therapy'. Together they form a unique fingerprint.

Cite this