Highly Accurate and Memory Efficient Unsupervised Learning-Based Discrete CT Registration Using 2.5D Displacement Search

Mattias P. Heinrich*, Lasse Hansen

*Corresponding author for this work


Learning-based registration, in particular unsupervised approaches that use a deep network to predict a displacement field that minimise a conventional similarity metric, has gained huge interest within the last two years. It has, however, not yet reached the high accuracy of specialised conventional algorithms for estimating large 3D deformations. Employing a dense set of discrete displacements (in a so-called correlation layer) has shown great success in learning 2D optical flow estimation, cf. FlowNet and PWC-Net, but comes at excessive memory requirements when extended to 3D medical registration. We propose a highly accurate unsupervised learning framework for 3D abdominal CT registration that uses a discrete displacement layer and a contrast-invariant metric (MIND descriptors) that is evaluated in a probabilistic fashion. We realise a substantial reduction in memory and computational demand by iteratively subdividing the 3D search space into orthogonal planes. In our experimental validation on inter-subject deformable 3D registration, we demonstrate substantial improvements in accuracy (at least ≈ 10% points Dice) compared to widely used conventional methods (ANTs SyN, NiftyReg, IRTK) and state-of-the-art U-Net based learning methods (VoxelMorph). We reduce the search space 5-fold, speed-up the run-time twice and are on-par in terms of accuracy with a fully 3D discrete network.

Original languageEnglish
Title of host publicationMICCAI 2020: Medical Image Computing and Computer Assisted Intervention – MICCAI 2020
EditorsAnne L. Martel, Purang Abolmaesumi, Danail Stoyanov, Diana Mateus, Maria A. Zuluaga, S. Kevin Zhou, Daniel Racoceanu, Leo Joskowicz
Number of pages11
Volume12263 LNCS
PublisherSpringer, Cham
Publication date29.09.2020
ISBN (Print)978-3-030-59715-3
ISBN (Electronic)978-3-030-59716-0
Publication statusPublished - 29.09.2020
Event23rd International Conference on Medical Image Computing and Computer-Assisted Intervention - Lima, Peru
Duration: 04.10.202008.10.2020
Conference number: 249659


Dive into the research topics of 'Highly Accurate and Memory Efficient Unsupervised Learning-Based Discrete CT Registration Using 2.5D Displacement Search'. Together they form a unique fingerprint.

Cite this