Deep Radar Sensor Models for Accurate and Robust Object Tracking

Jasmin Ebert, Thomas Gumpp, Sebastian Muenzner, Alex Matskevych, Alexandru Paul Condurache, Claudius Glaeser


Object tracking is one of the key challenges for perception systems of autonomous vehicles. Recursive Bayesian state estimation can be used to obtain object tracks. Both the measurement association and the object update within such Bayesian filters rely on sensor measurement models. These models offer an approximation of the expected sensor values that can be error-prone due to a mismatch between model and reality. The discrepancy is caused by the limited descriptive capacity of measurement models since sensor measurements are highly object and situation dependent. We address this problem in a data-driven approach by using Deep Neural Networks (DNNs) to learn situation dependent sensor measurement models. In detail, the DNN acts as a virtual sensor that uses current sensor measurements to regress necessary corrections of predicted object states. It can be directly plugged into existing tracking frameworks, substituting the previously hand-modeled association and update steps during Bayesian Filtering. We apply the proposed DNN-based measurement models to the problem of vehicle tracking using radar data in an Extended Kalman Filter setup and compare it to a classical closest reflex and an L-shape measurement update model. Extensive evaluation on a real-world dataset shows that our model improves performances significantly compared to state of the art methods.
Original languageEnglish
Title of host publication2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC)
Number of pages6
Publication date01.09.2020
ISBN (Print)978-1-7281-4150-3
ISBN (Electronic)978-1-7281-4149-7
Publication statusPublished - 01.09.2020
EventIEEE International Conference on Intelligent Transportation Systems 2020 - Virtual, Rhodes , Greece
Duration: 20.09.202023.09.2020


Dive into the research topics of 'Deep Radar Sensor Models for Accurate and Robust Object Tracking'. Together they form a unique fingerprint.

Cite this