Intrinsic Dimensionality Predicts the Saliency of Natural Dynamic Scenes

Eleonora Vig, Michael Dorr, Thomas Martinetz, Erhardt Barth

Abstract

Since visual attention-based computer vision applications have gained popularity, ever more complex, biologically inspired models seem to be needed to predict salient locations (or interest points) in naturalistic scenes. In this paper, we explore how far one can go in predicting eye movements by using only basic signal processing, such as image representations derived from efficient coding principles, and machine learning. To this end, we gradually increase the complexity of a model from simple single-scale saliency maps computed on grayscale videos to spatiotemporal multiscale and multispectral representations. Using a large collection of eye movements on high-resolution videos, supervised learning techniques fine-tune the free parameters whose addition is inevitable with increasing complexity. The proposed model, although very simple, demonstrates significant improvement in predicting salient locations in naturalistic videos over four selected baseline models and two distinct data labeling scenarios.
Original languageEnglish
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume34
Issue number6
Pages (from-to)1080-1091
Number of pages12
ISSN0162-8828
DOIs
Publication statusPublished - 06.2012

Fingerprint

Dive into the research topics of 'Intrinsic Dimensionality Predicts the Saliency of Natural Dynamic Scenes'. Together they form a unique fingerprint.

Cite this