Contribution of Spatio-Temporal Intensity Variation to Bottom-up Saliency

Eleonora Vig, Michael Dorr, Erhardt Barth


We investigate the contribution of local spatio-temporal variation of image intensity to saliency. To measure different types of variation, we use the geometrical invariants of the structure tensor. With a video represented in spatial axes x and y and temporal axis t, the n-dimensional structure tensor can be evaluated for different combinations of axes (2D and 3D) and also for the (degenerate) case of only one axis. The resulting features are evaluated on several spatio-temporal scales in terms of how well they can predict eye movements on complex videos. We find that a 3D structure tensor is optimal: the most predictive regions of a movie are those where intensity changes along all spatial and temporal directions. Among two-dimensional variations, the axis pair yt, which is sensitive to horizontal translation, outperforms xy and xt by a large margin, and is even superior in prediction to two baseline models of bottom-up saliency.
Original languageEnglish
Title of host publicationBio-Inspired Models of Network, Information, and Computing Systems
EditorsJ Suzuki, T Nakano
Number of pages6
PublisherSpringer Verlag
Publication date2012
ISBN (Print)978-3-642-32614-1
ISBN (Electronic)978-3-642-32615-8
Publication statusPublished - 2012
Event5th International ICST Conference, BIONETICS 2010 - Boston, United States
Duration: 01.12.201203.12.2012


Dive into the research topics of 'Contribution of Spatio-Temporal Intensity Variation to Bottom-up Saliency'. Together they form a unique fingerprint.

Cite this