Codebook-based electrooculography data analysis towards cognitive activity recognition

P. Lagodzinski*, K. Shirahama, M. Grzegorzek

*Corresponding author for this work
1 Citation (Scopus)


With the advancement in mobile/wearable technology, people started to use a variety of sensing devices to track their daily activities as well as health and fitness conditions in order to improve the quality of life. This work addresses an idea of eye movement analysis, which due to the strong correlation with cognitive tasks can be successfully utilized in activity recognition. Eye movements are recorded using an electrooculographic (EOG) system built into the frames of glasses, which can be worn more unobtrusively and comfortably than other devices. Since the obtained information is low-level sensor data expressed as a sequence representing values in constant intervals (100 Hz), the cognitive activity recognition problem is formulated as sequence classification. However, it is unclear what kind of features are useful for accurate cognitive activity recognition. Thus, a machine learning algorithm like a codebook approach is applied, which instead of focusing on feature engineering is using a distribution of characteristic subsequences (codewords) to describe sequences of recorded EOG data, where the codewords are obtained by clustering a large number of subsequences. Further, statistical analysis of the codeword distribution results in discovering features which are characteristic to a certain activity class. Experimental results demonstrate good accuracy of the codebook-based cognitive activity recognition reflecting the effective usage of the codewords.

Original languageEnglish
JournalComputers in Biology and Medicine
Pages (from-to)277-287
Number of pages11
Publication statusPublished - 01.04.2018


Dive into the research topics of 'Codebook-based electrooculography data analysis towards cognitive activity recognition'. Together they form a unique fingerprint.

Cite this