Evaluation of a Scale to Assess Subjective Information Processing Awareness of Humans in Interaction with Automation Artificial Intelligence

Subjective Information Processing Awareness (SIPA) describes how users experience the extent to which a system enables them to perceive, understand and predict its information processing. With the rising interdependence of information processing in Human-AI interaction, research methods for assessing user experience in automated information processing are needed. The objective of the present research was the empirical evaluation of the SIPA scale as an economical method to assess SIPA, as well as the construction of and comparison with a version in plain language. To this end, two empirical studies were conducted (NS1= 317, NS2 = 230) to enable scale analysis. Results showed that the SIPA scale achieves excellent reliability and expected correlations with connected constructs, e.g., trust and perceived usefulness of AI systems. In addition, no benefits of a plain language variant were found. Based on the results, the SIPA scale appears to be a promising tool for examining user experience of systems with automated information processing.