ISEA 2011 paper: Eye Gaze as a Vehicle for Aesthetic Interaction: Affective Visualisation for Immersive User Experience by Brigitta Zics
Go to ISEA 2011 Panel: Data Visualisation: Practice and Aesthetics Go to ISEA 2011 Author Profile
This paper will explore potential applications of aesthetic interaction with a particular perspective on emerging technologies that is inclusive of the user’s cognitive properties. It investigates the philosophical concept of affection which in this paper will be described as the interplay between technological effect and affective human response. This paper argues that understanding such an interrelationship between technological effect and affective responses implies an enhanced affective intelligence of the system with a potential control of the user’s immersive experience.
In this investigation affection is applied through aesthetic interaction. This implies that there is a semantic framework developed that is based on the affective capacity of audiovisual elements (or “meta-meaning” ) rather than other coded references. As such the designer of such an affective system uses the semantics of technological effect to anticipate affective responses of the user in order to trigger the cognitive state of immersion. Such immersive experiences will be referred to here as a cognitive flow of the user with productive and potentially novel states of consciousness.
Applying the concept of affection in practice, the paper introduces the affective visualisation of “Mind Cupola” which applies eye tracking technology to evaluate and respond to the changes in the cognitive profile of the person. The paper highlights the development process of this affective visualisation and explains the technological aspects of the cognitively inclusive interaction design. It provides a conceptual overview of the interaction architecture including the system flow of the stages of ” limbo”, “meditative”, “chaos”, “eye-message board” and “golden state – nirvana”. It describes how eye tracking facilitates an aesthetic interaction through direct feedback and indirect effects to guide its user toward a productive immersive state. The paper concludes with the evaluation of this affective system regarding the concept of affection and how users reflected on the degree of immersion and their quality of experiences.
International Symposium of Electronic Art
ISEA 2011 Istanbul
September 14, 2011 – September 21, 2011