Research Article
From GUI to AVUI: Situating Audiovisual User Interfaces Within Human-Computer Interaction and Related Fields
@ARTICLE{10.4108/eai.12-5-2021.169913, author={Nuno N. Correia and Atau Tanaka}, title={From GUI to AVUI: Situating Audiovisual User Interfaces Within Human-Computer Interaction and Related Fields}, journal={EAI Endorsed Transactions on Creative Technologies}, volume={8}, number={27}, publisher={EAI}, journal_a={CT}, year={2021}, month={5}, keywords={user interface, toolkit, interface builder, audiovisual, cross-modal interaction}, doi={10.4108/eai.12-5-2021.169913} }- Nuno N. Correia
Atau Tanaka
Year: 2021
From GUI to AVUI: Situating Audiovisual User Interfaces Within Human-Computer Interaction and Related Fields
CT
EAI
DOI: 10.4108/eai.12-5-2021.169913
Abstract
INTRODUCTION: We propose AudioVisual User Interfaces (AVUI), a novel type of UI linking interaction, sound and image. It extends the concept of Graphical User Interface (GUI) by adding interconnected sound and image.
OBJECTIVES: We aim to situate AVUIs in relation to identified relevant fields: Human-Computer Interaction (HCI), sonic interaction design, cognitive psychology and audiovisual art, and to identify benefits of AVUIs inthe context of those fields.
METHODS: In this research, we combine literature review of related concepts with a user-centered design methodology, involving a community of audiovisual artists and performers.
RESULTS: We contextualize AVUI within the identified fields and identify benefits for the implementation of AVUIs in relation to those fields.
CONCLUSION: These results can contribute to the further adoption of AVUIs by the HCI community, particularly those interested in multisensory experience involving sound and image.
Copyright © 2021 N. N. Correia et al., licensed to EAI. This is an open access article distributed under the terms of the Creative Commons Attribution license, which permits unlimited use, distribution and reproduction in any medium so long as the original work is properly cited.