CHI2021: One paper, one workshop
In this year’s ACM SIGHI Conference, 2021, we will contribute on full paper and one workshop
Paper: Feeling Colours: Crossmodal Correspondences Between Tangible 3D Objects, Colours and Emotions, Lin, A., Scheller, M., Feng, F., Proulx, M. J., & Metatla, O.
Abstract: With increasing interest in multisensory experiences in HCI there is a need to consider the potential impact of crossmodal correspondences (CCs) between sensory modalities on perception and interpretation. We investigated CCs between active haptic expe- riences of tangible 3D objects, visual colour and emotion using the “Bouba/Kiki” paradigm. We asked 30 participants to assign colours and emotional categories to 3D-printed objects with vary- ing degrees of angularity and complexity. We found tendencies to associate high degrees of complexity and angularity with red colours, low brightness and high arousal levels. Less complex round shapes were associated with blue colours, high brightness and pos- itive valence levels. These fndings contrast previously reported crossmodal efects triggered by 2D shapes of similar angularity and complexity, suggesting that designers cannot simply extrapolate potential perceptual and interpretive experiences elicited by 2D shapes to seemingly similar 3D tangible objects. Instead, we pro- pose a design space for creating tangible multisensory artefacts that can trigger specifc emotional percepts and discuss implications for exploiting CCs in the design of interactive technology.
Workshop: Rethinking the Senses: A Workshop on Multisensory Embodied Experiences and Disability Interactions. Maryam Bandukda, Aneesha Singh, Catherine Holloway, Nadia Berthouze, Emeline Brulé, Ana Tajadura-Jiménez, Oussama Metatla, Ana Javornik, Anja Thieme
Abstract: The emerging possibilities of multisensory interactions provide an exciting space for disability and open up opportunities to explore new experiences for perceiving one’s own body, it’s interactions with the environment and also to explore the environment itself. In addition, dynamic aspects of living with disability, life transitions, including ageing, psychological distress, long-term conditions such as chronic pain and new conditions such as long-COVID further affect people’s abilities. Interactions with this diversity of embodiments can be enriched, empowered and augmented through using multisensory and cross-sensory modalities to create more inclusive technologies and experiences. To explore this, in this workshop we will explore three related sub-domains: immersive multi-sensory experiences, embodied experiences, and disability interactions and design. The aim is to better understand how we can re-think the senses in technology design for disability interactions and the dynamic self, constructed through continuously changing sensing capabilities either because of changing ability or because of the empowering technology. This workshop will: (i) bring together HCI researchers from different areas, (ii) discuss tools, frameworks and methods, and (iii) form a multidisciplinary community to build synergies for further collaboration.