Category: Publications

[C] CHI2019 Paper: “Like Popcorn”: Crossmodal Correspondences Between Scents, 3D Shapes and Emotions in Children

Abstract There is increasing interest in multisensory experiences in HCI. However, little research considers how sensory modalities interact with each other and how this may impact interactive experiences. We investigate how children associate emotions with scents and 3D shapes. 14 participants (10-17yrs) completed crossmodal association tasks to attribute emotional characteristics...

[C] CHI2019 Paper: Voice User Interfaces in Schools: Co-designing for Inclusion With Visually-Impaired and Sighted Pupils

Abstract: Voice user interfaces (VUIs) are increasingly popular, particularly in homes. However, little research has investigated their potential in other settings, such as schools. We investigated how VUIs could support inclusive education, particularly for pupils with visual impairments (VIs). We organised focused discussions with educators at a school, with support...

[MAG] ACM Interactions: Toward Classroom Experiences Inclusive of Students with Disabilities

More than ever, digital content and tools are being introduced and accepted in diverse educational contexts, offering opportunities for innovation and for making learning processes more encompassing, engaging, and collaborative. Multimodal tools fostering tactile, auditory, and spatial learning promise increased access for students with vision impairments (VI). Yet many existing popular...

[J] Science Advances: Sampling molecular conformations and dynamics in a multiuser virtual reality framework

Abstract:We describe a framework for interactive molecular dynamics in a multiuser virtual reality (VR) environment, combining rigorous cloud-mounted atomistic physics simulations with commodity VR hardware, which we have made accessible to readers (see isci.itch.io/nsb-imd). It allows users to visualize and sample, with atomic-level precision, the structures and dynamics of complex molecular...

[LBW] CHI2018 EA: An Initial Investigation into Non-visual Code Structure Overview Through Speech, Non-speech and Spearcons

Abstract: We investigate a novel, non-visual approach to overviewing object-oriented source code and evaluate the efficiency of different categories of sounds for the purpose of getting an overview of source code structure for a visually-impaired computer programmer. A user-study with ten sighted and three non-sighted participants compared the effectiveness of speech,...