Accessible Multimodal Tool Support for Brainstorming Meetings

Activity: Talk or presentationContributed talkscience-to-science

Description

In recent years, assistive technology and digital accessibility for blind and visually impaired people (BVIP) has been significantly improved. Yet, group discussions, especially in a business context, are still challenging as non-verbal communication (NVC) is often depicted on digital whiteboards, including deictic gestures paired with visual artifacts. However, as NVC heavily relies on the visual perception, whichrepresents a large amount of detail, an adaptive approach is required that identifies the most relevant information for BVIP. Additionally, visual artifacts usually rely on spatial properties such as position, orientation, and dimensions to convey essential information such as hierarchy, cohesion, and importance that is often not accessible to the BVIP. In this paper, we investigate the requirements of BVIP during brainstorming sessions and, based on our findings, provide an accessible multimodal tool that uses non-verbal and spatial cues as an additional layer of information. Further, we contribute by presenting a set of input and output modalities that encode and decode information with respect to the individual demands of BVIP and the requirements of different use cases.
Period11 Sept 2020
Event title17th International Conference on Computers Helping People with Special Needs
Event typeConference
LocationAustriaShow on map

Fields of science

  • 502007 E-commerce
  • 509002 Disability studies
  • 102027 Web engineering
  • 302027 Hearing, voice and language disorders
  • 202004 Brain-computer interface
  • 503008 E-learning
  • 102 Computer Sciences
  • 602013 Sign language research
  • 506002 E-government
  • 211902 Assistive technologies
  • 102022 Software development
  • 102021 Pervasive computing
  • 102013 Human-computer interaction
  • 102024 Usability research
  • 102015 Information systems
  • 102026 Virtual reality
  • 102014 Information design
  • 102036 Digital accessibility

JKU Focus areas

  • Digital Transformation
  • Sustainable Development: Responsible Technologies and Management