Automatic Assistance to Cognitive Disabled Web Users via Reinforcement Learning on the Browser

  • Tomas Murillo Morales (Speaker)

Activity: Talk or presentationContributed talkscience-to-science

Description

This paper introduces a proof of concept software reasoner that aims to detect whether an individual user is in need of cognitive assistance during a typical Web browsing session. The implemented reasoner is part of the Easy Reading browser extension for Firefox. It aims to infer the user’s current cognitive state by collecting and analyzing user’s physiological data in real time, such as eye tracking, heart beat rate and variability, and blink rate. In addition, when the reasoner determines that the user is in need of help it automatically triggers a support tool appropriate for the individual user and Web content being consumed. By framing the problem as a Markov Decision Process, typical policy control methods found in the Reinforcement Learning literature, such as Q-learning, can be employed to tackle the learning problem.
Period10 Sept 2020
Event titleunbekannt/unknown
Event typeConference
LocationAustriaShow on map

Fields of science

  • 502007 E-commerce
  • 509002 Disability studies
  • 102027 Web engineering
  • 302027 Hearing, voice and language disorders
  • 202004 Brain-computer interface
  • 503008 E-learning
  • 102 Computer Sciences
  • 602013 Sign language research
  • 506002 E-government
  • 211902 Assistive technologies
  • 102022 Software development
  • 102021 Pervasive computing
  • 102013 Human-computer interaction
  • 102024 Usability research
  • 102015 Information systems
  • 102026 Virtual reality
  • 102014 Information design
  • 102036 Digital accessibility

JKU Focus areas

  • Digital Transformation
  • Sustainable Development: Responsible Technologies and Management