You've been logged out of GDC Vault since the maximum users allowed for this account has been reached. To access Members Only content on GDC Vault, please log out of GDC Vault from the computer which last accessed this account.

Click here to find out about GDC Vault Membership options for more users.

close

Session Name:

Powering a Cognitive Assistant for the Blind Using AR

Overview:

Augmented reality can extend your cognitive abilities. Things that you cannot perceive can be brought within reach of your senses in real time. On that premise, speakers Yang Liu and Markus Meister from Caltech will present a cognitive assistant for blind persons based on the Microsoft HoloLens. The system identifies objects in the environment and gives them virtual voices, communicating maximally distilled knowledge in a way that is intuitive and natural to the human user. By interacting with these voices, the blind user gains all kinds of new abilities: from obstacle avoidance to formation and recall of spatial memories. With this technology, blind people can navigate an unfamiliar multi-story building on their first attempt, without any training. Liu and Meister will discuss the design principle behind the technology and argue that with the same principles, AR can power intelligent assistants that boost cognitive powers for everyone.

Did you know free users get access to 30% of content from the last 2 years?


Get your team full access to the most up to date GDC content

  • XRDC 2018
  • Yang Liu
  • Caltech
  • Markus Meister
  • Caltech
  • free content
  • Innovation
  • Virtual / Augmented Reality