Microsoft Research Webinar Series
Designing Computer Vision Algorithms to Describe the Visual World to People Who Are Blind or Low Vision
A common goal in computer vision research is to build machines that can replicate the human vision system (for example, detect an object or scene category, describe an object or scene, or locate an object). A natural grand challenge for the artificial intelligence community is to design such technology to assist people who are blind to overcome their real daily visual challenges.
In this webinar with Dr. Danna Gurari, Assistant Professor in the School of Information at University of Texas at Austin, and Dr. Ed Cutrell, Senior Principal Researcher in the Microsoft Research Ability Group, learn how computer vision researchers are working to create vision systems adapted to the needs of those who use them. By creating new dataset challenges, the researchers aim to empower the artificial intelligence community to work on real use cases.
To encourage the larger artificial intelligence community to collaborate on developing methods for assistive technology, we introduce the first dataset challenges with data that originates from people who are blind. Our data comes from over 11,000 people in real-world scenarios who were seeking to learn about the physical world around them. More broadly, this dataset serves as a great catalyst for uncovering hard artificial intelligence challenges that must be addressed to create more robust systems across many contexts and scenarios.
Together, we’ll explore:
- Creating tools for people who are blind or have low vision that match their needs and complement their capabilities
- Key challenges of teaching computers how to automatically describe pictures taken by people who are blind or low vision
- Several potential solutions to make computers more accurately address the needs of people who are blind or low vision
Dr. Danna Gurari is an assistant professor as well as director of the Image and Video Computing Group in the School of Information at University of Texas at Austin (UT-Austin). Her research interests span computer vision, machine learning, human computation, crowdsourcing, human computer interaction, accessibility, and (bio)medical image analysis. She and her work have been recognized with the 2017 Honorable Mention Award at CHI, Researcher Excellence Award from the Boston University computer science department in 2015, 2014 Best Paper Award for Innovative Idea at MICCAI IMIC, and 2013 Best Paper Award at WACV.
Dr. Ed Cutrell is a Senior Principal Researcher at Microsoft Research where he explores computing for disability, accessibility, and inclusive design in the MSR Ability group. Over the years, he has worked on a broad range of HCI topics, including input tech, visual perception and graphics, intelligent notifications and disruptions, and interfaces for search and personal information management. Ed has worked in the field of human-computer interaction (HCI) since 2000; he is trained in cognitive neuropsychology, with a PhD from the University of Oregon.