A Kinect Based Indoor Navigation System for the Blind

Digital Repository at the University of Maryland (University of Maryland College Park)2015

А. А. Белов, Guodong Fu, Janani Gururam, Francis Hackenburg, Yael Osman, John Purtilo, Nicholas Rossomando, Ryan Sawyer, R. J. SHIH, Emily True, Agnes Varghese, Yolanda Zhang

Abstract

Team NAVIGATE aims to create a robust, portable navigational aid for the blind. Our prototype uses depth data from the Microsoft Kinect to perform realtime obstacle avoidance in unfamiliar indoor environments. The device augments the white cane by performing two signi cant functions: detecting overhanging objects and identifying stairs. Based on interviews with blind individuals, we found a combined audio and haptic feedback system best for communicating environmental information. Our prototype uses vibration motors to indicate the presence of an obstacle and an auditory command to alert the user to stairs ahead. Through multiple trials with sighted and blind participants, the device was successful in detecting overhanging objects and approaching stairs. The device increased user competency and adaptability across all trials.

Related Papers

→ Localization System using Microsoft Kinect for Indoor Structures(2012)5 cited
→ Computer vision detection of negative obstacles with the Microsoft Kinect(2012)2 cited
→ Microsoft Kinect-based Indoor Building Information Model Acquisition(2018)1 cited
Design and implementation of a magic mirror using Kinect(2016)
Human following robot using Microsoft Kinect(2012)