Penn State researchers have introduced a groundbreaking navigation tool for individuals with visual impairments called NaviSense. This smartphone-based system leverages artificial intelligence to recognize objects in real time, guiding users with audio and haptic feedback. Unveiled at the ACM SIGACCESS ASSETS ’25 conference in Denver, NaviSense won the Best Audience Choice Poster Award for its innovative approach to assistive navigation, moving away from reliance on preloaded object libraries.
With input from visually impaired participants, the app allows users to make voice commands, filtering out irrelevant objects and providing responsive, conversational feedback. A standout feature includes hand guidance, which tracks the user’s hand movements to offer directional support. Early testing showed that NaviSense outperformed existing commercial tools in speed and accuracy, enhancing users’ overall experience. With refinements underway, the technology is close to commercial release, aiming to improve accessibility for visually impaired individuals. Supported by the U.S. National Science Foundation, NaviSense may redefine digital assistance.
Source link
