A new study offers hope for people who are blind or have low vision (pBLV) through an innovative navigation system that was tested using virtual reality. The system, which combines vibrational and sound feedback, aims to help users navigate complex real-world environments more safely and effectively.
The research from NYU Tandon School of Engineering, published in , advances work from , and colleagues toward developing a first-of-its-kind wearable system to help pBLV navigate their surroundings independently.
“Traditional mobility aids have key limitations that we want to overcome,” said Fabiana Sofia Ricci, the paper’s lead author and a Ph.D. candidate in NYU Tandon (BME) and NYU Tandon’s (CUSP). “White canes only detect objects through contact and miss obstacles outside their range, while guide dogs require extensive training and are costly. As a result, only 2 to 8 percent of visually impaired Americans use either aid.”
In this study, the research team miniaturized the earlier haptic feedback of its backpack-based system into a discreet belt equipped with 10 precision vibration motors. The belt's electronic components, including a custom circuit board and microcontroller, fit into a simple waist bag, a crucial step toward making the technology practical for real-world use.
The system provides two types of sensory feedback: vibrations through the belt indicate obstacle location and proximity, while audio beeps through a headset become more frequent as users approach obstacles in their path.
"We want to reach a point where the technology we’re building is light, largely unseen and has all the necessary performance required for efficient and safe navigation," said Rizzo, who is an associate professor in NYU Tandon’s BME department, associate director of , affiliated faculty at CUSP and associate professor in the Department of Rehabilitation Medicine at e.
"The goal is something you can wear with any type of clothing, so people are not bothered in any way by the technology."
The researchers tested the technology by recruiting 72 participants with normal vision, who wore Meta Quest 2 VR headsets and haptic feedback belts while walking around NYU's Media Commons at 370 Jay Street in Downtown Brooklyn, an empty room with only side curtains.
Through their headsets, the participants experienced a virtual subway station as someone with advanced glaucoma would see it - with reduced peripheral vision, blurred details, and altered color perception. The environment, created with Unity gaming software to match the room's exact dimensions, allowed the team to determine how well participants could navigate using the belt's vibrations and audio feedback when their vision was impaired.
"We worked with mobility specialists and NYU Langone ophthalmologists to design the VR simulation to accurately recreate advanced glaucoma symptoms," says Porfiri, the paper’s senior author, CUSP Director and an Institute Professor in NYU Tandon’s Departments of BME and Mechanical and Aerospace Engineering. "Within this environment, we included common transit challenges that visually impaired people face daily - broken elevators, construction zones, pedestrian traffic, and unexpected obstacles."
Results showed that haptic feedback significantly reduced collisions with obstacles, while audio cues helped users move more smoothly through space. Future studies will involve individuals with actual vision loss.
The technology complements the functionality of , a mobile app being developed by a Rizzo-led team to provide pBLV navigation guidance inside subway stations. Commute Booster “reads” station signage and tells users where to go, while the haptic belt could help those users avoid obstacles along the way.
In December 2023, the National Science Foundation (NSF) awarded Rizzo, Porfiri, and a team of NYU colleagues a via its Convergence Accelerator, a program whose mission includes supporting the development of assistive and rehabilitative technologies. That grant, along with others from NSF, funded this research and also supports Commute Booster’s development. In addition to Ricci, Rizzo and Porfiri, Lorenzo Liguori and Eduardo Palermo are the paper’s authors, both from the Department of Mechanical and Aerospace Engineering of Sapienza University of Rome, Italy.
About the New York University Tandon School of Engineering
The NYU Tandon School of Engineering is home to a community of renowned faculty, undergraduate and graduate students united in a mission to understand and create technology that powers cities, enables worldwide communication, fights climate change, and builds healthier, safer, and more equitable real and digital worlds. The school’s culture centers on encouraging rigorous, interdisciplinary collaboration and research; fostering inclusivity, entrepreneurial thinking, and diverse perspectives; and creating innovative and accessible pathways for lifelong learning in STEM. NYU Tandon dates back to 1854, the founding year of both the New York University School of Civil Engineering and Architecture and the Brooklyn Collegiate and Polytechnic Institute. Located in the heart of Brooklyn, NYU Tandon is a vital part of New York University and its unparalleled global network. For more information, visit.
RSS