Binghamton University Develops Robotic Guide Dogs with Advanced Communication for Visually Impaired
Researchers at Binghamton University have developed a robotic guide dog system that enhances navigation for visually impaired individuals through verbal communication. Led by Shiqi Zhang, an associate professor at the university's School of Computing, the system utilizes large language models to provide real-time feedback and route information. Unlike traditional guide dogs, these robotic counterparts can communicate detailed situational awareness, offering 'plan verbalization' before departure and 'scene verbalization' during travel. The system was tested with seven legally blind participants navigating a multi-room office environment, where the robot guided them to a conference room, describing surroundings and obstacles along the way. Participants rated the system positively for its helpfulness and ease of communication, preferring a combination of planning explanations and real-time narration.