conference logo

Playlist "Swiss Python Summit 2024"

Empowering Independence: Robot-Assisted Shopping for the Visually Impaired with Product Recognition

Chantal Keller

Shopping independently presents significant challenges for the visually impaired. I address these obstacles with a Python-based shopping assistance system that combines product and hand detection with speech recognition. In this talk, we’ll explore how computer vision technology, leveraging a camera and pre-trained models, enables visually impaired users to navigate supermarkets and select products autonomously. By recognizing items and providing acoustic guidance for hand positioning, a self-driving system empowers users to shop without external help. Additionally, attendees will learn how voice commands, processed through speech recognition, create a user-friendly interface.