VIRAS: Barrier-Free Shopping at the Supermarket

Shopping in supermarkets poses major challenges for blind and visually impaired individuals. Without outside help, it is difficult to navigate the store and locate products on the shelves – especially when the layout or product selection changes. Inconsistent lighting conditions make orientation even harder. Weighing fruits and vegetables is virtually impossible. A survey conducted by the ILT among associations for the blind in Germany and Switzerland revealed that many affected individuals avoid shopping independently for these reasons.

This is where the VIRAS project comes in: Developed in close cooperation with users, the ILT is creating an autonomous shopping cart that guides blind and visually impaired people safely through supermarkets using AI-supported object recognition, 3D mapping, and barrier-free navigation. VIRAS stands for Visually Impaired Robot-Assisted Shopping.

The project aims to sustainably improve quality of life and promote social inclusion. The shopping cart received positive feedback from 87 percent of survey participants. The target group includes over 4 percent of the Swiss population who are significantly visually impaired – and the number is rising.

How the Smart Shopping Cart Viras Works

VIRAS supports users throughout the entire shopping process – from creating the shopping list to checking out and paying. As an autonomous system, the motorized cart navigates the store on its own, avoiding other customers and obstacles.

• Before starting the shopping trip, the shopping list can be entered into the VIRAS app manually or transferred using a barcode scanner from packaging or household supplies.
• With the press of a button, the autonomous navigation begins. The cart precisely locates itself within the supermarket. Route planning is adaptive and prioritizes efficient, collision-free paths to the selected items.
• When a product is reached, the system activates its object recognition feature. Two side-mounted, pivoting stereo cameras capture the shelf from different angles. An AI module analyzes the image data and identifies the desired item based on visual characteristics. The exact shelf location is then described via audio.
• At the same time, the user’s hand is tracked by a hand-tracking module. The system provides acoustic feedback until the item is correctly grasped.
• Once the product is placed in the cart, an audio confirmation is issued.
• Navigation then continues to the next item or to the checkout.

Robotics Meets Inclusion: The Technology Behind VIRAS

VIRAS is based on a modified shopping cart system optimized for autonomous assistance functions. A modular platform integrates control, navigation, and interaction components. The cart’s movement is motorized, but it only responds when the user actively initiates a command. This safety principle ensures that the cart moves only when explicitly directed, building trust and a sense of control for the user.

Technical Components of VIRAS:

• Camera systems for environmental perception
• Voice control and haptic feedback for intuitive interaction
• Real-time data processing for dynamic route planning

More on the Technical Details of Viras

Next Steps: Supporting People With Limited Mobility

VIRAS is currently being tested under real-life conditions in a Migros store in Hinwil. The goal is to evaluate and further develop the system in a practical environment. The VIRAS team is working on several exciting enhancements.

The intended user base is also being expanded: In addition to blind and visually impaired individuals, the cart could assist older adults, people with cognitive impairments, and those with limited mobility.

Even supermarket customers without disabilities can benefit from the cart as a navigation tool to find products quickly and efficiently. Additional features like real-time inventory updates and promotional displays are also planned.

Partners

The Swiss Central Association for the Blind, the Swiss Association of the Blind, the Swiss Caritas for the Blind, and the Swiss Association of the Blind and Visually Impaired support the development and implementation of the project both financially and ideologically. The Migros Cooperative Eastern Switzerland is a project partner of VIRAS.

We also receive support from various companies in the industry.

Sincere thanks to all our partners and sponsors.

Go to ILT Overview