MR-Shoppingu: Physical Interaction with Augmented Retail Products using Continuous Context Awareness

Author: Kelvin Cheng, Mitsuru Nakazawa, Soh Masuko


In-store physical shopping experiences are often complemented with searches for product related information on mobile devices. However, there is a distinct gap between the physical reality at the shop and the digital content on mobile devices. At the same time, in the not-too-distant future, we envision a world where mixed-reality technologies become ubiquitous, in much the same way as mobile devices have become today. In this context, we proposed MR-Shoppingu, a novel interactive retail shopping experience by using a combination of continuous context awareness, natural user actions, and augmented physical products with online content. Users can interact with products physically and naturally, and are provided with relevant content and recommendations virtually in mixed-reality. This may help consumers in the purchasing process by increasing efficiency and certainty of purchase, and enabling a more personalized and entertaining shopping experience.

Copied! instagram
Research Areas : #Others
Careers : Open Positions