NEWS

MR-Shoppingu: Physical Interaction with Augmented Retail Products Using Continuous Context Awareness

Winner: Kelvin Cheng, Mitsuru Nakazawa, Soh Masuko

Publication Year: 2017

Paper: MR-Shoppingu: Physical Interaction with Augmented Retail Products using Continuous Context Awareness

Abstract:

In-store physical shopping experiences are often complemented with searches for product related information on mobile devices. However, there is a distinct gap between the physical reality at the shop and the digital content on mobile devices. At the same time, in the not-too-distant future, we envision a world where mixed-reality technologies become ubiquitous, in much the same way as mobile devices have become today. In this context, we proposed MR-Shoppingu, a novel interactive retail shopping experience by using a combination of continuous context awareness, natural user actions, and augmented physical products with online content. Users can interact with products physically and naturally, and are provided with relevant content and recommendations virtually in mixed-reality. This may help consumers in the purchasing process by increasing efficiency and certainty of purchase, and enabling a more personalized and entertaining shopping experience.