Leveraging from Artificial Intelligence (AI) In Advancing the Augmented Reality (AR) Grocery Shopping Experience

<p>Globally, people are extremely eager to save time and money while maintaining healthy life choices, especially when performing essential activities such as in-store grocery shopping. This paper presents a system that integrates Artificial Intelligence (AI) methods with Augmented Reality (AR) techniques to enhance the grocery shopping experience through the use of smart glasses. Our proposed framework deploys a Convolutional Neural Network (CNN) object detection model that allows for item identification. By simultaneously retrieving data from a large nutrition database, personal medical reports, and other grocery store related datasets, our intelligent system is able to provide user-centric nutrition facts, health and wellness tips, and unhealthy selection warnings that are augmented on a real time broadcasting of the smart glasses. Our state-of-the-art framework (CoShopper) demonstrates high accuracy in detecting grocery items, improves product selection, increases cost efficiency, and reduces the time spent in the process.</p>