Instant Nutrition Values with AR and AI – Concept Design

Date

April 2028.

‍

Team

Mario Stipetic - lead UX UI designer

Nina Juretic - UX UI designer‍

‍
Goal

This concept, designed for the healthcare industry, aimed to enhance how people track their nutrition by leveraging augmented reality (AR) and artificial intelligence (AI). The goal was to enable users to point their smartphone camera at their food and instantly receive detailed nutritional information, addressing the increasing consumer demand for better tools to manage dietary habits. By integrating AR for real-time display and AI for ingredient identification, this concept sought to provide a seamless, automated alternative to manual input for nutrition tracking apps.

Challenges

The primary challenge in designing this concept was envisioning how emerging technologies like AR and AI could be used together to provide accurate and real-time nutritional data. There was a need to think beyond existing limitations and project how these technologies might evolve to make this concept feasible. Additionally, ensuring that the user interface was intuitive, clear, and non-intrusive was critical, especially when overlaying complex data on a real-world image.

Solution

The solution involved a combination of AR to handle the on-screen display of nutritional information and AI-powered image recognition to scan and identify the ingredients on a plate. The AI component, utilizing high-resolution camera technology, would calculate the nutritional and caloric values based on the ingredients detected. This approach allowed for a streamlined, user-friendly experience, where users could effortlessly obtain detailed nutritional information in real-time.

‍

With Avocado you can not only get the information about your food but also keep track of that information so you can have an overview of your eating habits at one place.

“We believe that in near future nutrition values will be calculated instantly.”

‍

We believe that in near future nutrition values will be calculated instantly.

Screenshot 2018-04-11 14.12.40.png

‍

Here is where Avocado helps. It’s AR (augmented reality) mode scans and identifies nutrition data with the help of AI (artificial intelligence) of your meals.

People are taking greater care than ever about what they eat. That’s why most smartphones already come with apps to track your health. So does an iPhone with Health app which tracks your Activity, Mindfulness, Nutrition, and Sleep. And while your iPhone can track your Activity and Sleep pretty well on its own, using a manual input of the Nutrition section is quite a pain. Here is where Avocado helps. It’s AR (augmented reality) mode scans and identifies nutrition data with help of AI (artificial intelligence) of your meals.

‍

The Avocado system is simplified and made cater to your interest. A user decides about the nutritional information they wish to keep track of. Perhaps you are interested in tracking your proteins because you exercise a lot and want to gain muscle. Maybe, you are trying to kick off your sugar addiction. Well then, track your sugar intake.

With Avocado you can not only get the information about your food but also keep track of that information so you can have an overview of your eating habits at one place. After the initial setup, all the user has to do is point a camera at their food and the app does the calculating. It recognises the ingredients of your meal, then the whole meal.

‍

After the initial setup, all the user has to do is point a camera at their food and the app does the calculating. It recognizes the ingredients of your meal, then the whole meal.

The Avocado system is simplified and made cater to your interest. A user decides about the nutritional information they wish to keep track of. Perhaps you are interested in tracking your proteins because you exercise a lot and want to gain muscle. Maybe, you are trying to kick off your sugar addiction. Well then, track your sugar intake.

‍

After it has done recognizing your meal, the app calculates your calories, protein, or other things you decided to keep track and shows you a calculation, preview of your meal and information.

After it has done recognizing your meal, the app calculates your calories, protein, or other things your decided you to keep track and shows you a calculation, preview of your meal and information.
Screenshot 2018-04-11 14.10.53.png
Then your meal gets listed with the rest of your meals by day. And it’s easy as that!

Then your meal gets listed with the rest of your meals by day. And it’s easy as that!

‍

Outcome

The concept video gained traction and sparked interest on platforms like LinkedIn and YouTube, contributing to discussions on the future of nutrition tracking through AR and AI. While still a conceptual design, it highlighted the potential for integrating advanced technologies into everyday tasks and added value to the ongoing evolution of health-tech innovations.

‍

More Info

  • Technologies Considered: AR for visual overlays, AI for image recognition and data processing, and smartphone camera integration.
  • Design Approach: Focused on a seamless user experience by minimizing manual input and providing instant results in an intuitive manner.
  • Impact: The concept generated attention in professional circles, showcasing the potential of AR and AI to transform nutrition tracking and contribute to healthier lifestyles.

‍

My Contribution

  • Research
  • Information architecture design
  • UX design
  • visual design
  • UI design
  • Interaction design
  • Interaction prototype design
  • video creation
  • asset handoff

‍