Hochschule Augsburg |
Vivien Bardosi
Master Thesis
2019
Poster Information (pdf)
Complete Thesis online
Winner of BEST DEMO AWARD
at 
Mensch und Computer 2019
Guided Cooking
with Augmented Reality
Gaze controlled cooking assistant
for Augmented Reality glasses
UX Research and Design
A prototypical iOS application was developed as part of a user-centered design process, which accompanies the user throughout the cooking process.
The virtual cooking instructions appear in the user’s field of view at the appropriate location when they are needed.
The emphasis of this work was placed on the conception and development of the prototype using user-oriented methods and thereby focusing on two important issues:
The first question deals with the adaption of recipes for an Augmented Reality cooking assistant. For this purpose, a system has been developed which can be used to adapt any arbitrary recipe.
The second question investigates whether gaze control is suitable for the intuitive use of a cooking assistance application with Augmented Reality glasses.
To answer this question, the gaze control implementation in the prototype was evaluated with the help of user testing. Since the application may contain important instructions outside of the field of view, a visual signal has been added to direct the user's attention.
It has been determined that gaze control is appropriate for the user's interaction with the application, as it can be integrated most naturally into the cooking process compared to voice or gesture control.
With the help of the developed system, recipes can be integrated into the Augmented Reality cooking assistant. A software with which these can be entered into the system via a clear user interface could simplify and speed up this process.
