# Acknowledgement:
This work was funded by the European MUHAI project (Horizon 2020 research and innovation program) under grant agreement number 951846.
# Application domain:
Human-Robot-Interaction, Virtual Reality
# Contact:
Rachel Ringe, rringe@uni-bremen.de
# Contributors:
Rachel Ringe, Lars Hurrelbrink
# Description:
The MUHAI VR Kitchen is a virtual reality (VR) environment for interacting with a visual representation of a robotic cooking assistant.
This VR application is used to observe humans during cooperative cooking with an artificial partner and was developed for the Oculus Quest 2 and 3 HMD in the Unity game engine. In this application, the user is placed in a virtual kitchen containing a virtual robot. The objects in the kitchen can be interacted with using both hands or controllers. Various tasks can be completed by grabbing tools or ingredients and moving them in the correct way, e.g., tilting a bag of sugar to pour the contents into a bowl or moving a knife’s blade in a downward motion through an ingredient. Additionally, the robot can be ordered to fulfill any cooking tasks needed for recipe completion – e.g., mixing the ingredients in a bowl – as well as supporting actions such as cleaning surfaces, removing trash like vegetable peels, or fetching objects the user has requested.
These orders can be given through a delegation-type interface where the user can give the robot an order in a declarative manner but is not required to provide any details on how the task should be accomplished. This interface is affordance-based, meaning it shows the user the possible actions that the robot could accomplish using the chosen object. If an order is given that requires more than one parameter, all the other possible objects that could be used in combination are highlighted e.g. picking the action ``Portion ingredient'' used on a bag of flour will then highlight all possible target containers for the ingredient.
The VR environment is mirrored in the [abe_sim](https://github.com/mpomarlan/abe_sim) mental simulation and serves as an interface for it. A working installation of abe_sim as well as a Meta Quest VR Headset and a windows operating system are necessary to run the application.
# Forks count:
0
# Forks url:
0
# Full name:
Name + owner (owner/name)
# Full title:
MUHAI VR-Kitchen
# Images:
![traitPic1](https://github.com/user-attachments/assets/93c7597b-6314-4f11-9ff3-db950e7ed156)
![kyle_poster (2)](https://github.com/user-attachments/assets/28e3a635-a240-4a31-a5cc-e0d9f8a873b7)
# Installation instructions:
1. Clone Repository from Github
2. Connect Meta Quest Headset to PC via Quest Link
3. Start abe_sim
4. Start VR Kitchen Executable
# Keywords:
set of terms used to commonly identify a software component
# License:
License and usage terms of a software component
# Name:
MUHAI VR Kitchen
# Owner:
https://github.com/muhai-project
# Owner type:
Organization
# Programming languages:
C#
# Related papers:
URL to possible related papers within the repository stated within the readme file (from Arxiv)
# Repository Status:
WIP
# Requirements:
* Meta Quest Headset + Meta Quest Link installed
* Windows Operating System
* Working Installation of Abe_Sim
# Support:
When encountering any problems with the software please contact Rachel Ringe (University of Bremen) at rringe@uni-bremen.de.
# Stargazers count:
0
# Support channels:
E-Mail: rringe@uni-bremen.de
# Usage examples:
The VR enviroment can be used to run user studies on Human-Robot-Collaboration in a kitchen environment.