‘Adhoc’ cooking with a HoloLens, the user may:
- Search libraries of food recipes, filtered by the basket ingredients. HoloLens uses object recognition to identify each of the items taken out of the basket. Chiefs should not have to ‘say’ or ‘input’ the ingredients to the HoloLens. Take every advantage to speed up, not slow down interaction of Chef and machine ‘working together’
- A step by step walk through to execute the recipe, HoloLens and human working together. e.g. HoloLens highlights the salt on the user’s field of vision. HoloLens articulates what is needed and when, like a tutor over your shoulder.
- Recipes may have a ‘pause’ to allowremind the Chief to ‘check the food’, and provide feedback to the HoloLens. AI on the HoloLens may indicate back to the Chief to action, such as the Chief saying it tastes too XYZ, so HoloLens responds, add NN of Salt.
- HoloLens may also state reminders such as ‘you should be plating your food by now’, or you haven’t added this ingredient yet.
- The HoloLens may guide the ‘food plating’ process, almost like an empty puzzle being populated.
Note: Microsoft is not responsible for any accidental cuts. 🙂
IBM’s Watson goes into battle on Bravo’s Top Chef with the aid of any household cook, and an Augmented Reality (AR) Headset, such as the HoloLens.