Eyewear including shared object manipulation AR experiences
Eyewear providing an interactive augmented reality experience between two users of eyewear devices to perform a shared group object manipulation task. During the shared group task, each user of the eyewear controls movement of a respective virtual object in a virtual scene based on a portion of the virtual scene the user is gazing at. Each user can also generate a verbal command to generate a virtual object that interacts with one or more of the other virtual objects.
1. Eyewear, comprising:
a frame;
an eyewear display coupled to the frame;
an eye tracker configured to track a gaze of a first user's eye; and
a processor configured to:
display a first image including an object on the eyewear display;
determine a first position of the object that the first user is gazing at using the eye tracker;
send a first message to a physically remote device indicating the first position of the object that the first user is gazing at;
receive a second message from the physically remote device indicating a location of the same first image that a second user of the physically remote device is gazing at; and
modify the first position of the object in the first image to a second position in the first image as a function of the eye tracker determination of gazing by the first user.
2. The eyewear of claim 1 , wherein the processor is configured to display another object in the first image and modify a position of the other object on the eyewear display to another position responsive to the second message indicating what the second user is gazing at.
3. The eyewear of claim 1 , wherein the processor is configured to respond to a verbal instruction by generating another object in the first image.
4. The eyewear of claim 3 , wherein the other object extends from the object.
5. The eyewear of claim 1 , wherein the processor is configured to automatically send the first message to the physically remote device that is indicative of the first user gaze.
6. The eyewear of claim 1 , wherein the processor is configured to automatically receive the second message from the physically remote device that is indicative of the second user gaze.
7. The eyewear of claim 1 , wherein the first image is a first virtual scene, and the object is a virtual object.
8. An interactive augmented reality method for use with an eyewear device having a frame, an eyewear display coupled to the frame, an eye tracker configured track a gaze of a first user's eye, and a processor, the processor:
displaying a first image including an object on the eyewear display;
determining a first position of the object that the first user is gazing at using the eye tracker;
sending a first message to a physically remote device indicating the first position of the object that the first user is gazing at;
receiving a second message from the physically remote device indicating a location of the same first image that a second user of the physically remote device is gazing at; and
modifying the first position of the object in the first image to a second position in the first image as a function of the eye tracker determination of gazing by the first user.
9. The method of claim 8 , the processor additionally displaying another object in the first image and modifying a position of the other object on the eyewear display to another location responsive to the second message indicating what the second user is gazing at.
10. The method of claim 8 , the processor additionally generating another object in the first image responsive to a verbal instruction.
11. The method of claim 10 , wherein the other object extends from the first object.
12. The method of claim 8 , wherein the processor automatically sends the first message to the physically remote device that is indicative of the first user gaze.
13. The method of claim 8 , wherein the processor automatically receives the second message from the physically remote device that is indicative of the second user gaze.
14. The method of claim 8 , wherein the first image is a first virtual scene, and the first object is a first virtual object.
15. A non-transitory computer-readable medium storing program code which, when executed, is operative to cause an electronic processor of an eyewear device having a frame, an eyewear display coupled to the frame, and an eye tracker configured track a gaze of a first user's eye to perform the steps of:
displaying a first image including an object on the eyewear display;
determining a first position of the object that the first user is gazing at using the eye tracker;
sending a first message to a physically remote device indicating the first position of the object that the first user is gazing at;
receiving a second message from the physically remote device indicating a location of the same first image that a second user of the physically remote device is gazing at; and
modifying the first position of the object in the first image to a second position in the first image as a function of the eye tracker determination of gazing by the first user.
16. The non-transitory computer-readable medium storing program code of claim 15 , further including code to perform the steps of displaying another object in the first image and modifying a position of the other object on the eyewear display to another location responsive to the second message indicating what the second user is gazing at.
17. The non-transitory computer-readable medium storing program code of claim 16 , further including code to perform the step of generating another object in the first image responsive to a verbal instruction.
18. The non-transitory computer-readable medium storing program code of claim 17 , wherein the other object extends from the first object.
19. The non-transitory computer-readable medium storing program code of claim 15 , wherein sending the first message to the physically remote device that is indicative of the first user gaze is automatic.
20. The non-transitory computer-readable medium storing program code of claim 15 , wherein receiving the second message from the physically remote device that is indicative of the second user gaze is automatic.