Avatar call on an eyewear device
The disclosed system establishes, by a first augmented reality (AR) device, a voice communication session between a plurality of users. The system displays, by the first AR device of a first user of the plurality of users, an avatar representing a second user of the plurality of users. The system receives, by the first AR device of a first user of the plurality of users, input from the first user that selects a display position for the avatar representing the second user within a real-world environment of the first user. The system animates the avatar representing the second user based on movement information received from a second AR device of the second user.
1. A method comprising:
establishing, by one or more processors of a first augmented reality (AR) device, a voice communication session between a plurality of users including a first user of the first AR device;
displaying, by the first AR device, an avatar representing a second user of the plurality of users;
receiving, by the first AR device, input from the first user that drags the avatar, representing the second user within a real-world environment of the first user, from a first display position to a second display position;
displaying, by the first AR device, a graphical region over the real-world environment, wherein the avatar is displayed inside the graphical region; and
animating the avatar representing the second user at the second display position based on movement information received from a second AR device of the second user.
2. The method of claim 1 , further comprising:
displaying a plurality of avatars including the avatar over the real-world environment, each of the plurality of avatars representing a respective user of the plurality of users, the plurality of avatars being displayed in the graphical region over the real-world environment;
receiving data indicating that the graphical region has been dragged from the first display position to the second display position; and
moving the plurality of avatars in the graphical region from the first display position to the second display position in response to receiving the data indicating that the graphical region has been dragged from the first display position to the second display position.
3. The method of claim 1 , wherein the avatar is displayed in a first portion of the real-world environment, further comprising:
detecting that the first AR device has been moved to view a second portion of the real-world environment that is different from the first portion of the real-world environment;
determining that the first AR device is no longer moving and has remained stationary pointing towards the second portion of the real-world environment; and
in response to determining that the first AR device is no longer moving and has remained stationary pointing towards the second portion of the real-world environment, moving the avatar to a new display position.
4. The method of claim 1 , further comprising:
receiving, as the input, a request to anchor the avatar at the display position;
detecting movement of the first AR device to view a different portion of the real-world environment; and
maintaining the avatar displayed at the display position while the first AR device is moved to view the different portion of the real-world environment.
5. The method of claim 1 , further comprising:
detecting movement of the first AR device to view a different portion of the real-world environment; and
updating a display position of the avatar to keep the avatar displayed within view of the different portion of the real-world environment in response to detecting the movement of the first AR device.
6. The method of claim 1 , further comprising:
maintaining the graphical region within view of the first AR device as the first AR device moves to view different portions of the real-world environment.
7. The method of claim 6 , further comprising:
animating the graphical region as moving in a same direction as the first AR device is being moved to view the different portions of the real-world environment, the graphical region being moved in the same direction as the first AR device while the avatar remains in a fixed position within the graphical region.
8. The method of claim 7 , wherein the avatar is moved in an opposite direction from the same direction in which the graphical region is being moved to keep the avatar in the fixed position within the graphical region, wherein the second AR device is configured to generate the movement information by:
accessing gyroscopic data to detect movement of a head of the second user, wherein the second AR device transmits an instruction to the first AR device to update an orientation of the avatar based on the movement of the head of the second user.
9. The method of claim 7 , further comprising:
determining that the first AR device is no longer moving and has remained stationary pointing towards the different portions of the real-world environment; and
in response to determining that the first AR device is no longer moving and has remained stationary pointing towards the different portions of the real-world environment, moving the avatar to towards a center of the graphical region from the fixed position in which the avatar has remained while the first AR device was being moved.
10. The method of claim 1 , wherein the second AR device is configured to generate the movement information by:
accessing microphone data to detect speech input of the second user, wherein the second AR device transmits an instruction to the first AR device to update lips of the avatar based on the speech input of the second user.
11. The method of claim 1 , wherein animating the avatar comprises:
determining that the movement information includes facial expression information; and
updating a facial expression of the avatar based on the facial expression information received from the second AR device.
12. The method of claim 1 , wherein animating the avatar comprises:
determining that the movement information includes body movement information; and
generating a whole body avatar as the avatar in response to determining that the movement information includes body movement information.
13. The method of claim 12 , further comprising:
updating one or more body parts of the avatar based on the body movement information received from the second AR device.
14. The method of claim 12 , wherein the second AR device accesses information from an external vision system to generate the body movement information.
15. The method of claim 14 , wherein the second AR device comprises an AR eyewear device, and wherein the external vision system comprises a messaging application implemented by a mobile device coupled to the AR eyewear device.
16. The method of claim 15 , wherein the messaging application is configured to apply one or more machine learning models to one or more images depicting the second user that have been captured by the mobile device to generate the body movement information.
17. The method of claim 1 , wherein displaying the avatar comprises:
selecting between a first type of avatar comprising only a head of a person and a second type of avatar comprising a whole body of a person based on determining whether an external vision system is coupled to the second AR device of the second user.
18. A system comprising:
a storage device of an eyewear device; and
at least one processor configured to perform operations comprising:
establishing, by a first augmented reality (AR) device, a voice communication session between a plurality of users;
displaying, by the first AR device, an avatar representing a second user of the plurality of users;
receiving, by the first AR device, input from the first user that drags the avatar, representing the second user within a real-world environment of the first user, from a first display position to a second display position;
displaying, by the first AR device, a graphical region over the real-world environment, wherein the avatar is displayed inside the graphical region; and
animating the avatar representing the second user at the second display position based on movement information received from a second AR device of the second user.
19. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
establishing, by a first augmented reality (AR) device, a voice communication session between a plurality of users;
displaying, by the first AR device, an avatar representing a second user of the plurality of users;
receiving, by the first AR device, input from the first user that drags the avatar, representing the second user within a real-world environment of the first user, from a first display position to a second display position;
displaying, by the first AR device, a graphical region over the real-world environment, wherein the avatar is displayed inside the graphical region; and
animating the avatar representing the second user at the second display position based on movement information received from a second AR device of the second user.