User avatar movement control using an augmented reality eyewear device
Systems and methods are provided for performing operations on an augmented reality (AR) device. The system accesses, by the AR device, movement data comprising inertial measurement data and camera data. The system determines three-dimensional (3D) movement of the AR device based on the movement data. The system presents, by the AR device, an AR object on a real-world environment being viewed using the AR device. The system, in response to determining the 3D movement of the AR device, modifies the AR object by the AR device.
1 . A method comprising:
accessing, by an augmented reality (AR) device, movement data comprising inertial measurement data;
determining, based on the movement data, that a given movement of the AR device in a particular vertical height transgresses a threshold height and a threshold rate at which the particular vertical height is reached; and
in response to determining that the given movement in the particular vertical height transgresses the threshold height and the threshold rate at which the particular vertical height is reached, selecting a movement style of an AR object.
2 . The method of claim 1 , further comprising:
determining three-dimensional (3D) movement of the AR device based on the movement data; and
presenting, by the AR device, the AR object on a real-world environment being viewed using the AR device.
3 . The method of claim 1 , wherein the movement data comprises a specified degree of spin comprising a 360-degree of spin.
4 . The method of claim 1 , wherein the AR device comprises an AR eyewear device, further comprising:
determining an orientation, rotation, location, and velocity in 3D space of the AR device as the movement data of the AR device.
5 . The method of claim 1 , further comprising:
updating one or more body parts of an avatar based on the movement data.
6 . The method of claim 1 , further comprising:
synchronizing the inertial measurement data with image data comprising camera data obtained from a plurality of cameras; and
correcting positional drift of inertial measurement data in response to synchronizing the inertial measurement data with the image data.
7 . The method of claim 1 , wherein the given movement includes at least one of forward, backward, left or right movement.
8 . The method of claim 1 , further comprising:
determining that the movement data corresponds to movement in a particular speed; and
moving the AR object along a direction at the particular speed in response to determining that the movement data corresponds to the movement in the particular speed.
9 . The method of claim 8 , further comprising:
determining that the movement at the particular speed transgresses a threshold speed; and
in response to determining that the movement at the particular speed transgresses the threshold speed, changing a movement style of the AR object from a first movement style to a second movement style.
10 . The method of claim 9 , wherein the first movement style comprises walking, and wherein the second movement style comprises running, sprinting or flying.
11 . The method of claim 1 , further comprising:
determining that the movement data transgresses the threshold height and fails to transgress the threshold rate; and
in response to determining that the movement data in the particular vertical height transgresses the threshold height and fails to transgress the threshold rate, preventing application of a movement style to the AR object.
12 . The method of claim 1 , wherein the AR device is configured to apply one or more machine learning models to at least one of the movement data to estimate a modification to apply to the AR object.
13 . The method of claim 1 , wherein the AR object comprises an avatar representing a user, further comprising:
determining an exercise goal associated with a fitness activity; and
animating the avatar to represent achievement of the exercise goal based on the movement data.
14 . A system comprising:
at least one storage device of an augmented reality (AR) device; and
at least one processor coupled to the at least one storage device and programmed to perform operations comprising:
accessing, by an augmented reality (AR) device, movement data comprising inertial measurement data;
determining, based on the movement data, that a given movement of the AR device in a particular vertical height transgresses a threshold height and a threshold rate at which the particular vertical height is reached; and
in response to determining that the given movement in the particular vertical height transgresses the threshold height and the threshold rate at which the particular vertical height is reached, selecting a movement style of an AR object.
15 . The system of claim 14 , the operations comprising:
determining three-dimensional (3D) movement of the AR device based on the movement data; and
presenting, by the AR device, the AR object on a real-world environment being viewed using the AR device.
16 . The system of claim 14 , wherein the movement data comprises a specified degree of spin comprising a 360-degree of spin.
17 . The system of claim 14 , wherein the AR device comprises an AR eyewear device, and wherein the operations comprise:
determining an orientation, rotation, location, and velocity in 3D space of the AR device as the movement data of the AR device.
18 . A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
accessing, by an augmented reality (AR) device, movement data comprising inertial measurement data;
determining, based on the movement data, that a given movement of the AR device in a particular vertical height transgresses a threshold height and a threshold rate at which the particular vertical height is reached; and
in response to determining that the given movement in the particular vertical height transgresses the threshold height and the threshold rate at which the particular vertical height is reached, selecting a movement style of an AR object.
19 . The non-transitory machine-readable storage medium of claim 18 , the operations comprising:
determining three-dimensional (3D) movement of the AR device based on the movement data; and
presenting, by the AR device, the AR object on a real-world environment being viewed using the AR device.
20 . The non-transitory machine-readable storage medium of claim 18 , wherein the movement data comprises a specified degree of spin comprising a 360-degree of spin.