Systems and methods for predicting lower body poses

1. A method comprising, by a computing system:

receiving sensor data captured by one or more sensors coupled to a user;

determining contextual information associated with a time at which the sensor data is captured;

generating, based on the sensor data, an upper body pose that corresponds to a first portion of a body of the user, the first portion of the body comprising a head and an arm of the user;

generating, by processing the upper body pose using a machine-learning model, a lower body pose that corresponds to a second portion of the body of the user, the second portion of the body comprising a leg of the user, wherein the lower body pose is generated by further processing the contextual information using the machine-learning model; and

generating a full body pose of the user based on the upper body pose and the lower body pose.

2. The method of claim 1 , wherein the machine-learning model is trained using a second machine-learning model trained to determine whether a given full body pose is likely generated using the machine-learning model.

3. The method of claim 1 , wherein the machine-learning model is optimized during training to cause a second machine-learning model to incorrectly determine that a given full body pose, generated using the machine-learning model, is unlikely generated using the machine-learning model.

4. The method of claim 1 , wherein the machine-learning model is trained by:

generating, by processing a second upper body pose using the machine-learning model, a second lower body pose;

generating a second full body pose based on the second upper body pose and the second lower body pose;

determining, using a second machine-learning model, whether the second full body pose is likely generated using the machine-learning model; and

updating the machine-learning model based on the determination of the second machine-learning model.

5. The method of claim 1 , wherein the one or more sensors are associated with a head-mounted device worn by the user.

6. The method of claim 1 , wherein generating the upper body pose comprises:

determining, based on the sensor data, a plurality of poses corresponding to a plurality of predetermined body parts of the user; and

inferring the upper body pose based on the plurality of poses.

7. The method of claim 6 , wherein the plurality of poses comprises a wrist pose corresponding to a wrist of the user, wherein the wrist pose is determined based on one or more images captured by a head-mounted device worn by the user, the one or more images depicting (1) the wrist of the user or (2) a device held by the user.

8. The method of claim 1 , wherein the contextual information comprises an application the user is interacting with when the upper body pose is determined.

9. The method of claim 1 , further comprising generating, based on the full body pose, an avatar of the user.

10. One or more computer-readable non-transitory storage media comprising software that is operable when executed by a server to:

receive sensor data captured by one or more sensors coupled to a user;

determine contextual information associated with a time at which the sensor data is captured;

generate, based on the sensor data, an upper body pose that corresponds to a first portion of a body of the user, the first portion of the body comprising a head and an arm of the user;

generate, by processing the upper body pose using a machine-learning model, a lower body pose that corresponds to a second portion of the body of the user, the second portion of the body comprising a leg of the user, wherein the lower body pose is generated by further processing the contextual information using the machine-learning model; and

generate a full body pose of the user based on the upper body pose and the lower body pose.

11. The media of claim 10 , wherein generating the upper body pose comprises:

determining, based on the sensor data, a plurality of poses corresponding to a plurality of predetermined body parts of the user; and

inferring the upper body pose based on the plurality of poses.

12. The media of claim 11 , wherein the plurality of poses comprises a wrist pose corresponding to a wrist of the user, wherein the wrist pose is determined based on one or more images captured by a head-mounted device worn by the user, the one or more images depicting (1) the wrist of the user or (2) a device held by the user.

13. The media of claim 10 , wherein the contextual information comprises an application the user is interacting with when the upper body pose is determined.

14. The media of claim 10 , wherein the software is further operable when executed by the server to generate, based on the full body pose, an avatar of the user.

15. A system comprising:

one or more processors; and

one or more computer-readable non-transitory storage media coupled to one or more of the processors and comprising instructions operable when executed by one or more of the processors to cause the system to:

receive sensor data captured by one or more sensors coupled to a user;

determine contextual information associated with a time at which the sensor data is captured;

generate, based on the sensor data, an upper body pose that corresponds to a first portion of a body of the user, the first portion of the body comprising a head and an arm of the user;

generate, by processing the upper body pose using a machine-learning model, a lower body pose that corresponds to a second portion of the body of the user, the second portion of the body comprising a leg of the user, wherein the lower body pose is generated by further processing the contextual information using the machine-learning model; and

generate a full body pose of the user based on the upper body pose and the lower body pose.

16. The system of claim 15 , wherein generating the upper body pose comprises:

determining, based on the sensor data, a plurality of poses corresponding to a plurality of predetermined body parts of the user; and

inferring the upper body pose based on the plurality of poses.

17. The system of claim 16 , wherein the plurality of poses comprises a wrist pose corresponding to a wrist of the user, wherein the wrist pose is determined based on one or more images captured by a head-mounted device worn by the user, the one or more images depicting (1) the wrist of the user or (2) a device held by the user.

18. The system of claim 15 , wherein the contextual information comprises an application the user is interacting with when the upper body pose is determined.

19. The system of claim 15 , wherein the processors are further operable when executing the instructions to generate, based on the full body pose, an avatar of the user.