Spatially consistent representation of hand motion

1. A computing device, comprising:

a logic subsystem; and

a storage subsystem comprising instructions executable by the logic subsystem to:

receive a recorded representation of hand motion determined in a coordinate system of a virtual model aligned to a first object, the virtual model corresponding to the first object;

receive image data corresponding to an environment;

recognize a second object in the environment;

align the virtual model to the second object; and

based on the recorded representation of hand motion, output a parametric representation of hand motion for display in a coordinate system of the virtual model as aligned to the second object, such that the parametric representation of hand motion relative to the virtual model as aligned to the second object is spatially consistent with the recorded representation of hand motion relative to the virtual model as aligned to the first object, wherein the parametric representation includes a multi-dimensional vector, wherein each dimension of the multi-dimensional vector encodes an articulation of at least one of a plurality of hand joints.

2. The computing device of claim 1 , wherein the second object is recognized based on the virtual model.

3. The computing device of claim 1 , further comprising instructions executable to determine a pose of the second object.

4. The computing device of claim 3 , wherein the instructions executable to align the virtual model to the second object are executable to align a pose of the virtual model to the pose of the second object.

5. The computing device of claim 1 , wherein the recorded representation of hand motion is determined in the coordinate system of the virtual model.

6. The computing device of claim 1 , wherein the parametric representation of hand motion is output for display on a head-mounted display device.

7. The computing device of claim 6 , wherein the parametric representation of hand motion is output for display based on a head pose of a user of the head-mounted display device.

8. The computing device of claim 1 , wherein the instructions are further executable to maintain an alignment of the virtual model to the second object as the second object undergoes motion.

9. The computing device of claim 8 , wherein the motion includes motion of an articulable part of the second object.

10. The computing device of claim 8 , wherein the motion includes motion of a removable part of the second object.

11. The computing system of claim 1 , further comprising instructions executable to use the multi-dimensional vector to reproduce an overall pose of a hand.

12. A computing device, comprising:

a logic subsystem; and

a storage subsystem comprising instructions executable by the logic subsystem to:

receive image data corresponding to an environment;

recognize a first object in the environment;

receive a virtual model representing the first object;

align the virtual model to the first object and maintain such alignment;

receive a recording of hand motion;

based on the recording, determine a parametric representation of hand motion relative to the virtual model as aligned with the first object; and

configure the parametric representation of hand motion for display in a coordinate system of the virtual model as aligned to a second object, such that the parametric representation of hand motion relative to the virtual model as aligned to the second object is spatially consistent with the parametric representation of hand motion relative to the virtual model as aligned to the first object, wherein the parametric representation includes a multi-dimensional vector, wherein each dimension of the multi-dimensional vector encodes an articulation of at least one of a plurality of hand joints.

13. The computing device of claim 12 , wherein the first object is recognized based on the virtual model.

14. The computing device of claim 12 , further comprising instructions executable to determine a pose of the first object.

15. The computing device of claim 14 , wherein the instructions executable to align the virtual model to the first object are executable to align a pose of the virtual model to the pose of the first object.

16. The computing device of claim 12 , wherein the parametric representation of hand motion is determined in the coordinate system of the virtual model.

17. The computing device of claim 12 , further comprising instructions executable to output the parametric representation of hand motion for display at another computing device.

18. At a robotic device, a method of controlling a robot manipulator, comprising:

receiving a parametric representation of hand motion determined in a coordinate system of a virtual model aligned to a first object, the virtual model corresponding to the first object;

receiving image data corresponding to an environment;

recognizing a second object in the environment;

aligning the virtual model to the second object; and

based on the parametric representation of hand motion, determining a sequence of actions for performance, relative to the virtual model as aligned to the second object, by a manipulator of the robotic device, where the sequence of actions is spatially consistent with the parametric representation of hand motion relative to the virtual model as aligned to the first object, wherein the parametric representation includes a multi-dimensional vector, wherein each dimension of the multi-dimensional vector encodes an articulation of at least one of a plurality of hand joints.

19. The method of claim 18 , further comprising, for each action of the sequence of actions, generating one or more corresponding commands configured to cause the manipulator to perform the action.

20. The method of claim 19 , further comprising updating the one or more commands based on the image data to thereby align the manipulator to the second object.