Systems and methods to facilitate interactions with virtual content in an interactive space using visual indicators
A system configured to facilitate interactions with virtual content in an interactive space may comprise one or more of a hand tracking device, a light source, an optical element, one or more physical processors, non-transitory electronic storage, and/or other components. The hand tracking device may be configured to generate output signals conveying ranges of surfaces and/or objects present in the real world. A hand of a user may be identified and tracked through three-dimensional space. A virtual cursor may be presented as positionally linked with the hand. The virtual cursor may be modified to reflect change in hand pose. As the hand comes close to virtual objects, an individual virtual object may be modified to reflect which virtual object is closest to the hand.
1. A system configured to provide an interface with three-dimensional virtual content, the system comprising:
a client device configured to be worn on a head of a user;
one or more image-forming components held by the client device, the one or more image-forming components being configured to emit light rays forming images of virtual content, the images being presented to the user;
one or more hand tracking devices configured to generate output signals conveying ranges of surfaces and/or objects present in the real world; and
one or more physical processors configured by machine-readable instructions to:
identify, based on the output signals, presence of one or more hands of the user;
determine, based on the output signals, location of the one or more hands;
determine, based on the output signals, pose of the one or more hands;
correlate the location of the one or more hands with individual locations of two or more virtual objects;
control the one or more image-forming components based on the location of the one or more user's hands, including controlling the one or more image-forming components to:
based on determining the locations of the one or more user's hands are correlated with locations of first and second virtual objects, modify images of the first and second virtual objects,
wherein the modification to the image of the second virtual object is visually distinct from the modification to the image of the first virtual object.
2. The system of claim 1 , wherein the modification of the image of the first virtual object includes highlighting an edge of the first virtual object.
3. The system of claim 1 , further controlling the one or more image-forming components to:
based on the location of a first one of the user's hands, emit light rays forming an image of a virtual cursor such that the virtual cursor is positionally linked with the location of the user's first hand as determined by the output signals of the one or more hand tracking devices
based on the determining the user's first hand is in a first pose, determine an interaction with the first virtual object and modify the image of the virtual cursor in response to the interaction,
wherein the modification of the image of the virtual cursor includes highlighting an edge of the virtual cursor.
4. The system of claim 3 , wherein the interaction is a grab.
5. The system of claim 4 , wherein the first pose is a closed hand, indicating the user's intention to perceive that the virtual content as being grabbed by the user's first hand.
6. The system of claim 1 , wherein the one or more image-forming components are configured such that when the client device is worn on the user's head, the light rays are provided to one or both eyes of the user and superimposed over views of the real world to create an augmented reality environment.
7. The system of claim 1 , wherein the correlation of the location of one of the user's hand with the location of a first one of the virtual objects is based on determining individual distances of individual virtual objects from the user's hand, and wherein the location of the user's hand is correlated with the location of the first virtual object based on the first virtual object being closer to the location of the user's hand than other virtual objects.
8. The system of claim 1 , wherein the client device is a headset.
9. The system of claim 1 , wherein the one or more hand tracking devices comprise one or more of a camera, a three-dimensional scanner, a depth sensor, a rangefinder, a laser gauge, a time-of-flight sensor, an IR camera/emitter pair, a passive structured light stereo pair, or a passive unstructured light stereo pair.
10. The system of claim 1 , wherein the one or more hand tracking devices are incorporated into the client device.
11. The system of claim 1 , wherein the modification to the image of one of the virtual objects varies as a distance between the location of one of the user's hands and the location of the virtual object changes.
12. The system of claim 1 , wherein:
a location of first one of the user's hands is correlated with the locations of the first virtual object and the second virtual object; and
the modification to the second image is visually distinct from the modification to the first image of the first virtual object based on the locations of first virtual object and the second virtual object being at different distances from the location of the user's hand.
13. The system of claim 1 , wherein:
a first location of a first one of the user's hands is correlated with a first location of a first one of the two or more virtual objects and a second location of a second one of the user's hands is correlated with a second location of a second virtual object; and
the modification to the second image is visually distinct from the modification to the first image of the first virtual object based on the location of the first virtual object being correlated with the location of the user's hand and the second location of the second virtual object being correlated with the second location of the second hand.
14. The system of claim 13 , wherein distinctive modifications are exclusively assigned to each of the first and second hands.
15. The system of claim 1 , wherein the correlation of the location of one of the user's one or more hands with the location of one of the two or more virtual objects is based on the location of the virtual object being within a threshold distance from the location of the user's hand.
16. A method to provide an interface with three-dimensional virtual content, the method comprising:
emitting light rays forming images of virtual content, the images being presented to a user;
identifying, based on output signals conveying ranges of surfaces and/or objects present in the real world, presence of one or more hands of the user;
determining, based on the output signals, location of the one or more hands;
determining, based on the output signals, pose of the one or more hands;
correlating the locations of the one or more hands with a locations of two or more virtual objects; and
controlling the emission of the light rays based on the location of the one or more hands, including:
based on determining the locations of the one or more hands are correlated with a locations of first and second virtual objects, modifying images of the first and second virtual objects;
wherein the modification to the image of the second virtual object is visually distinct from the modification to the image of the first virtual object.
17. The method of claim 16 , wherein the modification of the image of the first virtual object includes highlighting an edge of the first virtual object.
18. The method of claim 16 , further controlling the emission of the light rays to:
based on the location of a first one of the user's hands emitting light rays forming an image of a virtual cursor such that the virtual cursor is positionally linked with the location of the user's first hand, as determined from the output signals;
based on determining the location of the user's first hand is correlated with a location of a first virtual object, modifying an image of the first virtual object; and
based on the determining the user's first hand is in a first pose, determining an interaction with the first virtual object and modifying the image of the virtual cursor in response to the interaction,
wherein the modification of the image of the virtual cursor includes highlighting an edge of the virtual cursor.
19. The method of claim 18 , wherein the interaction is a grab.
20. The method of claim 19 , wherein the first pose is a closed hand, indicating the user's intention to perceive that the virtual content as being grabbed by the user's first hand.
21. The method of claim 16 , further comprising:
providing the light rays to one or both eyes of the user to superimpose the light rays over views of the real world to create an augmented reality environment.
22. The method of claim 16 , wherein the correlation of the location of one of the user's hands with the location of a first one of the virtual objects is based on determining individual distances of individual virtual objects from the user's hand, and wherein the location of the user's hand is correlated with the location of the first virtual object based on the first virtual object being closer to the location of the user's hand than other virtual objects.
23. The method of claim 16 , wherein the output signals are generated by one or more hand tracking devices.
24. The method of claim 23 , wherein the one or more hand tracking devices are incorporated into a client device.
25. The method of claim 24 , wherein the method is implemented in a system including one or more physical processors coupled to the client device, the client device being configured to be installed on a head of the user.
26. The method of claim 16 , wherein the modification to the image of one of the virtual objects varies as a distance between the location of one of the user's hands and the location of the virtual object changes.
27. The method of claim 16 , wherein:
a location of first one of the user's hands is correlated with the locations of the first virtual object and the second virtual object; and
the modification to the second image is visually distinct from the modification to the first image of the first virtual object based on the locations of first virtual object and the second virtual object being at different distances from the location of the user's hand.
28. The method of claim 16 , wherein:
a first location of a first one of the user's hands is correlated with a first location of a first one of the two or more virtual objects and a second location of a second one of the user's hands is correlated with a second location of a second virtual object; and
the modification to the second image is visually distinct from the modification to the first image of the first virtual object based on the location of the first virtual object being correlated with the location of the user's hand and the second location of the second virtual object being correlated with the second location of the second hand.
29. The method of claim 28 , wherein distinctive modifications are exclusively assigned to each of the first and second hands.
30. The method of claim 16 , wherein the correlation of the location of one of the user's one or more hands with the location of one of the two or more virtual objects is based on the location of the virtual object being within a threshold distance from the location of the user's hand.