Self-tracked controller
The disclosed system may include a housing dimensioned to secure various components including at least one physical processor and various sensors. The system may also include a camera mounted to the housing, as well as physical memory with computer-executable instructions that, when executed by the physical processor, cause the physical processor to: acquire images of a surrounding environment using the camera mounted to the housing, identify features of the surrounding environment from the acquired images, generate a map using the features identified from the acquired images, access sensor data generated by the sensors, and determine a current pose of the system in the surrounding environment based on the features in the generated map and the accessed sensor data. Various other methods, apparatuses, and computer-readable media are also disclosed.
1. A system comprising:
one or more sensors;
a plurality of cameras mounted to a support structure; and
at least one processor configured to:
capture, using the plurality of cameras mounted to the support structure, a plurality of images of a surrounding environment;
identify one or more features of the surrounding environment from the captured plurality of images;
determine, based on the one or more identified features, a current pose of at least a portion of a user that is located in the surrounding environment; and
upon determining the current pose of the portion of the user, transition to capturing images using a single camera of the plurality of cameras, wherein a subsequent images taken by the single camera is used to determine a subsequent pose of the portion of the user in the surrounding environment.
2. The system of claim 1 , wherein the support structure comprises a frame of an electronic headset.
3. The system of claim 2 , wherein the electronic headset comprises at least one of a virtual reality (VR) headset or an augmented reality (AR) headset.
4. The system of claim 2 , wherein the portion of the user for which the pose is determined comprises the user's hand.
5. The system of claim 2 , wherein the processor is further configured to determine a current pose of the user's hand relative to the electronic headset.
6. The system of claim 5 , wherein the processor is further configured to detect one or more hand gestures formed by the user's hand.
7. The system of claim 5 , wherein the user's hand is interacting with at least one of a physical input device or a virtual input device.
8. The system of claim 7 , wherein the processor is further configured to determine the pose of user's hand relative to the physical input device or the virtual input device.
9. The system of claim 1 , wherein the support structure comprises a frame of an electronic handheld controller.
10. The system of claim 9 , wherein the electronic handheld controller is electronically paired to at least one of a virtual reality (VR) headset or an augmented reality (AR) headset.
11. The system of claim 9 , wherein the portion of the user for which the pose is determined comprises the user's body.
12. The system of claim 11 , wherein determining the current pose of the user's body includes determining a direction in which the user's body is moving.
13. The system of claim 11 , wherein determining the current pose of the user's body includes determining how far the user's body is from the electronic handheld controller.
14. An electronic device comprising:
one or more sensors;
a plurality of cameras mounted to a support structure; and
at least one processor configured to:
capture, using the plurality of cameras mounted to the support structure, a plurality of images of a surrounding environment;
identify one or more features of the surrounding environment from the captured plurality of images;
determine, based on the one or more identified features, a current pose of at least a portion of a user that is located in the surrounding environment; and
upon determining the current pose of the portion of the user, transition to capturing images using a single camera of the plurality of cameras, wherein a subsequent images taken by the single camera is used to determine a subsequent pose of the portion of the user in the surrounding environment.
15. The electronic device of claim 14 , wherein the processor is further configured to generate a map using the one or more features identified from the captured images, and wherein determining the current pose of the portion of the user in the surrounding environment is further based on the generated map.
16. The electronic device of claim 14 , wherein the processor implements one or more computer vision algorithms to identify the features in the captured images.
17. The electronic device of claim 16 , wherein the processor triangulates a current position of the electronic device using one or more of the identified features in the captured images.
18. The electronic device of claim 14 , wherein the processor implements the images captured by the plurality of cameras to identify a three-dimensional (3D) position of a specified feature of the surrounding environment.
19. The electronic device of claim 14 , wherein the processor distributes at least a portion of computing tasks related to identifying the features of the surrounding environment from the captured images to one or more external computer systems.
20. A non-transitory computer-readable medium comprising one or more computer-executable instructions that, when executed by at least one processor of a computing device, cause the computing device to:
capture, using a plurality of cameras mounted to a support structure, a plurality of images of a surrounding environment;
identify one or more features of the surrounding environment from the captured plurality of images;
determine, based on the one or more identified features, a current pose of at least a portion of a user that is located in the surrounding environment; and
upon determining the current pose of the portion of the user, transition to capturing images using a single camera of the plurality of cameras, wherein a subsequent images taken by the single camera is used to determine a subsequent pose of the portion of the user in the surrounding environment.