CONTROLLER MOVEMENT TRACKING WITH LIGHT EMITTERS
A head-worn computer includes a camera system positioned to capture a surrounding environment in front of a user, a processor that identifies a position of a plurality of light emitters mounted on a hand-held controller from images captured by the camera system and tracks the position of the plurality of light emitters as the hand-held controller moves in the surrounding environment and interprets the tracked position as positional changes of the hand-held controller. The processor uses the position of the plurality of light emitters as markers in three dimensional space, the markers used as an anchor for virtual content presented in a see-through display of the head-worn computer.
1 . A system comprising:
a wearable head device;
a camera system configured to capture images of a surrounding environment of a user of the wearable head device;
a see-through display of the wearable head device; and
one or more processors configured to perform a method comprising:
activating one or more of a plurality of light emitting elements of an object,
activating the camera system to capture an image, the image comprising a view of the activated one or more of the plurality of light emitting elements,
deactivating the one or more of the plurality of light emitting elements,
determining a position of the object in the surrounding environment at a first time,
determining a predicted position of the object at a second time later than the first time, wherein said determining the predicted position is based on an input from a first orientation sensor of the object and based further on the image captured by the camera system,
determining, based on the predicted position of the object, a display position of virtual content in the see-through display of the wearable head device, and
presenting the virtual content at the display position in the see-through display of the wearable head device,
wherein the plurality of light emitting elements comprises a first light emitting element of a first wavelength and a second light emitting element of a second wavelength, different from the first wavelength.
2 . The system of claim 1 , wherein:
said activating the one or more of a plurality of light emitting elements comprises activating according to a pulse width modulation scheme, and
said activating the camera system comprises activating according to a capture pattern, the capture pattern corresponding to the pulse width modulation scheme.
3 . The system of claim 2 , wherein:
one or more of the plurality of light emitting elements is configured to emit visible light, and
the pulse width modulation scheme comprises a pulse width modulation at a frequency imperceptible to a human eye.
4 . The system of claim 1 , wherein the camera system comprises two or more cameras mounted separately on the wearable head device and wherein each camera views the plurality of light emitting elements from a different perspective.
5 . The system of claim 1 , further comprising an inertial measurement unit (IMU), wherein said determining the predicted position of the object is further based on an output from the IMU.
6 . The system of claim 1 , wherein the method further comprises:
providing the predicted position as a control input for a software application operating via the wearable head device.
7 . The system of claim 1 , wherein the method further comprises:
using the position of the plurality of light emitting elements as an anchor for virtual content presented via the see-through display of the wearable head device.
8 . A method comprising:
activating one or more of a plurality of light emitting elements of an object;
activating a camera system to capture an image, the image comprising a view of the activated one or more of the plurality of light emitting elements;
deactivating the one or more of the plurality of light emitting elements;
determining a position of the object at a first time;
determining a predicted position of the object at a second time later than the first time, wherein said determining the predicted position is based on an input from a first orientation sensor of the object and based further on the image captured by a camera system;
determining, based on the predicted position of the object, a display position of virtual content in a see-through display of a wearable head device; and
presenting the virtual content at the display position in the see-through display of the wearable head device,
wherein the plurality of light emitting elements comprises a first light emitting element of a first wavelength and a second light emitting element of a second wavelength, different from the first wavelength.
9 . The method of claim 8 , wherein:
said activating the one or more of a plurality of light emitting elements comprises activating according to a pulse width modulation scheme, and
said activating the camera system comprises activating according to a capture pattern, the capture pattern corresponding to the pulse width modulation scheme.
10 . The method of claim 8 , wherein:
one or more of the plurality of light emitting elements is configured to emit visible light, and
the pulse width modulation scheme comprises a pulse width modulation at a frequency imperceptible to a human eye.
11 . The method of claim 8 , wherein the camera system comprises two or more cameras mounted separately on the wearable head device and wherein each camera views the plurality of light emitting elements from a different perspective.
12 . The method of claim 8 , wherein the wearable head device comprises an IMU, and wherein said determining the predicted position of the object is further based on an output from the second IMU.
13 . The method of claim 8 , further comprising providing the predicted position as a control input for a software application operating via the wearable head device.
14 . The method of claim 8 , further comprising:
using a position of the plurality of light emitting elements as an anchor for virtual content presented via the see-through display of the wearable head device.
15 . A non-transitory computer readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:
activating one or more of a plurality of light emitting elements of an object;
activating a camera system to capture an image, the image comprising a view of the activated one or more of the plurality of light emitting elements;
deactivating the one or more of the plurality of light emitting elements;
determining a position of the object at a first time;
determining a predicted position of the object at a second time later than the first time, wherein the determining is based on an input from a first orientation sensor of the object and based further on the image captured by a camera system;
determining, based on the predicted position of the object, a display position of virtual content in a see-through display of a wearable head device; and
presenting the virtual content at the display position in the see-through display of the wearable head device,
wherein the plurality of light emitting elements comprises a first light emitting element of a first wavelength and a second light emitting element of a second wavelength, different from the first wavelength.
16 . The non-transitory computer readable medium of claim 15 , wherein:
said activating the one or more of a plurality of light emitting elements comprises activating according to a pulse width modulation scheme, and
said activating the camera system comprises activating according to a capture pattern, the capture pattern corresponding to the pulse width modulation scheme.
17 . The non-transitory computer readable medium of claim 15 , wherein:
one or more of the plurality of light emitting elements is configured to emit visible light, and
the pulse width modulation scheme comprises a pulse width modulation at a frequency imperceptible to a human eye.
18 . The non-transitory computer readable medium of claim 15 , wherein the camera system comprises two or more cameras mounted separately on the wearable head device and wherein each camera views the plurality of light emitting elements from a different perspective.
19 . The non-transitory computer readable medium of claim 15 , wherein the wearable head device comprises an IMU, and wherein said determining the predicted position of the object is further based on an output from the IMU.
20 . The non-transitory computer readable medium of claim 15 , wherein the method further comprises providing the predicted position as a control input for a software application operating via the wearable head device.