Apparatus and method to determine a pose of a head mounted display
A light generation device (LGD) includes an attachment configured to couple the LDG to a surface of an interior of a vehicle, a sensor configured to capture motion data of the LGD, a plurality of light projectors configured to generate a plurality of light patterns within the interior, a memory, and a processor operatively coupled to the sensor and the memory. The processor is configured to cause the plurality of light patterns to be generated within the interior via the plurality of light projectors, and send the motion data to a head mounted display (HMD) that determines a pose associated with the HMD after receiving the motion data based on at least one of the motion data or image data (1) that is captured by the HMD and (2) that includes a representation of at least some patterns from the plurality of light patterns.
1 . A head mounted display (HMD), comprising:
a first sensor configured to capture motion data associated with the HMD when the HMD is worn by a user;
a second sensor configured to capture image data that includes a representation of light patterns generated by a light generation device;
a memory; and
a processor operatively coupled to the first sensor, the second sensor, and the memory, the processor configured to:
receive motion data associated with the light generation device;
determine whether at least one of the motion data associated with the HMD or the motion data associated with the light generation device has noise outside a predetermined acceptable range;
in response to determining that the at least one of the motion data associated with the HMD or the motion data associated with the light generation device has noise outside the predetermined acceptable range, determine a head pose of the user (1) based on the image data, (2) not based on the motion data associated with the HMD and (3) not based on the motion data associated with the light generation device; and
in response to determining that the at least one of the motion data associated with the HMD or the motion data associated with the light generation device has noise within the predetermined acceptable range, determine the head pose of the user based on the image data, the motion data associated with the HMD, and the motion data associated with the light generation device.
2 . The HMD of claim 1 , wherein the first sensor includes an inertial measurement unit and the second sensor includes a camera.
3 . The HMD of claim 1 , wherein determining the head pose of the user based on the image data, the motion data associated with the HMD, and the motion data associated with the light generation device includes:
modifying the motion data associated with the HMD based on the motion data associated with the light generation device to generate modified motion data, the head pose of the user determined based on the modified motion data.
4 . The HMD of claim 1 , wherein the motion data associated with the light generation device and the motion data associated with the HMD are unsynchronized.
5 . The HMD of claim 1 , wherein the light generation device is configured to generate the light patterns in an environment having a light level that is otherwise less than one-lux.
6 . The HMD of claim 1 , wherein the HMD and the light generation device are located inside a vehicle.
7 . The HMD of claim 1 , wherein the HMD and the light generation device are located inside a vehicle, the light generation device includes an attachment, and the light generation device is coupled to a surface of the vehicle via the attachment.
8 . The HMD of claim 1 , wherein the light generation device includes a plurality of light projectors configured to generate the light patterns that are projected in multiple directions onto multiple surfaces.
9 . The HMD of claim 1 , wherein the HMD and the light generation device are located inside a vehicle, and the light generation device is configured to generate the light patterns that are projected in multiple directions onto multiple surfaces of the vehicle.
10 . The HMD of claim 1 , further comprising:
a mirror coupled to the HMD and in a field of view of the second sensor, the image data captured by the second sensor via the mirror.
11 . The HMD of claim 1 , further comprising:
a mirror coupled to the HMD and in a field of view of the second sensor, the image data captured by the second sensor via the mirror,
the mirror being configured such that the second sensor receives light (1) from a first surface not including an outside view and (2) not from a second surface including the outside view.
12 . A method, comprising:
receiving, during a time period, motion data of a head mounted display (HMD);
receiving, from a light generation device, motion data of the light generation device during the time period;
receiving, during the time period, image data that includes a representation of a light pattern generated by the light generation device;
determining that a characteristic of at least one of the motion data of the HMD or the motion data of the light generation device is outside a predetermined acceptable range; and
in response to determining that the characteristic of at least one of the motion data of the HMD or the motion data of the light generation device is outside the predetermined acceptable range, determining a pose associated with the HMD (1) based on the image data, (2) not based on the motion data of the HMD and (3) not based on the motion data of the light generation device.
13 . The method of claim 12 , wherein the characteristic is at least one of noise or harshness.
14 . The method of claim 12 , wherein the light pattern is generated by the light generation device in an environment that is otherwise less than one-lux.
15 . The method of claim 12 , wherein the light pattern is generated by the light generation device in an environment that has a spectral diversity less than a predetermined threshold.
16 . A non-transitory, processor-readable medium storing instructions that, when executed by a processor, cause the processor to:
receive, during a time period, motion data of a head mounted display (HMD);
receive, from a light generation device, motion data of the light generation device during the time period;
receive, during the time period, image data that includes a representation of a light pattern generated by the light generation device;
determine that a characteristic of at least one of the motion data of the HMD or the motion data of the light generation device is outside a predetermined acceptable range; and
in response to determining that the characteristic of at least one of the motion data of the HMD or the motion data of the light generation device is outside the predetermined acceptable range, determine a pose associated with the HMD (1) based on the image data, (2) not based on the motion data of the HMD and (3) not based on the motion data of the light generation device.
17 . The non-transitory, processor-readable medium of claim 16 , wherein the characteristic is at least one of noise or harshness.
18 . The non-transitory, processor-readable medium of claim 16 , wherein the light pattern is generated by the light generation device in an environment that is otherwise less than one-lux.
19 . The non-transitory, processor-readable medium of claim 16 , wherein the light pattern is generated by the light generation device in an environment that has a spectral diversity less than a predetermined threshold.
20 . The non-transitory, processor-readable medium of claim 16 , wherein the motion data of the light generation device is associated with a vehicle and includes at least one of a vertical acceleration of the vehicle or a horizontal acceleration of the vehicle.