Perception based predictive tracking for head mounted displays
There is disclosed a method of and apparatus for predictive tracking for a head mounted display. The method comprises obtaining one or more three-dimensional angular velocity measurements from a sensor monitoring the head mounted display and setting a prediction interval based upon the one or more three-dimensional angular velocity measurements such that the prediction interval is substantially zero when the head mounted display is substantially stationary and the prediction interval increases up to a predetermined latency interval when the head mounted display is moving at an angular velocity of or above a predetermined threshold. The method further includes predicting a three-dimensional orientation for the head mounted display to create a predicted orientation at a time corresponding to the prediction interval, and generating a rendered image corresponding to the predicted orientation for presentation on the head mounted display.
1. A method comprising:
detecting a movement of a user's body part, the user's body part oriented at a first orientation;
obtaining, from one or more sensors, first data representative of the movement of the user's body part;
obtaining, from one or more cameras, second data representative of the movement of the user's body part;
determining a second orientation of the user's body part based on both the first data representative of the movement of the user's body part and the second data representative of the movement of the user body part; and
generating an image corresponding to the second orientation of the user's body part for presentation by a display.
2. The method of claim 1 , wherein the one or more sensors comprise one of:
a gyroscope, an accelerometer, and a magnetometer.
3. The method of claim 1 , wherein an input device configured to abut the user's body part includes an inertial measurement unit (“IMU”) and the IMU includes at least one of the one or more sensors.
4. The method of claim 1 , wherein an input device configured to abut the user's body part includes one or more markers on an outside surface of the input device, and wherein the one or more cameras are external to the input device.
5. The method of claim 4 , wherein the one or more markers comprises one of:
a reflector and a light.
6. The method of claim 1 , wherein at least one of the one or more cameras is configured to detect one or both of infrared light and visible light.
7. The method of claim 1 , wherein the one or more cameras are configured to provide one or more detected locations of one or more reference locations to a movement engine, and wherein the movement engine is configured to determine a movement of the one or more reference locations based on the detected locations and to generate the second data based on the determined movement of the one or more reference locations.
8. The method of claim 7 , wherein the one or more reference locations are associated with one or more markers of an input device configured to abut the user's body part.
9. The method of claim 1 , wherein determining the second orientation of the user's body part comprises determining an angular velocity of the user's body part based on the first data and the second data.
10. The method of claim 9 , wherein determining the second orientation of the user's body part further comprises determining a prediction interval of time based on the determined angular velocity.
11. An apparatus comprising a hardware processor and a non-transitory computer-readable storage medium storing executable computer instructions configured to cause the hardware processor to:
detecting a movement of a user's body part, the user's body part oriented at a first orientation;
obtaining, from one or more sensors, first data representative of the movement of the user's body part;
obtaining, from one or more cameras, second data representative of the movement of the user's body part;
determining a second orientation of the user's body part based on both the first data representative of the movement of the user's body part and the second data representative of the movement of the user body part; and
generating an image corresponding to the second orientation of the user's body part for presentation by a display.
12. The apparatus of claim 11 , wherein the one or more sensors comprise one of:
a gyroscope, an accelerometer, and a magnetometer.
13. The apparatus of claim 11 , wherein an input device configured to be abut the user's body part includes an inertial measurement unit (“IMU”) and the IMU includes at least one of the one or more sensors.
14. The apparatus of claim 11 , wherein an input device configured to be abut the user's body part includes one or more markers on an outside surface of the input device, and wherein the one or more cameras are external to the input device.
15. The apparatus of claim 14 , wherein the one or more markers comprises one of:
a reflector and a light.
16. The apparatus of claim 11 , wherein at least one of the one or more cameras is configured to detect one or both of infrared light and visible light.
17. The apparatus of claim 11 , wherein the one or more cameras are configured to provide one or more detected locations of one or more reference locations to a movement engine, and wherein the movement engine is configured to determine a movement of the one or more reference locations based on the detected locations and to generate the second data based on the determined movement of the one or more reference locations.
18. The apparatus of claim 17 , wherein the one or more reference locations are associated with one or more markers of an input device configured to be abut the user's body part.
19. The apparatus of claim 11 , wherein the executable computer instructions are further configured to cause the hardware processor to determine an angular velocity of the user's body part based on the first data and the second data.
20. The apparatus of claim 19 , wherein the executable computer instructions are further configured to cause the hardware processor to determine a prediction interval of time based on the determined angular velocity.
21. A system comprising:
one or more sensors;
one or more cameras; and
an apparatus configured to:
detect a movement of a user's body part, the user's body part oriented at a first orientation;
obtain, from the one or more sensors, first data representative of the movement of the user's body part;
obtain, from the one or more cameras, second data representative of the movement of the user's body part;
determine a second orientation of the user's body part based on both the first data representative of the movement of the user's body part and the second data representative of the movement of the user body part; and
generate an image corresponding to the second orientation of the user's body part for presentation by a display.