Optimized display image rendering
In one example, a head mounted display system includes at least one memory; and at least one processor to execute instructions to: detect a first position and a first view direction of a head of a user based on sensor data generated by at least one of an accelerometer, at least one camera, or a gyroscope at a first point in time; determine a latency associated with a time to cause an image to be presented on the display; determine a predicted position and a predicted view direction of the head of the user at a second point in time based on the latency; render, prior to the second point in time, the image for presentation on the display based on the predicted position and the predicted view direction of the head of the user; and cause the display to present the rendered image.
1. A headset, comprising:
a display;
a battery;
an inertial measurement unit (IMU);
interface circuitry;
memory;
machine readable instructions;
processor circuitry to execute the machine readable instructions to:
obtain, at a first time, a frame rendered based on a first position of the headset, the first position of the headset predicted based on first sensor data measured by the IMU, the first sensor data generated at a second time prior to the first time;
determine a second position of the headset based on second sensor data measured by the IMU;
adjust the rendered frame based on the second position of the headset; and
cause presentation of the adjusted rendered frame on the display.
2. The headset of claim 1 , wherein the processor circuitry is to adjust the rendered frame with a time warping transformation.
3. The headset of claim 1 , wherein the second sensor data is generated at a third time and the second time is prior to the third time.
4. The headset of claim 1 , wherein the first position of the headset is predicted based on a latency.
5. The headset of claim 4 , wherein the latency includes a render latency associated with a time to render the frame.
6. The headset of claim 1 , wherein the processor circuitry is to decode information associated with the rendered frame.
7. The headset of claim 1 , wherein the first position of the headset corresponds to a pose and an orientation of the headset.
8. The headset of claim 1 , further including a camera.
9. A machine readable storage medium comprising instructions to cause processor circuitry to at least:
obtain a frame, the frame generated based on a first position of a head mounted display, the first position of the head mounted display predicted based on first sensor data measured by an inertial measurement unit (IMU);
determine a second position of the head mounted display based on second sensor data measured by the IMU;
generate an adjusted version of the frame based on the second position of the head mounted display; and
cause presentation of the adjusted version of the frame on a display screen of the head mounted display.
10. The machine readable storage medium of claim 9 , wherein the instructions are to cause the processor circuitry to generate the adjusted version of the frame with a time warping transformation.
11. The machine readable storage medium of claim 9 , wherein the first sensor data is generated at a first time, and the second sensor data is generated at a second time, the second time after the first time.
12. The machine readable storage medium of claim 9 , wherein the first position of the head mounted display is predicted based on a latency.
13. The machine readable storage medium of claim 12 , wherein the latency includes a render latency associated with a time to render the frame.
14. The machine readable storage medium of claim 9 , wherein the instructions are to cause the processor circuitry to decode information associated with the frame.
15. The machine readable storage medium of claim 9 , wherein the first position of the head mounted display corresponds to a pose and an orientation of the head mounted display.
16. A system comprising:
a head mounted display including an inertial measurement unit (IMU);
an electronic device communicatively coupled to the head mounted display, the electronic device distinct from the head mounted display;
machine readable instructions; and
programmable circuitry to execute the machine readable instructions to at least:
obtain a frame rendered based on a first position of the head mounted display, the first position of the head mounted display predicted based on first sensor data from the inertial measurement unit (IMU);
determine a second position of the head mounted display based on second sensor data from the IMU;
adjust the frame based on the second position of the head mounted display; and
cause presentation of the adjusted frame on the head mounted display.
17. The system of claim 16 , wherein the programmable circuitry is to adjust the frame with a time warping transformation.
18. The system of claim 16 , wherein the first sensor data is generated at a first time, and the second sensor data is generated at a second time, the second time after the first time.
19. The system of claim 16 , wherein the first position of the head mounted display is predicted based on a render latency associated with a time to render the frame.
20. The system of claim 16 , wherein the programmable circuitry is to decode information associated with the frame.
21. The system of claim 16 , wherein the first position of the head mounted display corresponds to a pose and an orientation.
22. The system of claim 16 , wherein the programmable circuitry is included in the head mounted display.
23. The system of claim 16 , wherein the frame is rendered by the electronic device.