Method and system for video frame processing

1. A method for video frame processing, applicable to a system including a computing device and a head-mounted display having a motion sensor, a processor, and a display, comprising:

receiving a sequence of rendered video frames by the processor from the computing device, wherein the rendered video frames comprise a first frame and a second frame subsequent to the first frame;

obtaining a first head movement of the head-mounted display from the motion sensor by the processor, wherein the first head movement is associated with the first frame;

estimating a predicted head angle corresponding to an interpolated time point associated with an interpolated frame by the processor according to a first head angle corresponding to the first head movement;

performing motion estimation on the first frame and the second frame by the processor to obtain a first motion vector;

estimating an interpolated motion vector corresponding to the interpolated frame by the processor according to the first motion vector;

generating an interpolated content by the processor according to the interpolated motion vector;

transforming the predicted head angle to a view matrix by the processor;

rendering the interpolated frame by the processor according to the interpolated content and the view matrix; and

displaying the interpolated frame, subsequent to the first frame and prior to the second frame, on the display by the processor.

2. The method according to claim 1 , wherein the first head angle corresponds to a first time point, and wherein the step of estimating the predicted head angle corresponding to the interpolated time point associated with the interpolated frame by the processor according to the first head angle corresponding to the first head movement comprises:

obtaining a first angular velocity and a first angular acceleration from the motion sensor by the processor, wherein the first angular velocity and the first angular acceleration correspond to the first time point; and

estimating the predicted head angle corresponding to the interpolated time point by the processor according to the first head angle, the first angular velocity, and the first angular acceleration.

3. The method according to claim 1 , wherein after the step of rendering the interpolated frame by the processor, the method further comprises:

performing lens distortion on the interpolated frame by the processor.

4. A system for video frame processing, comprising:

a computing device; and

a head-mounted display, comprising:

a motion sensor, configured to detect movements of the head-mounted display;

a display, configured to display rendered video frames;

a processor, configured to:

receive a sequence of rendered video frames from the computing device, wherein the rendered video frames comprise a first frame and a second frame subsequent to the first frame;

obtain a first head movement of the head-mounted display from the motion sensor, wherein the first head movement is associated with the first frame;

estimate a predicted head angle corresponding to an interpolated time point associated with an interpolated frame according to a first head angle corresponding to the first head movement;

perform motion estimation on the first frame and the second frame to obtain a first motion vector;

estimate an interpolated motion vector corresponding to the interpolated frame according to the first motion vector;

generate an interpolated content according to the interpolated motion vector;

transform the predicted head angle to a view matrix;

render the interpolated frame according to the interpolated content and the view matrix; and

display the interpolated frame, subsequent to the first frame and prior to the second frame, on the display.

5. The system according to claim 4 , wherein the processor is configured to:

obtain a first angular velocity and a first angular acceleration from the motion sensor, wherein the first angular velocity and the first angular acceleration correspond to the first time point; and

estimate the predicted head angle corresponding to the interpolated time point according to the first head angle, the first angular velocity, and the first angular acceleration.

6. The system according to claim 4 , wherein the processor is further configured to:

perform lens distortion on the interpolated frame.

7. The system according to claim 4 , wherein the head-mounted display is externally-connected to the computing device.

8. The system according to claim 4 , wherein the computing device is integrated with the head-mounted display.

9. The system according to claim 4 , wherein a frame rate of the sequence of rendered video frames rendered by the computing device is lower than that of the first frame, the interpolated frame, and the second frame displayed on the head-mounted display.