Granted Patent B2

US 12,524,068 · App. 18/619,458 · Granted Jan 13, 2026

Inventors: Yunfei Fan (Beijing, CN); Guidong Wang (Beijing, CN); Tao Wu (Beijing, CN)

Assignee: Beijing Zitiao Network Technology Co., Ltd.

G06F3/012G06F3/0346G06F3/147

Abstract

Claims (71)

1 . A picture rendering method, which is applied to a head-mounted display device, the picture rendering method comprising:

determining a plurality of predicted moments after a current moment, wherein the plurality of predicted moments comprise a plurality of intermediate moments and a display moment after the plurality of intermediate moments;

inputting the plurality of predicted moments into a pre-trained prediction model for prediction processing to obtain a plurality of predicted inertial measurement data that correspond to the predicted moments on a one-to-one basis;

obtaining a current pose and a current speed of the head-mounted display device, and determining a display pose at the display moment based on the current pose, the current speed and the plurality of predicted inertial measurement data; and

rendering a virtual scene based on the display pose to obtain a display picture corresponding to the display moment.

2 . The picture rendering method according to claim 1 , prior to the determining a plurality of predicted moments after a current moment, further comprising:

obtaining a plurality of historical inertial measurement data;

determining historical moments corresponding to the historical inertial measurement data; and

determining a plurality of the historical moments as input data of the prediction model, and the plurality of historical inertial measurement data as label data of the prediction model, and training the prediction model to obtain a trained prediction model.

3 . The picture rendering method according to claim 1 , wherein the determining a display pose at the display moment based on the current pose, the current speed and the plurality of predicted inertial measurement data comprises:

obtaining current inertial measurement data; and

performing, by adopting an integration operation, integration processing on the current pose and the current speed based on the plurality of predicted inertial measurement data and the current inertial measurement data to obtain the display pose.

4 . The picture rendering method according to claim 3 , wherein the predicted inertial measurement data include: an angular speed and a linear acceleration; and wherein performing, by adopting an integration operation, integration processing on the current pose and the current speed based on the plurality of predicted inertial measurement data and the current inertial measurement data to obtain the display pose comprises:

obtaining a preset angular speed deviation and a preset linear speed deviation; and

performing, by adopting the integration operation, the integration processing on the current pose and the current speed based on the plurality of predicted inertial measurement data, the angular speed deviation and the linear speed deviation, and the current inertial measurement data to obtain the display pose.

5 . The picture rendering method according to claim 1 , wherein the determining a plurality of predicted moments after a current moment comprises:

obtaining the display moment; and

determining a plurality of intermediate moments between the current moment and the display moment.

6 . The picture rendering method according to claim 5 , wherein the obtaining the display moment comprises:

obtaining an interval duration between the display moment and the current moment; and

determining the display moment based on the interval duration and the current moment.

7 . The picture rendering method according to claim 6 , wherein the obtaining an interval duration between the display moment and the current moment comprises:

determining a virtual scene type; and

determining the interval duration according to the virtual scene type, wherein the virtual scene type and the interval duration have a preset correspondence.

8 . The picture rendering method according to claim 6 , wherein the obtaining an interval duration between the display moment and the current moment comprises:

obtaining a picture display frame rate; and

determining the interval duration according to the picture display frame rate, wherein the picture display frame rate and the interval duration are positively correlated.

9 . The picture rendering method according to claim 6 , wherein the obtaining an interval duration between the display moment and the current moment comprises:

obtaining a historical picture rendering duration within a preset historical moment period; and

determining the interval duration according to the historical picture rendering duration, wherein the interval duration is greater than or equal to the historical picture rendering duration.

10 . An electronic apparatus, comprising: at least one processor and a memory;

wherein the memory stores computer executable instructions; and

wherein the at least one processor executes the computer executable instructions stored in the memory, causing the at least one processor to:

determine a plurality of predicted moments after a current moment, wherein the plurality of predicted moments comprise a plurality of intermediate moments and a display moment after the plurality of intermediate moments;

input the plurality of predicted moments into a pre-trained prediction model for prediction processing to obtain a plurality of predicted inertial measurement data that correspond to the predicted moments on a one-to-one basis;

obtain a current pose and a current speed of the head-mounted display device, and determining a display pose at the display moment based on the current pose, the current speed and the plurality of predicted inertial measurement data; and

render a virtual scene based on the display pose to obtain a display picture corresponding to the display moment.

11 . The electronic apparatus according to claim 10 , prior to the determining a plurality of predicted moments after a current moment, the computer executable instructions further causing the at least one processor to:

obtain a plurality of historical inertial measurement data;

determine historical moments corresponding to the historical inertial measurement data; and

determine a plurality of the historical moments as input data of the prediction model, and the plurality of historical inertial measurement data as label data of the prediction model, and training the prediction model to obtain a trained prediction model.

12 . The electronic apparatus according to claim 10 , wherein the computer executable instructions for determining a display pose at the display moment based on the current pose, the current speed and the plurality of predicted inertial measurement data further causes the at least one processor to:

obtain current inertial measurement data; and

perform, by adopting an integration operation, integration processing on the current pose and the current speed based on the plurality of predicted inertial measurement data and the current inertial measurement data to obtain the display pose.

13 . The electronic apparatus according to claim 12 , wherein the predicted inertial measurement data include: an angular speed and a linear acceleration; and wherein the computer executable instructions for performing, by adopting an integration operation, integration processing on the current pose and the current speed based on the plurality of predicted inertial measurement data and the current inertial measurement data to obtain the display pose further causes the at least one processor to:

obtain a preset angular speed deviation and a preset linear speed deviation; and

perform, by adopting the integration operation, the integration processing on the current pose and the current speed based on the plurality of predicted inertial measurement data, the angular speed deviation and the linear speed deviation, and the current inertial measurement data to obtain the display pose.

14 . The electronic apparatus according to claim 10 , wherein the computer executable instructions for determining a plurality of predicted moments after a current moment further causes the at least one processor to:

obtain the display moment; and

determine a plurality of intermediate moments between the current moment and the display moment.

15 . The electronic apparatus according to claim 14 , wherein computer executable instructions for obtaining the display moment further causes the at least one processor to:

obtain an interval duration between the display moment and the current moment; and

determine the display moment based on the interval duration and the current moment.

16 . A non-transitory computer readable storage medium storing computer executable instructions thereon, which when executed by a processor implement the picture rendering method comprising:

determining a plurality of predicted moments after a current moment, wherein the plurality of predicted moments comprise a plurality of intermediate moments and a display moment after the plurality of intermediate moments;

inputting the plurality of predicted moments into a pre-trained prediction model for prediction processing to obtain a plurality of predicted inertial measurement data that correspond to the predicted moments on a one-to-one basis;

obtaining a current pose and a current speed of the head-mounted display device, and determining a display pose at the display moment based on the current pose, the current speed and the plurality of predicted inertial measurement data; and

rendering a virtual scene based on the display pose to obtain a display picture corresponding to the display moment.

17 . The non-transitory computer readable storage medium according to claim 16 , prior to the determining a plurality of predicted moments after a current moment, further comprising:

obtaining a plurality of historical inertial measurement data;

determining historical moments corresponding to the historical inertial measurement data; and

determining a plurality of the historical moments as input data of the prediction model, and the plurality of historical inertial measurement data as label data of the prediction model, and training the prediction model to obtain a trained prediction model.

18 . The non-transitory computer readable storage medium according to claim 16 , wherein the determining a display pose at the display moment based on the current pose, the current speed and the plurality of predicted inertial measurement data comprises:

obtaining current inertial measurement data; and

performing, by adopting an integration operation, integration processing on the current pose and the current speed based on the plurality of predicted inertial measurement data and the current inertial measurement data to obtain the display pose.

19 . The non-transitory computer readable storage medium according to claim 18 , wherein the predicted inertial measurement data include: an angular speed and a linear acceleration; and wherein performing, by adopting an integration operation, integration processing on the current pose and the current speed based on the plurality of predicted inertial measurement data and the current inertial measurement data to obtain the display pose comprises:

obtaining a preset angular speed deviation and a preset linear speed deviation; and

performing, by adopting the integration operation, the integration processing on the current pose and the current speed based on the plurality of predicted inertial measurement data, the angular speed deviation and the linear speed deviation, and the current inertial measurement data to obtain the display pose.

20 . The non-transitory computer readable storage medium according to claim 16 , wherein the determining a plurality of predicted moments after a current moment comprises:

obtaining the display moment; and

determining a plurality of intermediate moments between the current moment and the display moment.

Priority Claims (1)

Continuity (1)

References Cited (18)