IP Library Granted Patent US 11,436,787
Granted Patent B2
US 11,436,787 · App. 16/335,350 · Granted Sep 6, 2022

Rendering method, computer product and display apparatus

Inventors: Xuefeng Wang (Beijing, CN); Yukun Sun (Beijing, CN); Bin Zhao (Beijing, CN); Lixin Wang (Beijing, CN); Xi Li (Beijing, CN); Jianwen Suo (Beijing, CN); Wenyu Li (Beijing, CN); Qingwen Fan (Beijing, CN); Jinbao Peng (Beijing, CN); Yuanjie Lu (Beijing, CN); Yali Liu (Beijing, CN); Chenru Wang (Beijing, CN); Jiankang Sun (Beijing, CN); Hao Zhang (Beijing, CN); Lili Chen (Beijing, CN); Jinghua Miao (Beijing, CN)
Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD.; BEIJING BOE TECHNOLOGY DEVELOPMENT CO., LTD.
G06T15/20G06T15/005H04N13/344H04N13/383G06T2210/36
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,436,787
App. No.
16/335,350
Granted
Sep 6, 2022
Kind
B2
Abstract

An image rendering method for a computer product coupled to a display apparatus may include rendering an entire display region of the display apparatus with a first rendering mode to generate a first rendering mode sample image, determining a target region in the entire display region, rendering the target region with a second rendering mode to generate a second rendering mode sample image, and transmitting data of the first rendering mode sample image and the second rendering mode sample image. The second rendering mode comprises at least a value of an image rendering feature that is higher than that of the first rendering mode.

Claims (265)

1. An image rendering method for a computer product coupled to a display apparatus, comprising:

rendering an entire display region of the display apparatus with a first rendering mode to generate a first rendering mode sample image;

determining a target region in the entire display region;

rendering the target region with a second rendering mode to generate a second rendering mode sample image; and

transmitting data of the first rendering mode sample image and the second rendering mode sample image, wherein the second rendering mode comprises at least a value of an image rendering feature that is higher than that of the first rendering mode;

wherein determining the target region in the entire display region comprises:

determining a center point of the target region in the entire display region of the display apparatus;

determining a ratio of an area of the target region to an area of the entire display region; and

obtaining a location of the target region in the entire display region based on the center point of the target region and the ratio of the area of the target region to the area of the entire display region;

wherein determining the target region in the entire display region further comprises:

determining a center point of the entire display region as the center point of the target region;

determining the ratio of the area of the target region to the area of the entire display region as 1:n;

obtaining a field of view α of a camera for the entire display region;

calculating a field of view β of the camera for the target region using an equation below:

tan

(

α

2

)

=

tan

(

β

2

)

n

;

and

calculating a location of the target region in the entire display region based on the calculated field of view β of the camera for the target region.

2. The image rendering method according to claim 1 , wherein the image rendering feature comprises at least one of image resolution or bit depth.

3. The image rendering method according to claim 2 , wherein rendering the entire display region with the first rendering mode comprises rendering the entire display region at a first image resolution; rendering the target region with the second rendering mode comprises rendering the target region at a second image resolution; and a number of pixels per unit area corresponding to the first image resolution is about ¼ to ⅓ of a number of pixels per unit area corresponding to the second image resolution.

4. The image rendering method according to claim 3 ,

wherein the entire display region to be rendered corresponds to a monocular image of a display screen of the display apparatus.

5. The image rendering method according to claim 4 , wherein the image rendering feature comprises at least one of image resolution or bit depth;

the image rendering feature of the first rendering mode sample image is smaller than a display index of a corresponding image of the display screen; and

the image rendering feature of the second rendering mode sample image equals to a display index of the corresponding image of the display screen.

6. The image rendering method according to claim 4 , wherein the image rendering feature comprises the image resolution;

a number of pixels per unit area corresponding to the first image resolution of the first rendering mode is smaller than a number of pixels per unit area corresponding to a display resolution of the monocular image of the display screen; and

a number of pixels per unit area corresponding to the second image resolution of the second rendering mode equals to the number of pixels per unit area corresponding to the display resolution of the monocular image of the display screen.

7. The image rendering method according to claim 6 , wherein the display apparatus is a binocular head mounted display apparatus;

the first rendering mode sample image comprises a first image resolution rendering sample image of a left eye and a first image resolution rendering sample image of a right eye; and

the second rendering mode sample image comprises a second image resolution rendering sample image of a left eye and a second image resolution rendering sample image of a right eye.

8. The image rendering method according to claim 1 , wherein the ratio of the area of the target region to the area of the entire display region is about ¼ to ⅓.

9. The image rendering method according to claim 1 , wherein transmitting the data of the first rendering mode sample image and the second rendering mode sample image comprises:

splicing together the first rendering mode sample image and the second rendering mode sample image to obtained a spliced image; and

transmitting the spliced image.

10. The image rendering method according to claim 9 , wherein splicing the first rendering mode sample image and the second rendering mode sample image comprises:

superimposing the second rendering mode sample image on a corresponding area of the first rendering mode sample image.

11. A computer product, comprising one or more processors, the one or more processors is configured to implement the image rendering method according to claim 1 .

12. The computer product of claim 11 , comprising a first rendering module and a second rendering module,

wherein the first rendering module is configured to render the entire displaying region of the display apparatus by the first render mode to obtain the first rendering mode sample image; and

the second rendering module is configured to render the target region of the entire display region of the display apparatus by the second rendering mode to generate the second rendering mode sample image.

13. The computer product of claim 12 , further comprising a data transmission module, the data transmission module comprising an image splicing unit and a spliced image transmission unit;

wherein the image splicing unit is configured to splice together the first rendering mode sample image and the second rendering mode sample image and the spliced image transmission unit is configured to transmit the spliced image to a display screen of the display apparatus.

14. A display apparatus, coupling to the computer product according to claim 11 .

15. The display apparatus according to claim 14 , further comprising one or more sensors configured to track and determine a user's gaze point.

16. The display apparatus according to claim 14 , wherein the computer product is configured to obtain a size of the display screen of the display apparatus, and adjust a size of the first rendering mode sample image to cover the size of the display screen.

17. The display apparatus according to claim 14 , wherein the display apparatus is a head mounted display apparatus.

18. An image rendering method for a computer product coupled to a display apparatus, comprising:

rendering an entire display region of the display apparatus with a first rendering mode to generate a first rendering mode sample image;

determining a target region in the entire display region;

rendering the target region with a second rendering mode to generate a second rendering mode sample image; and

transmitting data of the first rendering mode sample image and the second rendering mode sample image, wherein the second rendering mode comprises at least a value of an image rendering feature that is higher than that of the first rendering mode;

wherein determining the target region in the entire display region comprises:

determining a center point of the target region in the entire display region of the display apparatus;

determining a ratio of an area of the target region to an area of the entire display region; and

obtaining a location of the target region in the entire display region based on the center point of the target region and the ratio of the area of the target region to the area of the entire display region;

wherein determining the target region in the entire display region further comprises:

determining a user's gaze point in the entire display region as the center point of the target region is;

determining the ratio of the area of the target region to the area of the entire display image as 1:n;

obtaining coordinates of the gaze point (Z x , Z y );

near clipping distance A near and far clipping distance A far of a camera for the entire display region;

left field of view β left , right field angle β right , top field of view β up , bottom field of view β down of the camera for the target region;

obtaining a range of Z x as −m≤Z x ≤m and a range of Z y , −m≤Z y ≤m based on the 1:n ratio of area of the target region to the area of the entire display region;

obtaining boundary values of the target region according to below equations:

Near clipping distance: Z near =A near ;

Far clipping distance: Z far =A far ;

Left boundary of near clipping plane:

Z

left

=

Z

near

×

tan

β

left

×

1

n

×

(

(

2

×

Z

x

-

m

)

m

)

;

Right boundary of near clipping plane:

Z

right

=

Z

near

×

tan

β

right

×

1

n

×

(

(

2

×

Z

x

+

m

)

m

)

;

obtaining parameters of projection matrix of the target region based on the obtained boundary values of the target region according to below equations:

{

x

=

2

×

Z

near

/

(

Z

right

-

Z

left

)

y

=

2

×

Z

near

/

(

Z

up

-

Z

down

)

a

=

(

Z

right

+

Z

left

)

/

(

Z

right

-

Z

left

)

b

=

(

Z

up

+

Z

down

)

/

(

Z

up

-

Z

down

)

c

=

-

(

Z

far

+

Z

near

)

/

(

Z

far

-

Z

near

)

d

=

-

(

2.0

×

Z

far

×

Z

near

)

/

Z

far

-

Z

near

)

e

=

-

1

;

and

obtaining the projection matrix Z m of the target region based on the obtained parameters of the projection matrix of the target region:

Z

m

=

(

x

0

a

0

0

y

b

0

0

0

c

d

0

0

e

0

)

.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2022
From: BOE TECHNOLOGY GROUP CO., LTD.
To: BEIJING BOE TECHNOLOGY DEVELOPMENT CO., LTD.
Reel/Frame 060626/0867 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2019
From: WANG, XUEFENG; SUN, YUKUN; ZHAO, BIN; WANG, LIXIN; LI, XI; SUO, JIANWEN; LI, WENYU; FAN, QINGWEN; PENG, JINBAO; LU, YUANJIE; LIU, YALI; WANG, CHENRU; SUN, JIANKANG; ZHANG, HAO; CHEN, LILI; MIAO, JINGHUA
To: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD.; BOE TECHNOLOGY GROUP CO., LTD.
Reel/Frame 048661/0254 →
Priority Claims (1)
CN 201810260593.3 · Mar 27, 2018 · national
Continuity (1)
Related Publication 20210358200A1 · Nov 18, 2021
Cited By (1)
US 12,192,547