IP Library Granted Patent US 10,212,409
Granted Patent B2
US 10,212,409 · App. 15/324,766 · Granted Feb 19, 2019

Method, apparatus, and non-transitory computer readable medium for generating depth maps

Inventors: Xingxing Zhao (Beijing, CN); Jibo Zhao (Beijing, CN)
Assignee: BOE TECHNOLOGY GROUP CO., LTD
H04N13/128G06F3/01H04N13/139H04N13/271H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,212,409
App. No.
15/324,766
Granted
Feb 19, 2019
Kind
B2
Abstract

The present invention provides a depth generation method. The method includes obtaining a left two-dimensional (2D) image and a right two-dimensional image, each having a first image resolution; scaling the left 2D image and the right 2D image to obtain a scaled left 2D image and a scaled right 2D image, each having a second image resolution; and generating an output depth map based on the scaled left 2D image and the scaled right 2D image.

Claims (58)

1. A depth map generation method implemented by a depth map generation apparatus including a depth map generation circuit, a resolution control circuit, and an image resolution adjusting circuit, the method comprising:

obtaining, through a camera, a left two-dimensional (2D) image and a right two-dimensional image, each having a first image resolution;

generating, through the depth map generation circuit, an intermediate depth map based on the left 2D image and the right 2D image;

calculating, through the resolution control circuit, a depth of a target object based on the intermediate depth map;

determining, through the resolution control circuit, a depth range of the target object according to the depth of the target object;

determining, through the resolution control circuit, a resolution corresponding to the depth range that includes the target object, the resolution being defined as a second image resolution;

scaling, through the image resolution adjusting circuit, the left 2D image and the right 2D image to obtain a scaled left 2D image and a scaled right 2D image, each having the second image resolution; and

generating, through the depth map generation circuit, an output depth map based on the scaled left 2D image and the scaled right 2D image.

2. The method according to claim 1 , further comprising:

adjusting, through a depth map resolution adjusting circuit, the generated depth map to a third image resolution; and

outputting, through the depth map resolution adjusting circuit, the scaled depth map.

3. The method according to claim 1 , further comprising:

corresponding, through the resolution control circuit, a plurality of image resolutions to a plurality of depth ranges to establish relationships between the plurality of image resolutions and the plurality of depth ranges, wherein the plurality of depth ranges include a short distance range, an intermediate distance range, and a long distance range; and

determining, through the resolution control circuit, the depth range of the target object according to the depth of the target object and the relationships between the plurality of image resolutions and the plurality of depth ranges.

4. The method according to claim 1 , wherein generating the depth map further comprises:

identifying, through the depth map generation circuit, matching pixels in the scaled left 2D image and the scaled right 2D image using parallel processing at a fixed calculation scale, wherein the calculation scale refers to a number of pixels configured to be matched at a same time;

calculating, through the depth map generation circuit, parallax values of the matched pixels; and

assigning, through the depth map generation circuit, intensity levels to the depth map according to the calculated parallax values.

5. The method according to claim 1 , further comprising:

determining, through the resolution control circuit, an effective measurable depth range of the intermediate depth map, wherein the effective measurable depth refers to a depth with a corresponding measurement resolution greater than or equal to a threshold; and

determining, through the resolution control circuit, the second image resolution based on the effective measurable depth range of the intermediate depth map.

6. A depth map generation apparatus, comprising:

a camera configured to obtain a left two-dimensional (2D) image and a right 2D image, each having a first image resolution;

a depth map generation circuit configured to generate an intermediate depth map based on the left 2D image and the right 2D image;

a resolution control circuit configured to calculate a depth of a target object based on the intermediate depth map, determine a depth range of the target object according to the depth of the target object, and determine a resolution corresponding to the depth range that includes the target object, the resolution being defined as a second image resolution; and

an image resolution adjusting circuit configured to scale the left 2D image and the right 2D image to obtain a scaled left 2D image and a scaled right 2D image, each having the second image resolution, wherein the depth map generation circuit is further configured to generate an output depth map based on the scaled left 2D image and the scaled right 2D image.

7. The apparatus according to claim 6 , further comprises:

a depth map resolution adjusting circuit configured to adjust the generated depth map to a third image resolution and output the adjusted depth map.

8. The apparatus according to claim 6 , wherein the resolution control circuit is further configured to:

correspond a plurality of image resolutions to a plurality of depth ranges to establish relationships between the plurality of image resolutions and the plurality of depth ranges, wherein the plurality of depth ranges include a short distance range, an intermediate distance range, and a long distance range; and

determine the depth range of the target object according to the depth of the target object and the relationships between the plurality of image resolutions and the plurality of depth ranges.

9. The apparatus according to claim 6 , wherein the depth map generation circuit is further configured to:

identify matching pixels in the scaled left 2D image and the scaled right 2D image by parallel processing at a calculation scale, wherein the calculation scale refers to a number of pixels configured to be matched at a same time;

calculate parallax values of the matched pixels; and

assign intensity levels to the depth map according to the calculated parallax values.

10. The apparatus according to claim 6 , wherein:

the resolution control circuit is configured to determine an effective measurable depth range of the intermediate depth map, and to determine the second image resolution based on the effective measurable depth range, wherein the effective measurable depth refers to a depth with a corresponding measurement resolution greater than or equal to a threshold.

11. A non-transitory computer-readable medium coupled to a processor and storing computer programs that, when being executed by the processor, cause the processor to:

obtain, through a camera, a left two-dimensional (2D) image and a right two-dimensional image, each having a first image resolution;

generate an intermediate depth map based on the left 2D image and the right 2D image;

calculate a depth of a target object based on the intermediate depth map;

determine a depth range of the target object according to the depth of the target object;

determine a resolution corresponding to the depth range that includes the target object, the resolution being defined as a second image resolution;

scale the left 2D image and the right 2D image to obtain a scaled left 2D image and a scaled right 2D image, each having the second image resolution; and

generate an output depth map based on the scaled left 2D image and the scaled right 2D image.

12. The non-transitory computer-readable medium according to claim 11 , wherein the processor is caused by the executed computer programs to:

adjust the generated depth map to a third image resolution; and

output the adjusted depth map.

13. The non-transitory computer-readable medium according to claim 11 , wherein the processor is caused by the executed computer programs to:

correspond a plurality of image resolutions to a plurality of depth ranges to establish relationships between the plurality of image resolutions and the plurality of depth ranges, wherein the plurality of depth ranges include a short distance range, an intermediate distance range, and a long distance range; and

determining the depth range of the target object according to the depth of the target object and the relationships between the plurality of image resolutions and the plurality of depth ranges.

14. The non-transitory computer-readable medium according to claim 11 , wherein the processor is caused by the executed computer programs to:

identify matching pixels in the scaled left 2D image and the scaled right 2D image using parallel processing at a fixed calculation scale, wherein the calculation scale refers to a number of pixels configured to be matched at a same time;

calculate parallax values of the matched pixels; and

assign intensity levels to the depth map according to the calculated parallax values.

15. The non-transitory computer-readable medium according to claim 11 , wherein the processor is caused by the executed computer programs to:

determine an effective measurable depth range of the intermediate depth map, wherein the effective measurable depth refers to a depth with a corresponding measurement resolution greater than or equal to a threshold; and

determine the second image resolution based on the effective measurable depth range of the intermediate depth map.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2017
From: ZHAO, XINGXING; ZHAO, JIBO
To: BOE TECHNOLOGY GROUP CO., LTD
Reel/Frame 041299/0483 →
Continuity (1)
Related Publication 20180184065A1 · Jun 28, 2018