IP Library › Granted Patent US 11,120,567
Granted Patent B2
US 11,120,567 · App. 16/842,791 · Granted Sep 14, 2021

Depth map generation device for merging multiple depth maps

Inventor: Chi-Feng Lee (Hsinchu County, TW)
Assignee: eYs3D Microelectronics, Co.
G06T7/596G06T3/40G06T5/006G06T5/50G06T7/593H04N5/23238H04N13/111H04N13/204H04N13/239H04N13/25H04N13/254H04N13/282H04N13/296G06T2207/10028G06T2207/20221G06T2207/20228G06T2219/2016H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,120,567
App. No.
16/842,791
Granted
Sep 14, 2021
Kind
B2
Abstract

A depth map generation device for merging multiple depth maps includes at least three image capturers, a depth map generator, and a mixer. The at least three image capturers form at least two image capture pairs. The depth map generator is coupled to the at least three image capturers for generating a depth map corresponding to each image capturer pair of the at least two image capture pairs according to an image pair captured by the each image capturer. The mixer is coupled to the depth map generator for merging at least two depth maps corresponding to the at least two image capturer pairs to generate a final depth map, wherein the at least two depth maps have different characteristics.

Claims (17)

1. A depth map generation device for merging multiple depth maps, comprising:

at least two image capturers;

a light source emitting structured light, wherein the light source and the at least two image capturers form at least two image capture pairs, respectively;

a depth map generation circuit coupled to the at least two image capturers for generating a depth map corresponding to each image capturer pair of the at least two image capture pairs according to an image comprising the structured light captured by the each image capturer pair; and

a mixing circuit coupled to the depth map generation circuit for merging at least two depth maps corresponding to the at least two image capture pairs to generate a final depth map according to smoothness of each block of the at least two depth maps, and the at least two depth maps have different characteristics.

2. The depth map generation device of claim 1 , wherein the each image capturer pair has a baseline, and the at least two depth maps correspond to at least two baselines.

3. The depth map generation device of claim 1 , wherein the mixing circuit merges a first depth map of the at least two depth maps and a second depth map of the at least two depth maps to generate the final depth map according to smoothness of each block of the first depth map and smoothness of a corresponding block of the second depth map, and both the each block of the first depth map and the corresponding block of the second depth map comprise at least one pixel.

4. The depth map generation device of claim 1 , wherein the at least two image capture pairs have a same optical center.

5. The depth map generation device of claim 1 , wherein the at least two depth maps are represented by disparity.

6. The depth map generation device of claim 1 , wherein when the mixing circuit merges the at least two depth maps to generate the final depth map, the mixing circuit executes an operation on at least one of the at least two depth maps to make disparities of the at least two depth maps match each other.

7. A depth map generation device for merging multiple depth maps, comprising:

an image capture module comprising at least two image capture pairs, and each image capturer pair of the at least two image capture pairs is composed of two image capturers, or composed of an image capturer and a light source;

a depth map generation circuit coupled to the image capture module for generating at least two depth maps corresponding to the at least two image capture pairs according to images captured by the at least two image capture pairs; and

a mixing circuit coupled to the depth map generation circuit for merging the at least two depth maps to generate a final depth map, wherein the at least two depth maps have different characteristics;

wherein when the mixing circuit merges the at least two depth maps to generate the final depth map, the mixing circuit executes normalization on at least one of the at least two depth maps to make disparities of the at least two depth maps match each other.

8. The depth map generation device of claim 7 , wherein the at least two image capture pairs have a same optical center.

9. The depth map generation device of claim 7 , wherein the at least two depth maps are represented by disparity.

Continuity (3)
Continuation 15937797 · Mar 27, 2018
Provisional Application 62479331 · Mar 31, 2017
Related Publication 20200234460A1 · Jul 23, 2020
Cited By (1)
US 12,657,663