IP Library Granted Patent US 8,830,227
Granted Patent B2
US 8,830,227 · App. 12/958,427 · Granted Sep 9, 2014

Depth-based gain control

Inventors: Dmitry Rais (Ramat Gan, IL); Daniel Cohen (Tel Aviv, IL); Erez Sali (Savyon, IL)
Assignee: Primesense Ltd.
H04N13/0253G06T7/0057
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,830,227
App. No.
12/958,427
Granted
Sep 9, 2014
Kind
B2
Abstract

A method for depth mapping includes capturing an electronic image of a scene using an imaging device. The electronic image is processed to generate depth data with respect to the scene. The gain of the imaging device is set responsively to the depth data.

Claims (17)

1. A method for depth mapping, comprising:

capturing an image of a scene using an imaging device, which comprises a matrix of detector elements and which is configured to output an electronic signal representing the captured image, wherein the imaging device has a gain that determines a relation between an intensity of radiation incident on the detector elements and a magnitude of the electronic signal;

processing the electronic signal output by the imaging device in response to a first image to generate depth data with respect to the scene; and

setting the gain of the imaging device that is to be applied to one or more second images, captured subsequently to the first image by selecting a pre-calibrated gain value based on the depth data.

2. The method according to claim 1 , wherein capturing the electronic image comprises projecting a pattern of optical radiation onto the scene, and wherein processing the electronic signal comprises computing the depth data based on transverse shifts of the pattern in the image.

3. The method according to claim 1 , wherein processing the electronic signal comprises creating and outputting a depth map of the scene.

4. The method according to claim 3 , wherein setting the gain comprises extracting a representative depth value from the depth map, and selecting the gain responsively to the representative depth value.

5. The method according to claim 4 , wherein extracting the representative depth value comprises computing a histogram of the depth data in the depth map, and selecting the representative depth value based on a set of high-frequency bins in the histogram.

6. The method according to claim 1 , and comprising, prior to capturing the electronic image of the scene, computing gain calibration data by capturing and processing multiple images of a calibration object placed at different, respective distances from the imaging device, wherein the pre-calibrated gain value is selected based on the gain calibration data.

7. Apparatus for depth mapping, comprising:

an imaging device, which comprises a matrix of detector elements configured to capture an image of a scene and which is configured to output an electronic signal representing the captured image, wherein the imaging device has a gain that determines a relation between an intensity of radiation incident on the detector elements and a magnitude of the electronic signal; and

a processor, which is configured to process the electronic signal output by the imaging device in response to a first image in order to generate depth data with respect to the scene, and to set the gain of the imaging device that is to be applied to one or more second images, captured subsequently to the first image, by selecting a pre-calibrated gain value based on the depth data.

8. The apparatus according to claim 7 , wherein the imaging device is configured to project a pattern of optical radiation onto the scene, and wherein the processor is configured to compute the depth data based on transverse shifts of the pattern in the image.

9. The apparatus according to claim 7 , wherein the processor is configured to create and output a depth map of the scene, comprising the depth data, based on the electronic image.

10. The apparatus according to claim 9 , wherein the processor is configured to extract a representative depth value from the depth map, and to select the gain responsively to the representative depth value.

11. The apparatus according to claim 10 , wherein the processor is configured to compute a histogram of the depth data in the depth map, and to select the representative depth value based on a set of high-frequency bins in the histogram.

12. The apparatus according to claim 7 , wherein prior to capturing the electronic image of the scene, gain calibration data are computed by capturing and processing multiple images of a calibration object placed at different, respective distances from the imaging device, wherein the processor is configured to select the pre-calibrated gain value based on the gain calibration data.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION # 13840451 AND REPLACE IT WITH CORRECT APPLICATION # 13810451 PREVIOUSLY RECORDED ON REEL 034293 FRAME 0092. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded May 11, 2015
From: PRIMESENSE LTD.
To: APPLE INC.
Reel/Frame 035624/0091 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2014
From: PRIMESENSE LTD.
To: APPLE INC.
Reel/Frame 034293/0092 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2010
From: RAIS, DMITRY; COHEN, DANIEL; SALI, EREZ
To: PRIMESENSE LTD.
Reel/Frame 025436/0167 →
Continuity (2)
Provisional Application 61267050 · Dec 6, 2009
Related Publication 20110134114A1 · Jun 9, 2011