IP Library Granted Patent US 9,918,015
Granted Patent B2
US 9,918,015 · App. 14/389,791 · Granted Mar 13, 2018

Exposure control using depth information

Inventors: Johannes Elg (Lund, SE); Fredrik Mattisson (Lund, SE); Jonas Gustavsson (Lund, SE); Daniel Linåker (Lund, SE)
Assignees: Sony Corporation; Sony Mobile Communications Inc.
H04N5/2353H04N5/2226H04N13/0271
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,918,015
App. No.
14/389,791
Granted
Mar 13, 2018
Kind
B2
Abstract

The invention is directed to exposure control in a camera. An exemplary method comprises determining depth information associated with a portion of an image frame; obtaining exposure data associated with the portion of the image frame; and controlling an amount of exposure for the portion of the image frame based on the depth information and the exposure data.

Claims (32)

1. A method for exposure control in a camera, the method comprising:

generating a depth map for an image frame to be captured by the camera;

determining, based on the depth map, one or more objects located either closest in distance to the camera or furthest in distance from the camera;

selecting a portion of the image frame that includes the one or more objects closest in distance to the camera or furthest in distance from the camera;

measuring an amount of light in the selected portion of the image frame;

obtaining exposure data associated with the portion of the image frame based on the measured amount of light in the selected portion of the image frame; and

controlling an amount of exposure only for the portion of the image frame based on depth information associated with the depth map and the exposure data.

2. The method of claim 1 , wherein the portion of the image frame includes at least two objects determined, based on the depth map, to be closest in distance to the camera or furthest in distance from the camera.

3. The method of claim 1 , wherein the portion of the image frame is selected by a user of the camera.

4. The method of claim 1 , wherein the depth information enables determination of two-dimensional data associated with the portion of the image frame.

5. The method of claim 1 , wherein the exposure data is associated with histogram data.

6. The method of claim 1 , wherein controlling the amount of exposure comprises increasing the amount of exposure or decreasing the amount of exposure for the portion of the image frame.

7. The method of claim 1 , wherein the camera comprises an array camera, a stereoscopic camera, or a time-of-flight camera.

8. The method of claim 1 , wherein the camera is part of a mobile device.

9. A system for exposure control, the system comprising:

a camera;

a memory;

a processor;

a module, stored in the memory, executable by the processor, and configured to:

generate a depth map for an image frame to be captured by the camera;

determine, based on the depth map, one or more objects located either closest in distance to the camera or furthest in distance from the camera;

select a portion of the image frame that includes the one or more objects closest in distance to the camera or furthest in distance from the camera;

measure an amount of light in the selected portion of the image frame;

obtain exposure data associated with the portion of the image frame based on the measured amount of light in the selected portion of the image frame; and

control an amount of exposure only for the portion of the image frame based on depth information associated with the depth map and the exposure data.

10. A computer program product for exposure control, the computer program product comprising a non-transitory computer-readable medium comprising code configured to:

generate a depth map for an image frame to be captured by the camera;

determine, based on the depth map, one or more objects closets in distance to the camera;

select a portion of the image frame that includes the one or more objects closest in distance to the camera or furthest in distance from the camera;

measure an amount of light in the selected portion of the image frame;

obtain exposure data associated with the portion of the image frame based on the measured amount of light in the selected portion of the image frame; and

control an amount of exposure only for the portion of the image frame based on depth information associated with the depth map and the exposure data.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2019
From: SONY MOBILE COMMUNICATIONS, INC.
To: SONY CORPORATION
Reel/Frame 048691/0134 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2016
From: SONY CORPORATION
To: SONY MOBILE COMMUNICATIONS INC.
Reel/Frame 038542/0224 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2015
From: ELG, JOHANNES; MATTISSON, FREDRIK; GUSTAVSSON, JONAS; LINÅKER, DANIEL
To: SONY CORPORATION
Reel/Frame 034801/0255 →
Continuity (1)
Related Publication 20160261783A1 · Sep 8, 2016