IP Library Granted Patent US 10,171,745
Granted Patent B2
US 10,171,745 · App. 14/587,462 · Granted Jan 1, 2019

Exposure computation via depth-based computational photography

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,171,745
App. No.
14/587,462
Granted
Jan 1, 2019
Kind
B2
Abstract

A method and electronic information handling system provide recording a first image of a scene at a first exposure level using a three-dimensional (3D) camera, correlating distances from the 3D camera and exposure levels over a plurality of image elements of the first image, selecting an exposure parameter value for at least one of the plurality of image elements having a z-distance value falling within a range of z-distance values, recording a second image of the scene according to the exposure parameter value, and constructing a composite image based on at least a portion of the second image for the at least one of the plurality of image elements.

Claims (47)

1. A method in an electronic information handling system comprising:

recording a first image of a scene at a first exposure level using a three-dimensional (3D) camera;

correlating distances from the 3D camera and exposure levels over a plurality of image elements of the first image;

selecting a first exposure parameter value for at least one of the plurality of image elements having a z-distance value falling within a range of z-distance values;

recording a second image of the scene according to the first exposure parameter value selected for the at least one of the plurality of image elements having a second exposure level; and

constructing a composite image based on at least a portion of the second image for the at least one of the plurality of image elements.

2. The method of claim 1 further comprising:

selecting a second exposure parameter value for at least another of the plurality of image elements having a different z-distance value falling within another range of z-distance values;

recording a third image of the scene according to the second exposure parameter value, wherein the constructing further comprises constructing the composite image based on the at least the portion of the second image for the at least one of the plurality of image elements and based on at least a portion of the third image for the at least another of the plurality of image elements.

3. The method of claim 1 wherein the constructing further comprises constructing the composite image based on the at least a portion of the second image for the at least one of the plurality of image elements and based on at least a portion of the first image for at least another of the plurality of image elements.

4. The method of claim 1 further comprising:

illuminating at least a portion of the scene including the at least one of the plurality of image elements based on the exposure parameter value.

5. The method of claim 4 wherein the illuminating comprises:

modulating an illumination source on the 3D camera in accordance with the exposure parameter value.

6. The method of claim 1 wherein the constructing the composite image based on the at least the portion of the second image for the at least one of the plurality of image elements comprises:

constructing the composite image from portions of a plurality of images recorded according to different exposure parameter values, wherein the portions of the plurality of images comprise the at least the portion of the second image and the different exposure parameter values comprise, for the at least the portion of the second image, the exposure parameter value, and wherein the portions correspond to different objects located at different distances of the distances from the 3D camera.

7. The method of claim 1 wherein the selecting the exposure parameter value for the at least one of the plurality of image elements further comprises:

selecting the exposure parameter value for a group of the plurality of image elements within a depth range of z-distance values.

8. An information handling system comprising:

a three-dimensional (3D) camera for recording a first image of a scene at a first exposure level;

a processor coupled to the 3D camera; and

memory coupled to the processor, the memory for storing instructions executable by the processor, the instructions, when executed by the processor, for causing the processor to correlate distances from the 3D camera and exposure levels over a plurality of image elements of the first image, to select a first exposure parameter value for at least one of the plurality of image elements having a z-distance value falling within a range of z-distance values, to record a second image of the scene according to the first exposure parameter value selected for at least one of the plurality of image elements having the z-distance value falling within the range of z-distance values, and to construct a composite image based on at least a portion of the second image for the at least one of the plurality of image elements.

9. The information handling system of claim 8 wherein the memory stores further instructions, when executed by the processor, for causing the processor to select a second exposure parameter value for at least another of the plurality of image elements having a different z-distance value falling within another range of z-distance values, and to record a third image of the scene according to the second exposure parameter value, wherein the constructing further comprises constructing the composite image based on the at least the portion of the second image for the at least one of the plurality of image elements and based on at least a portion of the third image for the at least another of the plurality of image elements.

10. The information handling system of claim 8 wherein the instructions for causing the processor to construct the composite image further comprise instructions for causing the processor to construct the composite image based on the at least a portion of the second image for the at least one of the plurality of image elements and based on at least a portion of the first image for at least another of the plurality of image elements.

11. The information handling system of claim 8 wherein the memory stores further instructions, when executed by the processor, for causing the processor to control illumination of at least a portion of the scene including the at least one of the plurality of image elements based on the exposure parameter value.

12. The information handling system of claim 11 further comprising:

an illumination source configured to be modulated in accordance with the exposure parameter value.

13. The information handling system of claim 8 wherein the instructions cause the processor to select an attribute value of an attribute selected from a group consisting of an illumination source on the 3D camera, an exposure speed of the 3D camera, and a sensitivity of the 3D camera is based on the exposure parameter value.

14. The information handling system of claim 8 wherein the instructions for causing the processor to select the exposure parameter value for the at least one of the plurality of image elements further comprise instructions for causing the processor to select the exposure parameter value for a group of the plurality of image elements within a depth range of z-distance values.

15. A method in an electronic information handling system comprising:

obtaining a first image of a scene at a first exposure level using a three-dimensional (3D) camera;

segmenting the first image into a plurality of image elements based on ranges of depth of z-distances from the 3D camera to objects in the scene;

determining a first group of the plurality of image elements representing a foreground object of interest in the scene based on a first range of the depth of z-distances;

determining a second group of the plurality of image elements representing a background area in the scene based on a second range of the depth of z-distances;

selecting a first exposure parameter value for the first group of the plurality of image elements;

obtaining a second image of the scene according to the first exposure parameter value selected for the first group of the plurality of image elements; and

constructing a composite image based on at least a portion of the second image for at least a portion of the first group of the plurality of image elements.

16. The method of claim 15 further comprising:

selecting a second exposure parameter value for at least another of the plurality of image elements;

obtaining a third image of the scene according to the second exposure parameter value, wherein the constructing further comprises constructing the composite image based on the at least the portion of the second image for the at least the portion of the first group of the plurality of image elements and based on at least a portion of the third image for the at least a portion of the second group of the plurality of image elements.

17. The method of claim 15 wherein the constructing further comprises constructing the composite image based on the at least a portion of the second image for the at least the portion of the first group of the plurality of image elements and based on at least a portion of the first image for at least a portion of the second group of the plurality of image elements.

18. The method of claim 15 further comprising:

illuminating at least a portion of the scene including the at least the portion of the first group of the plurality of image elements based on the first exposure parameter value.

19. The method of claim 18 wherein the illuminating comprises:

modulating an illumination source for the 3D camera in accordance with the exposure parameter value.

20. The method of claim 15 wherein the selecting the first exposure parameter value for the first group of the plurality of image elements further comprises:

selecting the exposure parameter value for the first group of the plurality of image elements within a subset range within the first range of the depth of z-distances.

Assignments (15)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061753/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (040136/0001) Recorded Apr 26, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061324/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 3, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL, L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058216/0001 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2017
From: BASCHE, TODD; ANCONA, ROCCO
To: DELL PRODUCTS, LP
Reel/Frame 044103/0750 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 040136/0001 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 040134/0001 →
RELEASE OF REEL 035104 FRAME 0043 (NOTE) Recorded Sep 14, 2016
From: BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
To: DELL SOFTWARE INC.; DELL PRODUCTS L.P.; COMPELLENT TECHNOLOGIES, INC.
Reel/Frame 040027/0123 →
RELEASE OF REEL 035103 FRAME 0809 (TL) Recorded Sep 14, 2016
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: DELL SOFTWARE INC.; DELL PRODUCTS L.P.; COMPELLENT TECHNOLOGIES, INC.
Reel/Frame 040027/0934 →
RELEASE OF REEL 035103 FRAME 0536 (ABL) Recorded Sep 13, 2016
From: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
To: DELL SOFTWARE INC.; DELL PRODUCTS L.P.; COMPELLENT TECHNOLOGIES, INC.
Reel/Frame 040016/0864 →
SUPPLEMENT TO PATENT SECURITY AGREEMENT (ABL) Recorded Feb 26, 2015
From: DELL PRODUCTS L.P.; DELL SOFTWARE INC.; COMPELLENT TECHNOLOGIES, INC.
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 035103/0536 →
SUPPLEMENT TO PATENT SECURITY AGREEMENT (TERM LOAN) Recorded Feb 26, 2015
From: DELL PRODUCTS L.P.; DELL SOFTWARE INC.; COMPELLENT TECHNOLOGIES, INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 035103/0809 →
SUPPLEMENT TO PATENT SECURITY AGREEMENT (NOTES) Recorded Feb 26, 2015
From: DELL PRODUCTS L.P.; DELL SOFTWARE INC.; COMPELLENT TECHNOLOGIES, INC.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 035104/0043 →