IP Library Granted Patent US 9,912,928
Granted Patent B2
US 9,912,928 · App. 15/352,510 · Granted Mar 6, 2018

Systems and methods for generating a digital image

Inventors: William Rivard (Menlo Park, CA); Adam Feder (Mountain View, CA); Brian Kindle (Sunnyvale, CA)
Assignee: Duelight LLC
H04N9/77H04N5/2256H04N5/2257H04N5/2258H04N5/2354H04N5/23206H04N5/247H04N9/09H04N9/097H04N9/735H04N5/23216
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,912,928
App. No.
15/352,510
Granted
Mar 6, 2018
Kind
B2
Abstract

A system, method, and computer program product for generating a digital image is disclosed. The system includes a first image sensor configured to capture a first image that includes a plurality of chrominance values, a second image sensor configured to capture a second image that includes a plurality of luminance values, and an image processing subsystem configured to generate a resulting image by combining the plurality of chrominance values with the plurality of luminance values. The first image sensor and the second image sensor may be distinct image sensors optimized for capturing chrominance images or luminance images.

Claims (39)

1. A system, comprising:

a first image sensor configured to capture a first ambient image comprising a first plurality of chrominance values, and a first strobe image comprising a second plurality of chrominance values;

a second image sensor configured to capture a second ambient image comprising a first plurality of luminance values, and a second strobe image comprising a second plurality of luminance values;

an image processing subsystem configured to generate a first resulting image by combining the first plurality of chrominance values and the first plurality of luminance values;

the image processing subsystem configured to generate a second resulting image by combining the second plurality of chrominance values and the second plurality of luminance values; and

the image processing subsystem configured to generate a third resulting image by combining the first resulting image and the second resulting image.

2. The system of claim 1 , wherein the first ambient image and the second ambient image are captured simultaneously.

3. The system of claim 1 , wherein the first strobe image and the second strobe image are captured simultaneously.

4. The system of claim 1 , wherein the first ambient image is captured with a first set of exposure parameters, and the first strobe image is captured with a second, different set of exposure parameters.

5. The system of claim 1 , wherein at least one of the first ambient image and the second ambient image is warped to correct for a disparate viewpoint.

6. The system of claim 1 , wherein at least one of the first image sensor and the second image sensor utilizes a rolling shutter.

7. The system of claim 1 , wherein the first image sensor is further configured to capture a third ambient image comprising a third plurality of chrominance values, and the second image sensor is further configured to capture a fourth ambient image comprising a third plurality of luminance values.

8. The system of claim 7 , wherein to generate the first resulting image, the image processing subsystem is further configured to combine the third plurality of chrominance values and the third plurality of luminance values with the combined the first plurality of chrominance values and the first plurality of luminance values.

9. The system of claim 1 , further comprising a strobe unit, wherein the image processing subsystem is configured to capture an image under ambient illumination, analyze the image to determine a white balance, and enable the strobe unit to provide strobe illumination of a particular color based on the white balance.

10. The system of claim 9 , further comprising a camera interface unit that is configured to accumulate color statistics for estimating the white balance.

11. The system of claim 9 , wherein the strobe unit comprises a plurality of light-emitting diodes (LEDs) configured to generate at least two different colors of illumination.

12. The system of claim 1 , wherein the first image sensor, second image sensor, and image processing subsystem are included in a wireless mobile device.

13. A method, comprising:

capturing, by a first image sensor, a first ambient image comprising a first plurality of chrominance values, and a first strobe image comprising a second plurality of chrominance values;

capturing, by a second image sensor, a second ambient image comprising a first plurality of luminance values, and a second strobe image comprising a second plurality of luminance values;

generating, by an image processing subsystem, a first resulting image by combining the first plurality of chrominance values and the first plurality of luminance values;

generating, by the image processing subsystem, a second resulting image by combining the second plurality of chrominance values and the second plurality of luminance values; and

generating, by the image processing subsystem, a third resulting image by combining the first resulting image and the second resulting image.

14. The method of claim 13 , wherein the first ambient image and the second ambient image are captured simultaneously.

15. The method of claim 13 , wherein at least one of the first image sensor and the second image sensor utilizes a rolling shutter.

16. The method of claim 13 , wherein generating the first resulting image comprises:

converting the first plurality of chrominance values into a plurality of hue and saturation pairs; and

generating a first pixel of the first resulting image based on at least one of the first plurality of luminance values and at least one hue and saturation pair.

17. A computer program product embodied on a non-transitory computer-readable medium, comprising:

code for causing a first image sensor to capture a first ambient image comprising a first plurality of chrominance values, and a first strobe image comprising a second plurality of chrominance values;

code for causing a second image sensor to capture a second ambient image comprising a first plurality of luminance values, and a second strobe image comprising a second plurality of luminance values;

code for generating a first resulting image by combining the first plurality of chrominance values and the first plurality of luminance values;

code for generating a second resulting image by combining the second plurality of chrominance values and the second plurality of luminance values; and

code for generating a third resulting image by combining the first resulting image and the second resulting image.

18. The computer program product of claim 17 , wherein the first ambient image and the second ambient image are captured simultaneously.

19. The computer program product of claim 17 , wherein at least one of the first image sensor and the second image sensor utilizes a rolling shutter.

20. The computer program product of claim 17 , wherein generating the first resulting image comprises:

converting the first plurality of chrominance values into a plurality of hue and saturation pairs; and

generating a first pixel of the first resulting image based on at least one of the first plurality of luminance values and at least one hue and saturation pair.

Assignments (2)
SECURITY INTEREST Recorded Jul 30, 2021
From: DUELIGHT, LLC
To: ZILKA KOTAB, P.C.
Reel/Frame 057043/0301 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2017
From: RIVARD, WILLIAM; FEDER, ADAM; KINDLE, BRIAN
To: DUELIGHT LLC
Reel/Frame 042321/0607 →
Continuity (2)
Continuation 14702549 · May 1, 2015
Related Publication 20170064276A1 · Mar 2, 2017