IP Library Granted Patent US 10,375,369
Granted Patent B2
US 10,375,369 · App. 16/154,999 · Granted Aug 6, 2019

Systems and methods for generating a digital image using separate color and intensity data

Inventors: William Rivard (Menlo Park, CA); Adam Feder (Mountain View, CA); Brian Kindle (Sunnyvale, CA)
Assignee: DUELIGHT LLC
H04N9/77H04N5/2256H04N5/2257H04N5/2258H04N5/2354H04N5/23206H04N5/247H04N9/045H04N9/09H04N9/097H04N9/735H04N5/23216
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,375,369
App. No.
16/154,999
Granted
Aug 6, 2019
Kind
B2
Abstract

A system, method, and computer program product for generating a digital image is disclosed. The system includes a first image sensor configured to capture a first image that includes a plurality of chrominance values, a second image sensor configured to capture a second image that includes a plurality of luminance values, and an image processing subsystem configured to generate a resulting image by combining the plurality of chrominance values with the plurality of luminance values. The first image sensor and the second image sensor may be distinct image sensors optimized for capturing chrominance images or luminance images.

Claims (50)

1. A system, comprising:

a first image sensor configured to capture a first image and a second image, wherein the first image sensor detects visible light color;

a second image sensor configured to capture a third image and a fourth image, wherein the second image sensor detects non-visible light intensity; and

an image processing subsystem configured to:

generate a first combined image by combining the first image and the second image;

generate a second combined image by combining the third image and the fourth image; and

generate a resulting image by combining the first combined image and the second combined image.

2. The system of claim 1 , further comprising:

a first lens that focuses light from a photographic scene onto the first image sensor, and

a second lens that focuses light from the photographic scene onto the second image sensor.

3. The system of claim 1 , further comprising a lens that focuses light from a photographic scene onto a beam splitter that is configured to split the light from the photographic scene onto the first image sensor and the second image sensor.

4. The system of claim 1 , wherein the first image sensor comprises a first portion of photodiodes included in a photodiode array and the second image sensor comprises a second portion of photodiodes included in the photodiode array.

5. The system of claim 1 , wherein the first image sensor and the second image sensor sample images utilizing a global shutter operation.

6. The system of claim 1 , wherein the first image sensor and the second image sensor sample images utilizing a rolling shutter operation.

7. The system of claim 1 , wherein one of the first image sensor and the second image sensor samples images utilizing a rolling shutter operation and the other of the first image sensor and the second image sensor samples images utilizing a global shutter operation.

8. The system of claim 1 , further comprising a strobe unit, and wherein at least one of the first image and the third image, or the second image and the fourth image, are sampled under strobe illumination.

9. The system of claim 8 , wherein the strobe unit includes a red light-emitting diode (LED), a green LED, and a blue LED.

10. The system of claim 9 , wherein the image processing subsystem is configured to capture the first image and the second image under ambient illumination, analyze the first image and the second image to determine a white balance setting, and enable the strobe unit to provide strobe illumination of a particular color based on the white balance setting.

11. The system of claim 1 , wherein the resulting image is generated by:

for each pixel in the resulting image:

determining a corresponding pixel in the first combined image, wherein the corresponding pixel in the first combined image is associated with a color specified by a red value, a green value, and a blue value;

converting the color specified by the red value, the green value, and the blue value into a Hue-Saturation-Value model that specifies the color using a Hue value, a Saturation value, and a Value value;

determining a corresponding pixel in the second combined image, wherein the corresponding pixel in the second combined image is associated with an intensity value; and

combining the intensity value with the Hue value and the Saturation value to specify a color for the pixel in the resulting image.

12. The system of claim 1 , wherein the first image sensor, the second image sensor, and the image processing subsystem are included in at least one of a wireless mobile device or a digital camera.

13. The system of claim 1 , wherein at least one of the third image or the fourth image includes infrared intensity information or ultraviolet intensity information.

14. A method, comprising:

receiving a first image and a second image from a first image sensor, wherein the first image sensor detects visible light color;

receiving a third image and a fourth image from a second image sensor, wherein the second image sensor detects non-visible light intensity; and

using an image processing subsystem for:

generating a first combined image by combining the first image and the second image;

generating a second combined image by combining the third image and the fourth image; and

generating a resulting image by combining the first combined image and the second combined image.

15. The method of claim 14 , wherein generating the resulting image comprises:

for each pixel in the resulting image:

determining a corresponding pixel in the first combined image, wherein the corresponding pixel in the first combined image is associated with a color specified by a red value, a green value, and a blue value;

converting the color specified by the red value, the green value, and the blue value into a Hue-Saturation-Value model that specifies the color using a Hue value, a Saturation value, and a Value value;

determining a corresponding pixel in the second combined image, wherein the corresponding pixel in the second combined image is associated with an intensity value; and

combining the intensity value with the Hue value and the Saturation value to specify a color for the pixel in the resulting image.

16. The method of claim 14 , wherein at least one of the third image or the fourth image includes infrared intensity information or ultraviolet intensity information.

17. The method of claim 14 , wherein a beam splitter directs light from a photographic scene onto the first image sensor and the second image sensor simultaneously.

18. A computer program product comprising computer executable instructions stored on a non-transitory computer readable medium that when executed by a processor instruct the processor to:

receive a first image and a second image from a first image sensor, wherein the first image sensor detects visible light color;

receive a third image and a fourth image from a second image sensor, wherein the second image sensor detects non-visible light intensity; and

use an image processing subsystem to:

generate a first combined image by combining the first image and the second image;

generate a second combined image by combining the third image and the fourth image; and

generate a resulting image by combining the first combined image and the second combined image.

19. The computer program product of claim 18 , wherein at least one of the third image or the fourth image includes infrared intensity information or ultraviolet intensity information.

20. The computer program product of claim 18 , wherein a beam splitter directs light from a photographic scene onto the first image sensor and the second image sensor simultaneously.

Assignments (2)
SECURITY INTEREST Recorded Jul 30, 2021
From: DUELIGHT, LLC
To: ZILKA KOTAB, P.C.
Reel/Frame 057043/0301 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2018
From: RIVARD, WILLIAM; FEDER, ADAM; KINDLE, BRIAN
To: DUELIGHT LLC
Reel/Frame 047772/0415 →
Continuity (4)
Continuation 15885296 · Jan 31, 2018
Continuation 15352510 · Nov 15, 2016
Continuation 14702549 · May 1, 2015
Related Publication 20190045165A1 · Feb 7, 2019
Cited By (5)
US 12,401,911 US 12,401,912 US 12,418,727 US 12,445,736 US 12,666,159