IP Library Granted Patent US 12,316,978
Granted Patent B2
US 12,316,978 · App. 18/930,881 · Granted May 27, 2025

Color balance in digital photography

Inventors: William Rivard (Menlo Park, CA); Adam Feder (Mountain View, CA); Brian Kindle (Sunnyvale, CA)
Assignee: DUELIGHT LLC
H04N23/741G06T5/50H04N23/6811H04N23/72H04N23/76G06T2207/20208G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,316,978
App. No.
18/930,881
Granted
May 27, 2025
Kind
B2
Abstract

A technique for generating a digital photograph comprises blending two related images, each sampled according to a different illumination environment. The two related images are blended according to a blend surface function that includes a height discontinuity separating two different blend weight regions. Color consistency between the two related images is achieved by spatial color correction prior to blending. The technique enables a digital camera to generate a strobe image having an appearance of consistent color despite discordant strobe and ambient scene illumination.

Claims (54)

1. An apparatus, comprising:

at least one non-transitory memory;

a touch screen;

a camera; and

one or more processors in communication with the at least one non-transitory memory, the touch screen, and the camera, wherein the one or more processors execute instructions stored in the non-transitory memory to cause the apparatus to:

in response to a detection of user input on a button:

capture, utilizing the camera configured with a first exposure parameter and without a strobe enabled, a first image at a first time,

capture, utilizing the camera configured with a second exposure parameter, a second image at a second time after the first time and without the strobe enabled, and

combine at least a portion of the first image and at least a portion of the second image to generate a first combined image, such that at least a portion of the first combined image is generated based on at least a portion of a third image that is generated by combining at least portions of multiple images before the at least portion of the first image and the at least portion of the second image are combined;

display, utilizing the touch screen, the first combined image;

display, utilizing the touch screen, a slider user interface element; and

in response to a detection of user input on the slider user interface element, adjust the first combined image.

2. The apparatus of claim 1 , wherein the apparatus is configured such that, in response to the detection of the user input on the button: capture, utilizing the camera, a fourth image and a fifth image.

3. The apparatus of claim 2 , wherein the apparatus is configured such that the fourth image is captured after the second time and with the strobe enabled.

4. The apparatus of claim 2 , wherein the apparatus is configured such that the fourth image is stored and is accessible for being displayed utilizing the touch screen.

5. The apparatus of claim 1 , wherein the apparatus is configured such that the first image and the second image are stored and are accessible for being displayed utilizing the touch screen in response to a detection of corresponding user input.

6. The apparatus of claim 1 , wherein the apparatus is configured such that the first combined image includes a high dynamic range (HDR) image.

7. The apparatus of claim 1 , wherein the apparatus is configured such that the at least portion of the third image is generated based on at least a portion of a fourth image that is generated before the third image is generated.

8. The apparatus of claim 1 , wherein the apparatus is configured such that the at least portion of the third image is generated based on at least a portion of a fourth image that is generated before the combination of the at least portion of the first image and the at least portion of the second image.

9. The apparatus of claim 1 , wherein the apparatus is configured such that the at least portions of multiple images include at least a part of the first image and at least a part of the second image.

10. The apparatus of claim 1 , wherein the apparatus is configured such that the first combined image is altered by adding a blurring to at least a portion thereof.

11. The apparatus of claim 1 , wherein the apparatus is configured such that the first image is captured utilizing a first gain in association with a first image portion and a second gain in association with a second image portion.

12. The apparatus of claim 1 , wherein the apparatus is configured such that the first image is captured utilizing a first gain for a first pixel and a second gain for a second pixel.

13. The apparatus of claim 1 , wherein the apparatus is configured such that the at least portion of the first image and the at least portion of the second image is combined to generate the first combined image by including the at least portion of the first image and the at least portion of the second image in the first combined image.

14. The apparatus of claim 1 , wherein the apparatus is configured such that the at least portion of the first image and the at least portion of the second image is combined to generate the first combined image by including, in the first combined image, the at least portion of the first image for a first region of a scene and the at least portion of the second image for a second region of the scene.

15. The apparatus of claim 1 , wherein the apparatus is configured such that the at least portion of the first image and the at least portion of the second image is combined to generate the first combined image by including, in the first combined image, the at least portion of the first image for a first region of a scene without including any portion of the second image for the first region of the scene, and the at least portion of the second image for a second region of the scene without including any portion of the first image for the second region of the scene.

16. The apparatus of claim 1 , wherein the apparatus is configured such that the at least portion of the first combined image is generated based on the at least portion of the third image, by the at least portion of the third image being combined with the at least portion of the first image and the at least portion of the second image.

17. The apparatus of claim 1 , wherein the apparatus is configured such that the at least portion of the first combined image is generated based on the at least portion of the third image, by the at least portion of the third image being included in the first combined image.

18. The apparatus of claim 1 , wherein the apparatus is configured such that the at least portion of the first combined image is generated based on the at least portion of the third image, by including, in the first combined image, the at least portion of the first image for a first region of a scene, the at least portion of the second image for a second region of the scene, and the at least portion of the third image for a third region of the scene.

19. The apparatus of claim 1 , wherein the apparatus is configured such that the at least portion of the first combined image is generated based on the at least portion of the third image, by including, in the first combined image, the at least portion of the first image for a first region of a scene without including any portion of the second image nor the third image for the first region of the scene, the at least portion of the second image for a second region of the scene without including any portion of the first image nor the third image for the second region of the scene, and the at least portion of the third image for a third region of the scene without including any portion of the first image nor the second image for the third region of the scene.

20. The apparatus of claim 1 , wherein the apparatus is configured such that the combining includes a blending.

21. The apparatus of claim 1 , wherein the apparatus is configured such that:

the at least portion of the third image is generated based on at least a portion of a fourth image that is generated before the third image is generated;

the first combined image is altered by adding a blurring to at least a portion thereof; and

the first combined image includes a high dynamic range (HDR) image.

22. The apparatus of claim 1 , wherein the apparatus is configured such that:

the at least portion of the third image is generated based on at least a portion of a fourth image that is generated before the third image is generated;

the first combined image is altered by adding a blurring to at least a portion thereof;

the at least portion of the first combined image is generated based on the at least portion of the third image, by including, in the first combined image, the at least portion of the first image for a first region of a scene, the at least portion of the second image for a second region of the scene, and the at least portion of the third image for a third region of the scene; and

the first combined image includes a high dynamic range (HDR) image.

23. A method, comprising:

at an apparatus including a touch screen and a camera:

in response to a detection of user input on a button:

capturing, utilizing the camera configured with a first exposure parameter and without a strobe enabled, a first image at a first time,

capturing, utilizing the camera configured with a second exposure parameter, a second image at a second time after the first time and without the strobe enabled, and

combining at least a portion of the first image and at least a portion of the second image to generate a first combined image, such that at least a portion of the first combined image is generated based on at least a portion of a third image that is generated by combining at least portions of multiple images before the at least portion of the first image and the at least portion of the second image are combined;

displaying, utilizing the touch screen, the first combined image;

displaying, utilizing the touch screen, a slider user interface element; and

in response to a detection of user input on the slider user interface element, adjusting the first combined image.

24. The method of claim 23 , wherein:

the at least portion of the third image is generated based on at least a portion of a fourth image that is generated before the third image is generated;

the first combined image is altered by adding a blurring to at least a portion thereof;

the first image is captured utilizing a first gain in association with a first image portion and a second gain in association with a second image portion; and

that the first combined image includes a high dynamic range (HDR) image.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE LAST NAME OF SECOND INVENTOR FROM "KIINDLE" TO "KINDLE" PREVIOUSLY RECORDED ON REEL 69381 FRAME 342. ASSIGNOR(S) HEREBY CONFIRMS THE CONFIRMATORY ASSIGNMENT OF PATENT RIGHTS. Recorded Jan 28, 2025
From: FEDER, ADAM BARRY; KINDLE, BRIAN; RIVARD, WILLIAM
To: DUELIGHT LLC
Reel/Frame 070039/0172 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2024
From: FEDER, ADAM BARRY; KIINDLE, BRIAN; RIVARD, WILLIAM
To: DUELIGHT LLC
Reel/Frame 069381/0342 →
Continuity (9)
Continuation In Part 18646581 · Apr 25, 2024
Continuation 17321166 · May 14, 2021
Continuation 16857016 · Apr 23, 2020
Continuation 16519244 · Jul 23, 2019
Continuation 15891251 · Feb 7, 2018
Continuation 14823993 · Aug 11, 2015
Continuation In Part 14568045 · Dec 11, 2014
Continuation 13573252 · Sep 4, 2012
Related Publication 20250056130A1 · Feb 13, 2025
References Cited (12)
US 8976264B2 · Rivard · 2015 [cited by examiner]
US 8977073B2 · Kwon · 2015 [cited by examiner]
US 9406147B2 · Rivard · 2016 [cited by examiner]
US 9918017B2 · Rivard · 2018 [cited by examiner]
US 10382702B2 · Rivard · 2019 [cited by examiner]
US 10652478B2 · Rivard · 2020 [cited by examiner]
US 11025831B2 · Rivard · 2021 [cited by examiner]
US 12003864B2 · Rivard · 2024 [cited by examiner]
US 20070025717A1 · Raskar · 2007 [cited by examiner]
US 20110150357A1 · Prentice · 2011 [cited by examiner]
US 20120069213A1 · Jannard · 2012 [cited by examiner]
Rivard et al., U.S. Appl. No. 19/025,744, filed Jan. 16, 2025. [cited by applicant]
Cited By (2)
US 12,445,736 US 12,666,159