IP Library › Granted Patent US 9,584,733
Granted Patent B2
US 9,584,733 · App. 12/895,637 · Granted Feb 28, 2017

High dynamic range transition

Inventor: Frank Doepke (San Jose, CA)
Assignee: Apple Inc.
H04N5/2355H04N5/225H04N5/23245H04N9/68
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,584,733
App. No.
12/895,637
Granted
Feb 28, 2017
Kind
B2
Abstract

In personal electronic devices including digital imaging capability, methods, devices and computer readable media are described for determining when image capture operations may benefit from using high dynamic range imaging (HDRI) operations. In general, techniques are disclosed for analyzing an image's luminosity and/or color/tonal histograms to automatically determine when HDRI operations can benefit scene capture. If the determination that HDRI operations can improve scene capture, the user is so notified.

Claims (52)

1. A method comprising:

capturing a first image of a scene using an image sensor;

obtaining a histogram representative of the first image, the histogram having a plurality of bins;

determining, from the histogram, if the image sensor's dynamic range has been exceeded by:

receiving an input modifying a previous brightness threshold to a first brightness threshold and an input modifying a previous darkness threshold to a first darkness threshold,

determining a brightness level of the histogram,

determining whether the brightness level exceeds the first brightness threshold, and

determining, if the brightness level does not exceed the first brightness threshold, a darkness level of the histogram; and

presenting to a user a recommendation to switch from a non-high dynamic range operation to a high dynamic range operation for a subsequent capturing of the scene when it is determined that the image sensor's dynamic range has been exceeded, wherein the recommendation can be accepted or declined by the user.

2. The method of claim 1 , further comprising:

receiving user input to use high dynamic range operations; and

capturing, automatically, one or more additional images, each additional image captured using different image exposure setting values from those used when capturing the first image.

3. The method of claim 2 , further comprising:

combining the first image and the one or more additional images into a result image; and

storing the result image in a memory.

4. The method of claim 1 , wherein capturing a first image comprises capturing a preview image.

5. The method of claim 1 , wherein obtaining a histogram comprises obtaining a luminosity histogram.

6. A program storage device, comprising instructions for causing a programmable control device to perform the method of claim 1 .

7. The method of claim 1 , wherein the brightness level is determined by:

counting pixels in a number of histogram bins at the histogram's maximum brightness level, wherein the number of histogram bins is selected based on at least one of sensor noise, capture characteristics, or image type.

8. The method of claim 1 , wherein the darkness level is determined by:

counting pixels in a number of histogram bins at the histogram's maximum darkness level wherein the number of histogram bins is selected based on at least one of sensor noise, capture characteristics, or image type.

9. A digital image capture device, comprising:

a digital image sensor;

a memory communicatively coupled to the digital image sensor; and

a programmable control device communicatively coupled to the memory, wherein the memory includes instructions for causing the programmable control device to perform the method of claim 1 .

10. The digital image capture device of claim 9 , wherein the digital image sensor, memory and programmable control device are incorporated in a personal electronic device.

11. A method comprising:

capturing a first image of a scene using an image sensor;

obtaining a histogram representative of the first image, the histogram having a plurality of bins;

determining, from the histogram, if the image sensor's dynamic range has been exceeded by:

determining a brightness level, wherein the brightness level is determined by counting pixels in a number of histogram bins at the histogram's maximum brightness level, wherein the number of histogram bins is selected based on at least one of sensor noise, capture characteristics, or image type,

determining a darkness level, wherein the darkness level is determined by counting pixels in a number of histogram bins at the histogram's maximum darkness level, wherein the number of histogram bins is selected based on at least one of sensor noise, capture characteristics, and image type, and

presenting to a user a recommendation to switch from a non-high dynamic range operation to a high dynamic range operation for a subsequent capturing when it is determined that the image sensor's dynamic range has exceeded at least one of a modifiable brightness threshold and a modifiable darkness threshold, wherein the recommendation can be accepted or declined by the user.

12. The method of claim 11 , further comprising:

receiving user input to enter the high dynamic range mode of operating the digital image capture device; and

capturing, based on the user input one or more additional images, each additional image captured using different exposure setting values from those used when capturing the image.

13. The method of claim 12 , further comprising:

combining the image and the one or more additional images into a result image; and

storing the result image in the memory.

14. The method of claim 11 , wherein receiving a histogram comprises obtaining a luminosity histogram.

15. A program storage device, comprising instructions for causing a programmable control device to perform the method of claim 11 .

16. A digital image capture device, comprising:

a digital image sensor;

a memory communicatively coupled to the digital image sensor; and

a programmable control device communicatively coupled to the memory, wherein the memory includes instructions for causing the programmable control device to perform the method of claim 11 .

17. The digital image capture device of claim 16 , wherein the digital image sensor, memory and programmable control device are incorporated in a personal electronic device.

18. The digital image capture device of claim 17 wherein the personal electronic device comprises a mobile phone.

19. The method of claim 11 , wherein determining, from the histogram, if the image sensor's dynamic range has been exceeded further comprises:

receiving an input setting a brightness threshold and an input setting a darkness threshold;

determining whether the brightness level exceeds the brightness threshold; and

determining, if the brightness level does not exceed the brightness threshold, whether the darkness level exceeds the darkness threshold.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2010
From: DOEPKE, FRANK
To: APPLE INC.
Reel/Frame 025074/0782 →
Continuity (1)
Related Publication 20120081579A1 · Apr 5, 2012