IP Library Granted Patent US 9,420,166
Granted Patent B2
US 9,420,166 · App. 14/378,514 · Granted Aug 16, 2016

Method and apparatus for enhanced automatic adjustment of focus, exposure and white balance in digital photography

Inventor: Matti Hamalainen (Lempaala, FI)
Assignee: Nokia Technologies Oy
H04N5/23216G02B7/36H04N5/232H04N5/23222H04N9/735
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,420,166
App. No.
14/378,514
Granted
Aug 16, 2016
Kind
B2
Abstract

A method, apparatus and computer program are described where signals are received from a camera unit ( 310 ) having an image sensor with a plurality of image detectors. The signals include first signals received from first pixel detectors corresponding to a first image area and second signals received from second pixel detectors corresponding to a second image area surrounding the first image area. Camera settings of a setting group are automatically controlled ( 340 ) based on the first signals. The settings group has at least one of focus control, exposure control and white balance control. Changes in the setting group are predicted based on the second signals. A change is detected in the first image area and used to adapt the automatic control ( 340 ) of the camera settings of the settings group. Control signals are output to the camera unit ( 310 ) to control ( 340 ) the camera settings of the settings group.

Claims (37)

1. An apparatus, comprising:

an input configured to receive signals from a camera unit having an image sensor with a plurality of image detectors, the signals comprising first signals received from first pixel detectors corresponding to a first image area and second signals received from second pixel detectors corresponding to a second image area surrounding the first image area; and

at least one processor configured to:

receive the first and second signals from the input;

automatically control camera settings of a setting group comprising at least one of focus control, exposure control and white balance control, based on the first signals;

predict changes in the setting group based on the second signals; and

detect a change in the first image area and use the predicted changes to adapt the automatic control of the camera settings of the setting group;

the apparatus further comprising, an output configured to output control signals to the camera unit, the control signals being configured to control the camera settings of the setting group;

wherein:

the at least one processor is further configured to predict changes in the first and second signals; and

the at least one processor is further configured to perform the predicting of the changes in the setting group based on the predicted changes in the first and second signals.

2. The apparatus of claim 1 , wherein the at least one processor is further configured to detect changes in an image object from at least the other of the first and second signals and to use the detected changes in the image object in the predicting of the changes in the setting group.

3. The apparatus of claim 1 , wherein the change in the first image area comprises changing field of view visible to the image sensor.

4. The apparatus of claim 1 , wherein the change in the first image area comprises digital panning.

5. The apparatus of claim 1 , wherein the change in the first image area comprises changing of an image object.

6. The apparatus of claim 1 , wherein the second image area is received from a number of the first pixel detectors that is at least 50% of a number of the second pixel detectors.

7. The apparatus of claim 1 , wherein the at least one processor is further configured to form segments for the first and second image areas based on image content in the first and second image areas.

8. The apparatus of claim 1 , further comprising the image sensor.

9. The apparatus of claim 1 , wherein the at least one processor is further configured to track an image object and to correspondingly change the first image area.

10. The apparatus of claim 1 , wherein the at least one processor is further configured to perform image segmentation and to calculate image parameters for image segments formed in the image segmentation.

11. The apparatus of claim 10 , wherein the at least one processor is further configured to predict next second image area location.

12. The apparatus of claim 10 , wherein the at least one processor is further configured to predict next second image area location in a parallel process with the image segmentation.

13. The apparatus of claim 11 , wherein the at least one processor configured to perform the predicting of the changes in the setting group based on the calculated image parameters and the predicted second image area location.

14. The apparatus of claim 10 , wherein the at least one processor is further configured to predict active image segments for next second image area.

15. The apparatus of claim 10 , wherein the at least one processor is further configured to predict active image segments for next second image area in a parallel process with the image segmentation.

16. The apparatus of claim 14 , wherein the at least one processor configured to perform the predicting of the changes in the setting group based on the calculated image parameters and the predicted second image area location.

17. A method comprising:

receiving signals from a camera unit having an image sensor with a plurality of image detectors, the signals comprising first signals received from first pixel detectors corresponding to a first image area and second signals received from second pixel detectors corresponding to a second image area surrounding the first image area;

automatically controlling camera settings of a setting group comprising at least one of focus control, exposure control and white balance control, based on the first signals;

predicting changes in the setting group based on the second signals;

detecting a change in the first image area and using the predicted changes to adapt the automatic control of the camera settings of the setting group;

outputting control signals to the camera unit, the control signals being configured to control the camera settings of the setting group;

predicting changes in the first and second signals; and

performing the predicting of the changes in the setting group based on the predicted changes in the first and second signals.

18. The method of claim 17 , further comprising:

detecting changes in an image object from at least the other of the first and second signals; and

using the detected changes in the image object in the predicting of the changes in the setting group.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 26, 2015
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 035258/0087 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2014
From: HAMALAINEN, MATTI
To: NOKIA CORPORATION
Reel/Frame 033938/0512 →
Continuity (1)
Related Publication 20150029357A1 · Jan 29, 2015