IP Library Granted Patent US 9,813,607
Granted Patent B2
US 9,813,607 · App. 14/360,093 · Granted Nov 7, 2017

Method and apparatus for image capture targeting

Inventors: Ossi Kalevo (Toijala, FI); Riku Suomela (Espoo, FI)
Assignee: Nokia Technologies Oy
H04N5/23212H04N5/23222H04N5/23296H04N5/23219
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,813,607
App. No.
14/360,093
Granted
Nov 7, 2017
Kind
B2
Abstract

In accordance with an example embodiment of the present invention, a method and corresponding apparatus and computer program are disclosed for: receiving images from an image sensor of a camera unit ( 505 ); monitoring locations of different objects in the received images ( 510 ); determining which if any of the different objects is a primary object that is or should be of interest to a user ( 515 ); and detecting if any primary object becomes occluded by another one of the different objects and responsively to detection of such occlusion triggering a first action ( 520 ).

Claims (32)

1. An apparatus comprising:

an input for receiving images from an image sensor of a camera unit;

a processor configured to:

monitor locations of different objects in the received images, wherein the monitoring of locations of different objects involves determining a position of the different objects along an axis extending between the camera unit and the different objects;

determine which if any of the different objects is a primary object that is or should be of interest to a user; and

detect if any primary object becomes occluded by another one of the different objects and responsively to detection of such occlusion to trigger a first action,

wherein the processor is further configured to determine, using the determined position of different objects along the axis extending between the camera unit and the different objects, how much the camera unit should be moved laterally to avoid occlusion of primary objects, and

wherein the first action comprises issuing a movement signal indicative of a direction to which, and how much, the camera unit should be moved laterally to avoid the occlusion.

2. The apparatus of claim 1 , wherein the issuing of a movement signal is subject to the determination of how much the camera unit should be moved so that the movement signal is issued only if a movement smaller than a given threshold is determined necessary.

3. The apparatus of claim 1 , wherein the first action is starting of continuous shooting mode.

4. The apparatus of claim 3 , wherein the processor is further configured, during the continuous shooting mode, to detect and automatically reject some or all of the images in which the occlusion is present.

5. The apparatus of claim 1 , wherein the first action is delaying image capture.

6. The apparatus of claim 5 , wherein the image capture is delayed at most by a given maximum period.

7. The apparatus of claim 6 , wherein the maximum period is dynamically defined depending on one or more factors.

8. The apparatus of claim 7 , the factors comprising one or more of the following: relative speed of the occluded primary object and of an occluding object; whether other images have already been taken where the occluded primary object was captured; sharpness of earlier image or images where the presently the occluded primary object was visible; estimated exposure period; whether a flash unit is used and if so, optionally also the possible flash rate of the flash unit.

9. The apparatus of claim 1 , wherein the apparatus is further configured to receive object information from an auto-focus unit.

10. The apparatus of claim 1 , wherein the processor is configured to detect different objects in the received images.

11. The apparatus of claim 10 , wherein for detecting of the different objects, the processor is configured to cause the camera unit to: change focusing over entire or most of available focusing range, take images at different focusing, and determine objects at different distances based on how different parts of the images become focused and/or unfocused while the focusing is changed.

12. The apparatus of claim 10 , wherein the processor is configured to receive a depth map from the camera unit and use the depth map in determination of the different objects.

13. A method comprising:

receiving images from an image sensor of a camera unit;

monitoring locations of different objects in the received images, wherein the monitoring of locations of different objects involves determining a position of the different objects along an axis extending between the camera unit and the different objects;

determining which if any of the different objects is a primary object that is or should be of interest to a user;

detecting if any primary object becomes occluded by another one of the different objects and responsively to detecting of such occlusion triggering a first action; and

determining, using the determined position of different objects along the axis extending between the camera unit and the different objects, how much the camera unit should be moved laterally to avoid occlusion of primary objects,

wherein the first action comprises issuing a movement signal indicative of a direction to which, and how much, the camera unit should be moved laterally to avoid the occlusion.

14. The method of claim 13 , further comprising detecting different objects in the received images.

15. The method of claim 14 , wherein for detecting of the different objects, cause the camera unit to: change focusing over entire or most of available focusing range, take images at different focusing, and determine objects at different distances based on how different parts of the images become focused and/or unfocused while the focusing is changed.

16. The method of claim 14 , further comprising receiving a depth map from the camera unit and using the depth map in the detecting of the different objects.

17. The apparatus of claim 9 , wherein the object information comprises depth information, and wherein the processor is configured to use the received object information as a basis for the monitoring of locations of different objects in the received images.

18. The apparatus of claim 1 , wherein the monitoring of locations of different objects comprises determining a position of the different objects in a lateral direction.

19. The apparatus of claim 1 , wherein the processor is configured to determine depth of an object by face detection and by calculating a scale of at least one facial feature in an image.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 26, 2015
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 035258/0116 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 17, 2014
From: KALEVO, OSSI; SUOMELA, RIKU
To: NOKIA CORPORATION
Reel/Frame 034186/0446 →
Continuity (1)
Related Publication 20140320668A1 · Oct 30, 2014