IP Library › Granted Patent US 9,973,698
Granted Patent B2
US 9,973,698 · App. 14/551,581 · Granted May 15, 2018

Rapid shake detection using a cascade of quad-tree motion detectors

Inventors: Quang Tuan Pham (North Ryde, AU); Amit Kumar Gupta (Epping, AU)
Assignee: Canon Kabushiki Kashia
H04N5/23254G06T7/207
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,973,698
App. No.
14/551,581
Granted
May 15, 2018
Kind
B2
Abstract

A method of determining stability of a camera comprises capturing an image with the camera and then (A) determining a magnitude of motion for each region of a current sub-division of the image. A step (B) then determines a number of the magnitudes of motion not larger than a magnitude threshold associated with the current sub-division, and where the determined number is greater than or equal to a region threshold associated with the number of regions in the current sub-division, (i) determining the camera to be stable, or otherwise (ii) dividing the current sub-division of the image into a further sub-division and repeating steps (A) and (B) upon the further sub-division.

Claims (29)

1. A method of detecting shake of a camera, comprising:

capturing an image with the camera;

determining a magnitude of a motion from at least the image;

where the determined magnitude of motion is not larger than a first threshold, determining the camera to be stable;

where the determined magnitude of motion is larger than the first threshold, determining if a magnitude of motion for each of a number of blocks of the image is larger than at least one further threshold; and

determining the shake of camera based on a number of blocks having a magnitude of motion exceeding the at least one further threshold,

wherein the at least one further threshold comprises a second threshold associated with a first block, and a third threshold associated with a second block whose size is not larger than the first block, and

wherein the at least one further threshold comprises the second threshold associated with a quadtree level 2 number of blocks, and the third threshold associated with a quadtree level 3 number of blocks.

2. A method according to claim 1 , wherein the first threshold is smaller than the at least one further threshold.

3. A method according to claim 1 , wherein the motion between corresponding blocks in the image is computed from correlation of image projection profiles.

4. A method according to claim 3 , wherein the image projection profiles comprise a sum of image intensities along a projection direction of the image projection profiles.

5. A method according to claim 3 , wherein the image projection profiles comprise a sum of image gradient magnitudes along a projection direction of the image projection profiles.

6. A method according to claim 3 , wherein the image projection profiles are complex with a real component and an imaginary component being one of (i) a sum of image intensities along a projection direction of the image projection profiles, and (ii) a sum of image gradient magnitudes along the projection direction.

7. A method according to claim 3 , wherein the image projection profiles are pre-computed for quadtree blocks at a finest level, from which image projection profiles for quadtree blocks at coarser levels are derived.

8. A method of determining stability of a camera, comprising:

capturing an image with the camera;

(A) determining a magnitude of motion for each of a number of blocks of a current sub-division of the image;

(B) determining a number of blocks having magnitudes of motion not larger than a magnitude threshold associated with the current sub-division, and where the determined number is greater than or equal to a region threshold associated with the number of blocks in the current sub-division, (i) determining the camera to be stable, or otherwise (ii) dividing the current sub-division of the image into a further sub-division, and repeating steps (A) and (B) upon the further sub-division,

wherein the sub-division is a global cascading quad-tree sub-division, and

wherein after three traversals of step (B) the camera is not determined to be stable, the camera is deemed to be unstable.

9. A method according to claim 8 wherein step (A) is performed at least twice.

10. Apparatus for detecting shake of a camera, the apparatus comprising:

an input for an image captured with the camera;

a processor coupled to the input and configured to:

determine a magnitude of a motion from at least the image, and where the determined magnitude of motion is not larger than a first threshold, determining the camera to be stable; and

where the determined magnitude of motion is larger than the first threshold, determining if a magnitude of motion for each of a number of blocks of the image is larger than at least one further threshold, and determining the shake of camera based on the number of blocks having a magnitude of motion exceeding the at least one further threshold,

wherein the at least one further threshold comprises a second threshold associated with a first block, and a third threshold associated with a second block whose size is not larger than the first block, and

wherein the at least one further threshold comprises the second threshold associated with a quadtree level 2 number of blocks, and the third threshold associated with a quadtree level 3 number of blocks.

11. Apparatus according to claim 10 wherein the apparatus is one of (i) formed within the camera, (ii) a computing device to which the camera can be coupled, and (iii) a server computer to which the camera couples via a network, and the input includes a memory into which the image captured from the camera is stored.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2015
From: PHAM, QUANG TUAN; GUPTA, AMIT KUMAR
To: CANON KABUSHIKI KAISHA
Reel/Frame 034824/0001 →
Priority Claims (1)
AU 2013260753 · Nov 25, 2013 · national
Continuity (1)
Related Publication 20150146022A1 · May 28, 2015