IP Library Granted Patent US 8,977,053
Granted Patent B2
US 8,977,053 · App. 14/136,673 · Granted Mar 10, 2015

Image processing device and image processing method

Inventor: Seiichiro Sakata (Hachioji, JP)
Assignee: Olympus Imaging Corp.
G06K9/00228H04N5/23219
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,977,053
App. No.
14/136,673
Granted
Mar 10, 2015
Kind
B2
Abstract

An image processing device, method and program in which a feature point derivation unit derives a plurality of characteristic points in an input moving image. A tracking subject feature point setting unit sets a feature point within a tracking subject, from the characteristic points. A background feature point setting unit sets a group of background feature points from the characteristic points. The background feature points are not located within the tracking subject. A motion detection unit detects movement over time of the background feature points. A clip area setting unit sets a size and a position of a clip area of an image to be employed which includes the feature point within the tracking subject, on the basis of the movement of the feature point within the tracking subject and the movement of the background feature points, when the motion detection unit detects movement of the background feature points.

Claims (30)

1. An image processing device comprising:

a feature point derivation unit that derives a plurality of characteristic points in an input moving image obtained by photographing an object;

a tracking subject feature point setting unit that sets a feature point within a tracking subject, from the plurality of characteristic points;

a background feature point setting unit that sets a group of background feature points from the plurality of characteristic points, the background feature points not being located within the tracking subject;

a motion detection unit that detects movement over time of the background feature points within the input moving image;

a clip area setting unit that sets a size and a position of a clip area of an image to be employed such that the clip area includes the feature point within the tracking subject, on the basis of the movement of the feature point within the tracking subject and the movement of the background feature points, wherein

when the movement of the background feature points decreases or is not detected, the clip area setting unit sets the clip area in a first setting mode, and

when the movement of the background feature points is detected and does not decrease, the clip area setting unit sets the clip area in a second setting mode different from the first setting mode.

2. The image processing device of claim 1 , wherein the clip area setting unit sets, in the second setting mode, the clip area to surround the feature point within the tracking subject and the background feature points at which the movement has been detected.

3. The image processing device of claim 1 , wherein the motion detection unit further detects following feature points which follow the feature point within the tracking subject, and when the motion detection units detects that the following feature points have moved as a whole relative to the background feature points, the clip area setting unit sets the clip area to surround the feature point within the tracking subject and the following feature points such that a larger amount of space is provided in a movement direction side of the input moving image than an opposite side of the input moving image.

4. The image processing device of claim 1 , further comprising a clip area indication processing unit that indicates the clip area set by the clip area setting unit.

5. The image processing device of claim 1 , further comprising:

a clip processing unit that clips an image out of the input moving image in the clip area set by the clip area setting unit; and

a clipped image recording unit that records the image clipped by the clip processing unit.

6. An image processing method comprising:

deriving a plurality of characteristic points in an input moving image obtained by photographing an object;

setting a feature point within a tracking subject, from the plurality of characteristic points;

setting a group of background feature points from the plurality of characteristic points, the background feature points not being located within the tracking subject;

detecting movement over time of the background feature points within the input moving image; and

setting a size and a position of a clip area of an image to be employed such that the clip area includes the feature point within the tracking subject, on the basis of the movement of the feature point within the tracking subject and the movement of the background feature points, wherein

when the movement of the background feature points decreases or is not detected, the clip area is set in a first setting mode, and

when the movement of the background feature points is detected and does not decrease, the clip area is set in a second setting mode different from the first setting mode.

7. A non-transitory computer-readable storage device storing an image processing program, the image processing program instructs a computer to perform:

a feature point derivation procedure for deriving a plurality of characteristic points in an input moving image obtained by photographing an object;

a tracking subject feature point setting procedure for setting a feature point within a tracking subject, from the plurality of characteristic points;

a background feature point setting procedure for setting a group of background feature points from the plurality of characteristic points; the background feature points not being located within the tracking subject;

a motion detection procedure for detecting movement over time of the background feature points within the input moving image; and

a clip area setting procedure for setting a size and a position of a clip area of an image to be employed such that the clip area includes the feature point within the tracking subject, on the basis of the movement of the feature point within the tracking subject and the movement of the background feature points, wherein

when the movement of the background feature points decreases or is not detected, the clip area setting procedure sets the clip area in a first setting mode, and

when the movement of the background feature points is detected and does not decrease, the clip area setting procedure sets the clip area in a second setting mode different from the first setting mode.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2021
From: OLYMPUS CORPORATION
To: OM DIGITAL SOLUTIONS CORPORATION
Reel/Frame 058901/0912 →
CHANGE OF ADDRESS Recorded Jun 27, 2016
From: OLYMPUS CORPORATION
To: OLYMPUS CORPORATION
Reel/Frame 039344/0502 →
MERGER Recorded Aug 5, 2015
From: OLYMPUS IMAGING CORP.
To: OLYMPUS CORPORATION
Reel/Frame 036279/0239 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2013
From: SAKATA, SEIICHIRO
To: OLYMPUS IMAGING CORP.
Reel/Frame 031831/0257 →
Priority Claims (1)
JP 2011-67164 · Mar 25, 2011 · national
Continuity (2)
Division 13358221 · Jan 25, 2012
Related Publication 20140105460A1 · Apr 17, 2014