IP Library Granted Patent US 9,154,728
Granted Patent B2
US 9,154,728 · App. 13/738,280 · Granted Oct 6, 2015

Image processing apparatus, image capturing apparatus, and program

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,154,728
App. No.
13/738,280
Granted
Oct 6, 2015
Kind
B2
Abstract

An exemplary image processing apparatus generates an interpolation frame to be inserted between a first frame and a second frame, contiguous with each other, of a moving picture obtained by an image capturing apparatus. The image processing apparatus includes: a motion vector calculation section configured to calculate a motion vector of an object by performing a block matching operation between the first and second frames; and an interpolation frame generation section configured to generate the interpolation frame through a process performed based on a magnitude of motion of the image capturing apparatus from a point in time when the first frame is obtained to a point in time when the second frame is obtained.

Claims (25)

1. An image processing apparatus for generating an interpolation frame to be inserted between a first frame and a second frame, contiguous with each other, of a moving picture obtained by an image capturing apparatus, the image processing apparatus comprising:

a motion vector calculation section configured to calculate a motion vector of an object by performing a matching operation between the first and second frames; and

an interpolation frame generation section configured to generate the interpolation frame such that:

the dependence of the interpolation frame on the calculated motion vector is increased if a detected magnitude of motion is less than or equal to a threshold value; and

the dependence of the interpolation frame on the calculated motion vector is decreased if the detected magnitude of motion is greater than the threshold value;

wherein the detected magnitude of motion represents motion of the image capturing apparatus from a point in time when the first frame is obtained to a point in time when the second frame is obtained, wherein the magnitude of motion is detected independent of content of the first and second frames.

2. The image processing apparatus of claim 1 , wherein the interpolation frame generation section is configured to generate, as the interpolation frame, a frame representing a transitional state between the first and second frames dictated based on the motion vector if the magnitude of motion representing motion of the image capturing apparatus is less than a predetermined threshold value, and otherwise generate, as the interpolation frame, a frame that is less dependent on the motion vector than a frame representing the transitional state.

3. The image processing apparatus of claim 2 , wherein the threshold value is set based on a size of a search range of the matching operation.

4. The image processing apparatus of claim 2 , wherein the interpolation frame generation section is configured to generate, as the interpolation frame, a frame obtained through a process including an arithmetic mean between the first and second frames if the magnitude of motion representing motion of the image capturing apparatus is greater than the threshold value.

5. The image processing apparatus of claim 4 , wherein the interpolation frame generation section is configured to generate, as the interpolation frame, a synthetic frame between a frame representing the transitional state and a frame obtained by an arithmetic mean between the first and second frames if the magnitude of motion representing motion of the image capturing apparatus is greater than the threshold value.

6. The image processing apparatus of claim 5 , wherein the interpolation frame generation section is configured to generate the synthetic frame by synthesizing together a frame representing the transitional state and a frame obtained by an arithmetic mean between the first and second frames at a different ratio depending on the magnitude of motion representing motion of the image capturing apparatus.

7. The image processing apparatus of claim 2 , wherein the interpolation frame generation section is configured to use the first frame or the second frame as the interpolation frame if the magnitude of motion of the image capturing apparatus is greater than the threshold value.

8. The image processing apparatus of claim 1 , wherein:

the motion vector calculation section is configured to divide each of the first and second frames into a plurality of blocks to calculate the motion vector by performing a matching operation for each of the divided blocks; and

the interpolation frame generation section is configured to generate the interpolation frame based on the motion vector calculated for each of the blocks.

9. An image capturing apparatus comprising:

the image processing apparatus of claim 1 ;

an image capturing section configured to generate data of a moving picture including the first and second frames through an image capturing operation; and

a motion detector configured to detect a motion of the image capturing apparatus and output the magnitude of motion representing motion of the image capturing section.

10. A computer program, stored on a non-transitory computer-readable medium, to be executed by a computer mounted in an image processing apparatus for generating an interpolation frame to be inserted between a first frame and a second frame, contiguous with each other, of a moving picture obtained by an image capturing apparatus, the computer program instructing the computer to execute the steps of:

calculating a motion vector of an object by performing a matching operation between the first and second frames; and

generating the interpolation frame such that:

the dependence of the interpolation frame on the calculated motion vector is increased if a detected magnitude of motion is less than or equal to a threshold value; and

the dependence of the interpolation frame on the calculated motion vector is decreased if the detected magnitude of motion is greater than the threshold value;

wherein the detected magnitude of motion representing motion of the image capturing apparatus from a point in time when the first frame is obtained to a point in time when the second frame is obtained, wherein the magnitude of motion is detected independent of content of the first and second frames.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED APPLICATION NUMBERS 13/384239, 13/498734, 14/116681 AND 14/301144 PREVIOUSLY RECORDED ON REEL 034194 FRAME 0143. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 24, 2020
From: PANASONIC CORPORATION
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 056788/0362 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2014
From: PANASONIC CORPORATION
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 034194/0143 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2014
From: NAKASHIMA, TOSHIYUKI
To: PANASONIC CORPORATION
Reel/Frame 032001/0459 →