IP Library Granted Patent US 8,274,602
Granted Patent B2
US 8,274,602 · App. 12/752,868 · Granted Sep 25, 2012

Image processing apparatus and image processing method with redundant frame detection

Assignee: Kabushiki Kaisha Toshiba
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,274,602
App. No.
12/752,868
Granted
Sep 25, 2012
Kind
B2
Abstract

According to one embodiment, an image processing apparatus includes a motion estimation module, a redundant frame determination module and an interpolation frame generation module. The motion estimation module calculates motion vectors for respective pixel blocks in each frame in moving image data by estimating motion between frames in the moving image data. The redundant frame determination module determines whether a target frame is a redundant frame based on the motion vectors corresponding to the target frame and the motion vectors corresponding to a frame preceding the target frame. The interpolation frame generation module discards the target frame if the target frame is a redundant frame, and generates an interpolation frame between the target frame and the preceding frame by motion compensation using the motion vectors corresponding to the target frame and outputs the interpolation frame and the target frame, if the target frame is a non-redundant frame.

Claims (28)

1. An image processing apparatus comprising:

a motion estimation module configured to calculate motion vectors for respective blocks in each frame in moving image data by estimating motion between frames in the moving image data;

a redundant frame determination module configured to determine whether a target frame is a redundant frame based on the motion vectors corresponding to the target frame and the motion vectors corresponding to a non-redundant frame preceding the target frame;

an interpolation frame generation module configured to discard the target frame if the target frame is a redundant frame, and to generate an interpolation frame between the target frame and the preceding non-redundant frame by motion compensation using the motion vectors corresponding to the target frame and to output the interpolation frame and the target frame, if the target frame is a non-redundant frame; and

a data storing module configured to store the target frame as the preceding non-redundant frame and to store the motion vectors corresponding to the target frame as motion vectors corresponding to the preceding non-redundant frame, if the target frame is the non-redundant frame,

wherein the redundant frame determination module is configured to determine that the target frame is a redundant frame, if a number of blocks in the target frame for which the motion vector is a zero vector is equal to or more than a first threshold and a difference between the motion vectors of the target frame and the motion vectors of the stored preceding non-redundant frame is equal to or more than a second threshold.

2. The image processing apparatus of claim 1 , wherein the interpolation frame generation module is configured to generate an interpolation frame between the stored preceding non-redundant frame and a succeeding non-redundant frame of the target frame by motion compensation using the motion vectors of the succeeding non-redundant frame, if the target frame is determined as a redundant frame.

3. The image processing apparatus of claim 1 , further comprising a scene change determination module configured to determine whether a scene change occurs between the stored preceding non-redundant frame and the target frame based on the motion vectors corresponding to the target frame,

wherein the redundant frame determination module is configured to determine whether the target frame is a redundant frame if no scene change occurs between the stored preceding non-redundant frame and the target frame.

4. The image processing apparatus of claim 3 , wherein the scene change determination module is configured to determine that no scene change occurs between the stored preceding non-redundant frame and the target frame if the sum of magnitudes of the motion vectors for the respective blocks in the target frame is less than a third threshold.

5. The image processing apparatus of claim 3 , wherein the scene change determination module is configured to determine that no scene change occurs between the stored preceding non-redundant frame and the target frame if a correlation value representing a correlation between the motion vectors for the blocks in the target frame is less than a third threshold.

6. An image processing method comprising:

calculating motion vectors for respective blocks in each frame in moving image data by estimating motion between frames in the moving image data;

determining whether a target frame is a redundant frame based on the motion vectors corresponding to the target frame and the motion vectors corresponding to a non-redundant frame preceding the target frame;

discarding the target frame if the target frame is a redundant frame, and generating an interpolation frame between the target frame and the preceding non-redundant frame by motion compensation using the motion vectors corresponding to the target frame and outputting the interpolation frame and the target frame, if the target frame is a non-redundant frame; and

storing the target frame as the preceding non-redundant frame and storing the motion vectors corresponding to the target frame as motion vectors corresponding to the preceding non-redundant frame, if the target frame is the non-redundant frame,

wherein the determining comprises determining that the target frame is a redundant frame, if a number of blocks in the target frame for which the motion vector is a zero vector is equal to or more than a first threshold and a difference between the motion vectors of the target frame and the motion vectors of the stored preceding non-redundant frame is equal to or more than a second threshold.

7. An image processing apparatus comprising:

a motion estimation module configured to calculate motion vectors for respective blocks in each frame in moving image data by estimating motion between frames in the moving image data;

a redundant frame determination module configured to determine whether a target frame is a redundant frame based on the motion vectors corresponding to the target frame and the motion vectors corresponding to a non-redundant frame preceding the target frame;

an interpolation frame generation module configured to discard the target frame if the target frame is a redundant frame, and to generate an interpolation frame between the target frame and the preceding non-redundant frame by motion compensation using the motion vectors corresponding to the target frame and to output the interpolation frame and the target frame, if the target frame is a non-redundant frame; and

a data storing module configured to store the target frame as the preceding non-redundant frame and to store the motion vectors corresponding to the target frame as motion vectors corresponding to the preceding non-redundant frame, if the target frame is the non-redundant frame,

wherein the redundant frame determination module is configured to calculate a horizontal difference between a horizontal component of the motion vector of each of the blocks in the stored preceding non-redundant frame and a horizontal component of the motion vector of the corresponding block in the target frame, and a vertical difference between a vertical component of the motion vector of each of the blocks in the stored preceding non-redundant frame and a vertical component of the motion vector of the corresponding block in the target frame, to calculate an absolute difference which is the sum of the absolute value of the horizontal difference and the absolute value of the vertical difference, and to determine that the target frame is a redundant frame, if a number of blocks in the target frame for which the motion vector is a zero vector is equal to or more than a first threshold, and the sum of the absolute difference of each of the blocks for the entire frame is equal to or more than a second threshold.

8. The image processing apparatus of claim 7 , wherein the interpolation frame generation module is configured to generate an interpolation frame between the stored preceding non-redundant frame and a succeeding non-redundant frame of the target frame by motion compensation using the motion vectors of the succeeding non-redundant frame, if the target frame is determined as a redundant frame.

9. The image processing apparatus of claim 7 , further comprising a scene change determination module configured to determine whether a scene change occurs between the stored preceding non-redundant frame and the target frame based on the motion vectors corresponding to the target frame,

wherein the redundant frame determination module is configured to determine whether the target frame is a redundant frame if no scene change occurs between the stored preceding non-redundant frame and the target frame.

10. The image processing apparatus of claim 9 , wherein the scene change determination module is configured to determine that no scene change occurs between the stored preceding non-redundant frame and the target frame if the sum of magnitudes of the motion vectors for the respective blocks in the target frame is less than a third threshold.

11. The image processing apparatus of claim 9 , wherein the scene change determination module is configured to determine that no scene change occurs between the stored preceding non-redundant frame and the target frame if a correlation value representing a correlation between the motion vectors for the blocks in the target frame is less than a third threshold.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2010
From: FUJISAWA, TATSURO; OSHIKIRI, MAKOTO
To: KABUSHIKI KAISHA TOSHIBA
Reel/Frame 024177/0115 →
Priority Claims (1)
JP 2009-130590 · May 29, 2009 · national
Continuity (1)
Related Publication 20100302438A1 · Dec 2, 2010