IP Library Granted Patent US 7,936,950
Granted Patent B2
US 7,936,950 · App. 11/674,503 · Granted May 3, 2011

Apparatus for creating interpolation frame

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,936,950
App. No.
11/674,503
Granted
May 3, 2011
Kind
B2
Abstract

An area detecting unit detects a first matching area in a first reference block in the first reference frame, a second matching area in a second reference block in the second reference frame. A settling unit settles a secondary motion vector to be assigned to a mismatching area in the each interpolation block, based on surrounding interpolation blocks around the mismatching area. A motion compensating unit assigns an image to the interpolation frame based on the primary motion vector and the secondary motion vector.

Claims (15)

1. An apparatus that interpolates an interpolation frame between a first reference frame and a second reference frame, the apparatus comprising:

a motion vector detecting unit that detects a primary motion vector of each interpolation block in the interpolation frame by referring to the first reference frame and the second reference frame;

an area detecting unit that detects a first matching area in a first reference block in the first reference frame, a second matching area in a second reference block in the second reference frame, a first mismatching area in the first reference block and a second mismatching area in the second reference block, wherein the both the first matching area and the second matching area are matching and corresponding to each other, the both the first mismatching area and the second mismatching area are mismatching and corresponding to each other, both the first reference block and the second reference block have equal size and identical shape to the interpolation block, and each of the first reference block and the second reference block is specified based on the primary motion vector of the interpolation block;

a first assigning unit that assigns the primary motion vector of the each interpolation block to an interpolation matching area in the each interpolation block, wherein the interpolation matching area corresponds to the first matching area and the second matching area;

a second assigning unit that assigns a secondary motion vector to be assigned to an interpolation mismatching area in the each interpolation block based on surrounding interpolation blocks around the interpolation mismatching area, wherein the interpolation mismatching area corresponds to the first mismatching area and the second mismatching area, the first mismatching area and the second mismatching area being determined as mismatching each other by the area detecting unit; and

a motion compensating unit that assigns an image onto the interpolation frame based on all of at least one motion vector of

the primary motion vector assigned to the interpolation matching area by the first assigning unit, and

the secondary motion vector settled for the interpolation mismatching area by the second assigning unit.

2. The apparatus according to claim 1 , wherein the second assigning unit assigns the secondary motion vector from at least one primary motion vector of the surrounding interpolation blocks around the interpolation mismatching area.

3. The apparatus according to claim 2 , wherein when there are a plurality of primary motion vectors of the surrounding interpolation blocks around the interpolation mismatching area, the second assigning unit assigns the secondary motion vector from the plurality of primary motion vectors based on a correlation between an area in the first reference block and an area in the second reference block, each area being specified based on the interpolation mismatching area and each of the plurality of primary motion vectors.

4. The apparatus according to claim 3 , wherein when there are a plurality of primary motion vectors of the surrounding interpolation blocks around the interpolation mismatching area, the second assigning unit assigns the secondary motion vector from the plurality of primary motion vectors based on a correlation between an area in the first reference block, an area in the second reference block, and an area in a third reference block in a third reference frame, each area being specified based on the interpolation mismatching area and each of the plurality of primary motion vectors.

5. The apparatus according to claim 4 , wherein when there are a plurality of primary motion vectors of the surrounding interpolation blocks around the interpolation mismatching area, the second assigning unit assigns the secondary motion vector from the plurality of primary motion vectors based on a correlation between an area in the first mismatching area, an area in the second mismatching area, and an area in the third reference block, each area being specified based on the interpolation mismatching area and each of the plurality of primary motion vectors.

6. The apparatus according to claim 1 , wherein when a correlation between the first mismatching area and the second mismatching area is higher than a threshold, the second assigning unit assigns the secondary motion vector based on the surrounding interpolation blocks around the interpolation mismatching area.

7. The apparatus according to claim 6 , wherein when there are a plurality of primary motion vectors of the surrounding interpolation blocks around the interpolation mismatching area, and when the first mismatching area and the second mismatching area have a lower correlation than a threshold, the second assigning unit assigns the secondary motion vector from the plurality of primary motion vectors based on a correlation between an area in the first reference block, an area in the second reference block, and an area in a third reference block in a third reference frame, each area being specified based on the interpolation mismatching area and each of the plurality of primary motion vectors.

8. The apparatus according to claim 1 , wherein when number of pixels included in the interpolation mismatching area is less than a threshold, the interpolation mismatching area is converted to an interpolation matching area, and converted interpolation matching area is assigned with the primary motion vector of the interpolation block.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2020
From: TOSHIBA VISUAL SOLUTIONS CORPORATION
To: HISENSE VISUAL TECHNOLOGY CO., LTD.
Reel/Frame 051493/0333 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2018
From: KABUSHIKI KAISHA TOSHIBA
To: TOSHIBA VISUAL SOLUTIONS CORPORATION
Reel/Frame 046201/0774 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2007
From: OHWAKI, KAZUYASU; ITOH, GOH; MISHIMA, NAO; TAKEYAMA, YASUTOYO
To: KABUSHIKI KAISHA TOSHIBA
Reel/Frame 018890/0001 →