IP Library Granted Patent US 9,860,532
Granted Patent B2
US 9,860,532 · App. 14/126,734 · Granted Jan 2, 2018

Method and apparatus for motion compensation prediction

Inventor: Frank Jan Bossen (Mountain View, CA)
Assignee: NTT DOCOMO, INC.
H04N19/00739H04N19/184H04N19/42H04N19/523H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,860,532
App. No.
14/126,734
Granted
Jan 2, 2018
Kind
B2
Abstract

The invention relates to a motion compensation performed under an inter-frame prediction. A fractional sample interpolation is applied on retrieved samples to generate fractional samples. The fractional sample interpolation comprises a plurality of filtering operations, and all of filtered results from the filtering operations are truncated down to a predetermined bit depth independent of the bit depth of the samples stored in the reference picture memory.

Claims (32)

1. A video decoding method for motion compensation performed under an inter-frame prediction to decode a target picture, the method comprising computer executable steps executed by a processor of a video decoder to implement:

decoding a residual and a motion vector received from an encoder;

referencing to the motion vector to retrieve a reference sample from a reference picture stored in a reference picture memory, wherein the reference picture stored in the reference picture memory and the reference sample retrieved from the reference picture are both represented with a first bit depth;

performing a scaling-up operation and a first fractional sample interpolation in a first direction on the retrieved reference sample to generate a first set of fractional samples represented with a second bit depth to which the first bit depth is scaled up by a scaling-up factor, wherein the second bit depth is constant and set equal to a number of bits available to represent the fractional sample, and the scaling-up factor is set equal to the second bit depth minus the first bit depth and is variable to keep the second bit depth constant and independent from a change of the first bit depth;

performing a second fractional sample interpolation on the first set of fractional samples in a second direction to generate a second set of fractional samples represented with the second bit depth;

referencing fractional parts of the motion vector to derive a prediction sample from the first and second sets of fractional samples, wherein the prediction sample is represented with the second bit depth;

scaling down and clipping the prediction sample to generate a prediction picture scaled down from the second bit depth to the first bit depth; and

adding the prediction picture and the residual to reconstruct the target picture represented with the first bit depth.

2. The method according to claim 1 , wherein the fractional sample interpolation applies an 8-tap FIR (Finite Impulse Response) filter having one of the following three sets of coefficients to generate a quarter-pel sample:

[−1, 4, −10, 58, 17, −5, 1, 0];

[−1, 4, −11, 40, 40, −11, 4, −1]; and

[0, 1, −5, 17, 58, −10, 4, −1].

3. The method according to claim 2 , wherein the fractional sample interpolation comprises truncating each filtered result so that the fractional samples are represented with the second bit depth.

4. The method according to claim 3 , wherein the second bit depth is maintained throughout the first and second fractional interpolation processes.

5. The method according to claim 3 , wherein truncating each filtered result comprises rounding truncated results towards minus infinity.

6. The method according to claim 1 , further comprising subtracting an offset from the scaled up samples.

7. A video encoding method for motion compensation performed under an inter-frame prediction, the method comprising computer executable steps executed by a processor of a video encoder to implement:

comparing a target picture and a reference picture stored in a reference picture memory to estimate a motion vector, wherein the reference picture stored in the picture memory is represented with a first bit depth;

referencing the motion vector to retrieve a reference sample from the reference picture, wherein the reference sample retrieved from the reference picture is represented with the first bit depth;

performing a scaling-up operation and a first fractional sample interpolation in a first direction on the retrieved reference sample to generate a first set of fractional samples represented with a second bit depth to which the first bit depth is scaled up by a scaling-up factor, wherein the second bit depth is constant and set equal to a number of bits available to represent the fractional sample, and the scaling-up factor is set equal to the second bit depth minus the first bit depth and is variable to keep the second bit depth constant and independent from a change of the first bit depth;

performing a second fractional sample interpolation on the first set of fractional samples in a second direction to generate a second set of fractional samples represented with the second bit depth;

referencing fractional parts of the motion vectors to derive a prediction sample from the first and second sets of fractional samples, wherein the prediction sample is represented with the second bit depth;

scaling down and clipping the prediction sample to generate a prediction picture scaled down from the second bit depth to the first bit depth; and

subtracting the prediction picture from the target picture to derive a residual for encoding.

8. The method according to claim 7 , wherein the fractional sample interpolation applies an 8-tap FIR (Finite Impulse Response) filter having one of the following three sets of coefficients to generate a quarter-pel sample:

[−1, 4, −10, 58, 17, −5, 1, 0];

[−1, 4, −11, 40, 40, −11, 4, −1]; and

[0, 1, −5, 17, 58, −10, 4, −1].

9. The method according to claim 8 , wherein the fractional sample interpolation comprises truncating each filtered result so that the fractional samples are represented with the second bit depth.

10. The method according to claim 9 , wherein the second bit depth is maintained throughout the first and second interpolation processes.

11. The method according to claim 9 , wherein truncating each filtered result comprises rounding truncated results towards minus infinity.

12. The method according to claim 7 , further comprising subtracting an offset from the scaled up samples.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2013
From: BOSSEN, FRANK JAN
To: DOCOMO INNOVATIONS, INC.
Reel/Frame 031810/0667 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2013
From: DOCOMO INNOVATIONS, INC.
To: NTT DOCOMO, INC.
Reel/Frame 031811/0449 →
Continuity (2)
Provisional Application 61501112 · Jun 24, 2011
Related Publication 20140119442A1 · May 1, 2014