IP Library › Granted Patent US 10,659,803
Granted Patent B2
US 10,659,803 · App. 16/413,329 · Granted May 19, 2020

Picture prediction method and related apparatus

Inventors: Huanbang Chen (Guangzhou, CN); Sixin Lin (Shenzhen, CN); Fan Liang (Guangzhou, CN); Haitao Yang (Shenzhen, CN)
Assignee: Huawei Technologies Co., Ltd.
H04N19/513H04N19/119H04N19/537
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,659,803
App. No.
16/413,329
Granted
May 19, 2020
Kind
B2
Abstract

A picture prediction method includes: determining two pixel samples in a current picture block, and determining a candidate motion information unit set corresponding to each of the two pixel samples; determining a merged motion information unit set i including two motion information units; and predicting a pixel value of the current picture block by using an affine motion model and the merged motion information unit set i.

Claims (459)

1. A picture processing method, comprising:

obtaining, by a picture processing apparatus, motion vectors of two pixel samples in a video frame to which a current picture block belongs; and

obtaining, by the picture processing apparatus, a motion vector of a pixel sample in the current picture block by using an affine motion model and the obtained motion vectors;

wherein the affine motion model comprises:

{

vx

=

ax

+

by

+

c

vy

=

-

bx

+

ay

+

d

,

wherein (x, y) are coordinates of the pixel sample, vx is a horizontal component of the motion vector of the pixel sample, vy is a vertical component of the motion vector of the pixel sample, and a, b, c and d are coefficients of the affine motion model.

2. The method of claim 1 , wherein when the two pixel samples comprise an upper left pixel sample of the current picture block and an upper right pixel sample of the current picture block, a is

vx

2

-

vx

0

w

,

b is

-

vy

2

-

vy

0

w

,

c is vx 0 , d is vy 0 , and the affine motion model comprises:

{

vx

=

vx

2

-

vx

0

w

⁢

x

-

vy

2

-

vy

0

w

⁢

y

+

vx

0

vy

=

vy

2

-

vy

0

w

⁢

x

+

vx

2

-

vx

0

w

⁢

y

+

vy

0

,

and wherein (vx 0 , vy 0 ) is a motion vector of the upper left pixel sample, (vx 1 , vy 1 ) is a motion vector of the upper right pixel sample, and w is a distance between the two pixel samples.

3. The method of claim 1 , wherein when the two pixel samples comprise an upper left pixel sample of the current picture block and a lower left pixel sample of the current picture block, a is

vy

2

-

vy

0

h

,

b is

vx

2

-

vx

0

h

,

c is vx 0 , d is vy 0 , and the affine motion model comprises:

{

vx

=

vy

2

-

vy

0

h

⁢

x

-

vx

2

-

vx

0

h

⁢

y

+

vx

0

vy

=

vx

2

-

vx

0

h

⁢

x

+

vy

2

-

vy

0

h

⁢

y

+

vy

0

,

and wherein (vx 0 , vy 0 ) is a motion vector of the upper left pixel sample, (vx 2 , vy 2 ) is a motion vector of the lower left pixel sample, and h is a distance between the two pixel samples.

4. The method of claim 1 , wherein after obtaining the motion vector of the pixel sample in the current picture block, the method further comprises:

performing motion compensation predictive coding on a picture block by using the motion vector of the pixel sample in the current picture block, wherein the pixel sample in the current picture block belongs to the picture block and the picture block belongs to the current picture block.

5. A picture processing apparatus comprising a processor and a non-transitory memory having instructions stored thereon, wherein the instructions, when executed by the processor, facilitate:

obtaining motion vectors of two pixel samples in a video frame to which a current picture block belongs; and

obtaining a motion vector of a pixel sample in the current picture block by using an affine motion model and the obtained motion vectors;

wherein the affine motion model comprises:

{

vx

=

ax

+

by

+

c

vy

=

-

bx

+

ay

+

d

,

wherein (x, y) are coordinates of the pixel sample, vx is a horizontal component of the motion vector of the pixel sample, vy is a vertical component of the motion vector of the pixel sample, and a, b, c and d are coefficients of the affine motion model.

6. The apparatus of claim 5 , wherein when the two pixel samples comprise an upper left pixel sample of the current picture block and an upper right pixel sample of the current picture block, a is

vx

1

-

vx

0

w

,

b is

-

vy

1

-

vy

0

w

,

c is vx 0 , d is vy 0 , and the affine motion model comprises:

{

vx

=

vx

1

-

vx

0

w

⁢

x

-

vy

1

-

vy

0

w

⁢

y

+

vx

0

vy

=

vy

1

-

vy

0

w

⁢

x

+

vx

1

-

vx

0

w

⁢

y

+

vy

0

,

and wherein (vx 0 , vy 0 ) is a motion vector of the upper left pixel sample, (vx 1 , vy 1 ) is a motion vector of the upper right pixel sample, and w is a distance between the two pixel samples.

7. The apparatus of claim 5 , wherein when the two pixel samples comprise an upper left pixel sample of the current picture block and a lower left pixel sample of the current picture block, a is

vy

2

-

vy

0

h

,

b is

vx

2

-

vx

0

h

,

c is vx 0 , d is vy 0 , and the affine motion model comprises:

{

vx

=

vy

2

-

vy

0

h

⁢

x

-

vx

2

-

vx

0

h

⁢

y

+

vx

0

vy

=

vx

2

-

vx

0

h

⁢

x

+

vy

2

-

vy

0

h

⁢

y

+

vy

0

,

and wherein (vx 0 , vy 0 ) is a motion vector of the upper left pixel sample, (vx 2 , vy 2 ) is a motion vector of the lower left pixel sample, and h is a distance between the two pixel samples.

8. The apparatus of claim 5 , wherein the instructions, when executed by the processor, further facilitate:

performing motion compensation predictive coding on a picture block by using the motion vector of the pixel sample in the current picture block, wherein the pixel sample in the current picture block belongs to the picture block and the picture block belongs to the current picture block.

9. A non-transitory computer-readable medium having processor-executable instructions stored thereon, wherein the processor-executable instructions, when executed, facilitate:

obtaining motion vectors of two pixel samples in a video frame to which a current picture block belongs; and

obtaining a motion vector of a pixel sample in the current picture block by using an affine motion model and the obtained motion vectors;

wherein the affine motion model comprises:

{

vx

=

ax

+

by

+

c

vy

=

-

bx

+

ay

+

d

,

wherein (x, y) are coordinates of the pixel sample, vx is a horizontal component of the motion vector of the pixel sample, vy is a vertical component of the motion vector of the pixel sample, and a, b, c and d are coefficients of the affine motion model.

10. The non-transitory computer-readable medium of claim 9 , wherein when the two pixel samples comprise an upper left pixel sample of the current picture block and an upper right pixel sample of the current picture block, a is

vx

1

-

vx

0

w

,

b is

-

vy

1

-

vy

0

w

,

c is vx 0 , d is vy 0 , and the affine motion model comprises:

{

vx

=

vx

1

-

vx

0

w

⁢

x

-

vy

1

-

vy

0

w

⁢

y

+

vx

0

vy

=

vy

1

-

vy

0

w

⁢

x

+

vx

1

-

vx

0

w

⁢

y

+

vy

0

,

and wherein (vx 0 , vy 0 ) is a motion vector of the upper left pixel sample, (vx 1 , vy 1 ) is a motion vector of the upper right pixel sample, and w is a distance between the two pixel samples.

11. The non-transitory computer-readable medium of claim 9 , wherein when the two pixel samples comprise an upper left pixel sample of the current picture block and a lower left pixel sample of the current picture block, a is

vy

2

-

vy

0

h

,

b is

vx

2

-

vx

0

h

,

c is vx 0 , d is vy 0 , and the affine motion model comprises:

{

vx

=

vy

2

-

vy

0

h

⁢

x

-

vx

2

-

vx

0

h

⁢

y

+

vx

0

vy

=

vx

2

-

vx

0

h

⁢

x

+

vy

2

-

vy

0

h

⁢

y

+

vy

0

,

and wherein (vx 0 , vy 0 ) is a motion vector of the upper left pixel sample, (vx 2 , vy 2 ) is a motion vector of the lower left pixel sample, and h is a distance between the two pixel samples.

12. The non-transitory computer-readable medium of claim 9 , wherein the processor-executable instructions, when executed, further facilitate:

performing motion compensation predictive coding on a picture block by using the motion vector of the pixel sample in the current picture block, wherein the pixel sample in the current picture block belongs to the picture block and the picture block belongs to the current picture block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 9, 2020
From: CHEN, HUANBANG; LIN, SIXIN; LIANG, FAN; YANG, HAITAO
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 052353/0301 →
Priority Claims (1)
WO PCT/CN2015/073969 · Mar 10, 2015 · international
Continuity (3)
Continuation 15699515 · Sep 8, 2017
Continuation PCTCN2015075094 · Mar 26, 2015
Related Publication 20190268616A1 · Aug 29, 2019
Cited By (2)
US 12,266,918 US 12,676,563