IP Library Granted Patent US 11,589,037
Granted Patent B2
US 11,589,037 · App. 17/125,486 · Granted Feb 21, 2023

Motion compensation using size of reference picture

Inventors: Vadim Seregin (San Diego, CA); Yao-Jen Chang (San Diego, CA); Muhammed Zeyd Coban (Carlsbad, CA)
Assignee: QUALCOMM Incorporated
H04N19/105H04N19/176H04N19/503
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,589,037
App. No.
17/125,486
Granted
Feb 21, 2023
Kind
B2
Abstract

A video coder is configured to determine a reference block of a reference picture for prediction of a current block of a current picture using motion information and to generate a set of reference samples for the current block of the current picture. To generate the set of reference samples, the video coder is configured to perform reference sample clipping on the reference block of the reference picture based on a size of the reference picture. The video coder is further configured to generate a prediction block for the current block of the current picture based on the set of reference samples.

Claims (61)

1. A method of decoding video data, the method comprising:

determining a reference block of a reference picture for prediction of a current block of a current picture using motion information;

generating a set of reference samples for the current block of the current picture, wherein generating the set of reference samples comprises performing wraparound processing when a size of the reference picture is different than a size of the current picture and performing reference sample clipping on the reference block of the reference picture based on the size of the reference picture; and

generating a prediction block for the current block of the current picture based on the set of reference samples.

2. The method of claim 1 , wherein the size of the reference picture comprises a width of the reference picture in samples.

3. The method of claim 1 , wherein the size of the reference picture comprises a height of the reference picture in samples.

4. The method of claim 1 , wherein performing reference sample clipping on the reference block comprises applying a clipping function that limits positions of the reference samples along a horizontal direction of the reference picture to a minimum of 0 and a maximum of a width of the reference picture in samples minus 1 and along a vertical direction of the reference picture to a minimum of 0 and a maximum of a height of the reference picture in samples minus 1.

5. The method of claim 1 , wherein performing the wraparound processing comprises generating a sample of the one or more set of reference samples based on the size of the reference picture and a wraparound offset.

6. The method of claim 1 , further comprising:

decoding a residual block for the current block of the current picture; and

decoding the current block of the current picture using the prediction block and the residual block.

7. The method of claim 1 , further comprising:

generating a residual block for the current block of the current picture using the current block of the current picture and the prediction block; and

encoding the residual block.

8. A device comprising:

a memory configured to store video data; and

one or more processors implemented in circuitry and configured to:

determine a reference block of a reference picture for prediction of a current block of a current picture using motion information;

generate a set of reference samples for the current block of the current picture, wherein, to generate the set of reference samples, the one or more processors are configured to perform wraparound processing when a size of the reference picture is different than a size of the current picture and perform reference sample clipping on the reference block of the reference picture based on the size of the reference picture; and

generate a prediction block for the current block of the current picture based on the set of reference samples.

9. The device of claim 8 , wherein the size of the reference picture comprises a width of the reference picture in samples.

10. The device of claim 8 , wherein the size of the reference picture comprises a height of the reference picture in samples.

11. The device of claim 8 , wherein, to perform reference sample clipping on the reference block, the one or more processors are configured to apply a clipping function that limits positions of the reference samples along a horizontal direction of the reference picture to a minimum of 0 and a maximum of a width of the reference picture in samples minus 1 and along a vertical direction of the reference picture to a minimum of 0 and a maximum of a height of the reference picture in samples minus 1.

12. The device of claim 8 , wherein, to perform the wraparound processing, the one or more processors are configured to generate a sample of the one or more set of reference samples based on the size of the reference picture and a wraparound offset.

13. The device of claim 8 , wherein the one or more processors are configured to:

decode a residual block for the current block of the current picture; and

decode the current block of the current picture using the prediction block and the residual block.

14. The device of claim 8 , wherein the one or more processors are configured to:

generate a residual block for the current block of the current picture using the current block of the current picture and the prediction block; and

encode the residual block.

15. The device of claim 8 , further comprising a display configured to display the video data.

16. The device of claim 8 , wherein the device comprises one or more of a camera, a computer, a mobile device, a broadcast receiver device, a set-top box, an integrated circuit, a microprocessor, or a wireless communication device.

17. The device of claim 8 , further comprising a camera configured to capture the video data.

18. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause a processor to:

determine a reference block of a reference picture for prediction of a current block of a current picture using motion information;

generate a set of reference samples for the current block of the current picture, wherein, to generate the set of reference samples, the instructions cause the processor to perform wraparound processing when a size of the reference picture is different than a size of the current picture and perform reference sample clipping on the reference block of the reference picture based on the size of the reference picture; and

generate a prediction block for the current block of the current picture based on the set of reference samples.

19. The non-transitory computer-readable storage medium of claim 18 , wherein the size of the reference picture comprises a width of the reference picture in samples.

20. The non-transitory computer-readable storage medium of claim 18 , wherein the size of the reference picture comprises a height of the reference picture in samples.

21. The non-transitory computer-readable storage medium of claim 18 , wherein, to perform reference sample clipping on the reference block, the instructions cause the processor to apply a clipping function that limits positions of the reference samples along a horizontal direction of the reference picture to a minimum of 0 and a maximum of a width of the reference picture in samples minus 1 and along a vertical direction of the reference picture to a minimum of 0 and a maximum of a height of the reference picture in samples minus 1.

22. The non-transitory computer-readable storage medium of claim 18 , wherein, to perform the wraparound processing, the instructions cause the processor to generate a sample of the one or more set of reference samples based on the size of the reference picture and a wraparound offset.

23. The non-transitory computer-readable storage medium of claim 18 , wherein the instructions further cause the processor to:

decode a residual block for the current block of the current picture; and

decode the current block of the current picture using the prediction block and the residual block.

24. The non-transitory computer-readable storage medium of claim 18 , wherein the instructions further cause the processor to:

generate a residual block for the current block of the current picture using the current block of the current picture and the prediction block; and

encode the residual block.

25. A device comprising:

means for determining a reference block of a reference picture for prediction of a current block of a current picture using motion information;

means for generating a set of reference samples for the current block of the current picture, wherein, the means for generating the set of reference samples comprises means for performing wraparound processing when a size of the reference picture is different than a size of the current picture and means for performing reference sample clipping on the reference block of the reference picture based on the size of the reference picture; and

means for generating a prediction block for the current block of the current picture based on the set of reference samples.

26. The device of claim 25 , wherein the size of the reference picture comprises a width of the reference picture in samples.

27. The device of claim 25 , wherein the size of the reference picture comprises a height of the reference picture in samples.

28. The device of claim 25 , wherein the means for performing reference sample clipping on the reference block comprises means for applying a clipping function that limits positions of the reference samples along a horizontal direction of the reference picture to a minimum of 0 and a maximum of a width of the reference picture in samples minus 1 and along a vertical direction of the reference picture to a minimum of 0 and a maximum of a height of the reference picture in samples minus 1.

29. The device of claim 25 , wherein the means for performing the wraparound processing comprises means for generating a sample of the one or more set of reference samples based on the size of the reference picture and a wraparound offset.

30. The device of claim 25 , further comprising:

means for decoding a residual block for the current block of the current picture; and

means for decoding the current block of the current picture using the prediction block and the residual block.

31. The device of claim 25 , wherein further comprising:

means for generating a residual block for the current block of the current picture using the current block of the current picture and the prediction block; and

means for encoding the residual block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2021
From: SEREGIN, VADIM; CHANG, YAO-JEN; COBAN, MUHAMMED ZEYD
To: QUALCOMM INCORPORATED
Reel/Frame 054894/0206 →
Continuity (3)
Provisional Application 62954204 · Dec 27, 2019
Provisional Application 62951709 · Dec 20, 2019
Related Publication 20210195173A1 · Jun 24, 2021
Cited By (1)
US 12,401,785