IP Library Granted Patent US 12,401,785
Granted Patent B2
US 12,401,785 · App. 18/170,909 · Granted Aug 26, 2025

Motion compensation using size of reference picture

Inventors: Vadim Seregin (San Diego, CA); Yao-Jen Chang (San Diego, CA); Muhammed Zeyd Coban (Carlsbad, CA)
Assignee: QUALCOMM Incorporated
H04N19/105H04N19/176H04N19/503
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,401,785
App. No.
18/170,909
Granted
Aug 26, 2025
Kind
B2
Abstract

A video coder is configured to determine a reference block of a reference picture for prediction of a current block of a current picture using motion information and to generate a set of reference samples for the current block of the current picture. To generate the set of reference samples, the video coder is configured to perform reference sample clipping on the reference block of the reference picture based on a size of the reference picture. The video coder is further configured to generate a prediction block for the current block of the current picture based on the set of reference samples.

Claims (60)

1. A method of decoding video data, the method comprising: determining a reference block of a reference picture for prediction of a current block of a current picture using motion information; generating a set of reference samples for the current block of the current picture, wherein generating the set of reference samples comprises performing wraparound processing based on a size of the reference picture and performing reference sample clipping on the reference block of the reference picture based on the size of the reference picture; and generating a prediction block for the current block of the current picture based on the set of reference samples; and wherein performing the wraparound processing comprises generating a sample of the one or more set of reference samples based on the size of the reference picture and a wraparound offset.

2. The method of claim 1 , wherein the size of the reference picture comprises a width of the reference picture in samples.

3. The method of claim 1 , wherein the size of the reference picture comprises a height of the reference picture in samples.

4. The method of claim 1 , wherein performing reference sample clipping on the reference block comprises applying a clipping function that limits positions of the reference samples along a horizontal direction of the reference picture to a minimum of 0 and a maximum of a width of the reference picture in samples minus 1 and along a vertical direction of the reference picture to a minimum of 0 and a maximum of a height of the reference picture in samples minus 1.

5. The method of claim 1 , wherein generating the set of reference samples comprises performing wraparound processing based on the size of the reference picture.

6. The method of claim 5 , wherein performing the wraparound processing comprises generating a sample of the one or more set of reference samples based on the size of the reference picture and a wraparound offset.

7. The method of claim 1 , wherein the size of the reference picture is different than a size of the current picture.

8. The method of claim 1 , further comprising:

decoding a residual block for the current block of the current picture; and

decoding the current block of the current picture using the prediction block and the residual block.

9. The method of claim 1 , further comprising:

generating a residual block for the current block of the current picture using the current block of the current picture and the prediction block; and

encoding the residual block.

10. The method of claim 1 , wherein the size of the reference picture is the same as a size of the current picture.

11. A device configured to decode video data comprising: a memory configured to store video data; and one or more processors implemented in circuitry and configured to: determine a reference block of a reference picture for prediction of a current block of a current picture using motion information;

generate a set of reference samples for the current block of the current picture, wherein, to generate the set of reference samples, the one or more processors are configured to perform wraparound processing based on a size of the reference picture and perform reference sample clipping on the reference block of the reference picture based on the size of the reference picture; and generate a prediction block for the current block of the current picture based on the set of reference samples, and wherein, to perform the wraparound processing, the one or more processors are configured to generate a sample of the one or more set of reference samples based on the size of the reference picture and a wraparound offset.

12. The device of claim 11 , wherein the size of the reference picture comprises a width of the reference picture in samples.

13. The device of claim 11 , wherein the size of the reference picture comprises a height of the reference picture in samples.

14. The device of claim 11 , wherein, to perform reference sample clipping on the reference block, the one or more processors are configured to apply a clipping function that limits positions of the reference samples along a horizontal direction of the reference picture to a minimum of 0 and a maximum of a width of the reference picture in samples minus 1 and along a vertical direction of the reference picture to a minimum of 0 and a maximum of a height of the reference picture in samples minus 1.

15. The device of claim 11 , wherein, to generate the set of reference samples, the one or more processors are configured to perform wraparound processing based on the size of the reference picture.

16. The device of claim 15 , wherein, to perform the wraparound processing, the one or more processors are configured to generate a sample of the one or more set of reference samples based on the size of the reference picture and a wraparound offset.

17. The device of claim 11 , wherein the size of the reference picture is different than a size of the current picture.

18. The device of claim 11 , wherein the one or more processors are configured to:

decode a residual block for the current block of the current picture; and

decode the current block of the current picture using the prediction block and the residual block.

19. The device of claim 11 , wherein the one or more processors are configured to:

generate a residual block for the current block of the current picture using the current block of the current picture and the prediction block; and

encode the residual block.

20. The device of claim 11 , further comprising a display configured to display the video data.

21. The device of claim 11 , wherein the device comprises one or more of a camera, a computer, a mobile device, a broadcast receiver device, a set-top box, an integrated circuit, a microprocessor, or a wireless communication device.

22. The device of claim 11 , further comprising a camera configured to capture the video data.

23. The device of claim 11 , wherein the size of the reference picture is the same as a size of the current picture.

24. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause a processor to: determine a reference block of a reference picture for prediction of a current block of a current picture using motion information; generate a set of reference samples for the current block of the current picture, wherein, to generate the set of reference samples, the instructions cause the processor to perform wraparound processing based on a size of the reference picture and perform reference sample clipping on the reference block of the reference picture based on the size of the reference picture; and generate a prediction block for the current block of the current picture based on the set of reference samples, and wherein, to perform the wraparound processing, the instructions cause the processor to generate a sample of the one or more set of reference samples based on the size of the reference picture and wraparound offset.

25. The non-transitory computer-readable storage medium of claim 24 , wherein the size of the reference picture comprises a width of the reference picture in samples.

26. The non-transitory computer-readable storage medium of claim 24 , wherein the size of the reference picture comprises a height of the reference picture in samples.

27. The non-transitory computer-readable storage medium of claim 24 , wherein, to perform reference sample clipping on the reference block, the instructions cause the processor to apply a clipping function that limits positions of the reference samples along a horizontal direction of the reference picture to a minimum of 0 and a maximum of a width of the reference picture in samples minus 1 and along a vertical direction of the reference picture to a minimum of 0 and a maximum of a height of the reference picture in samples minus 1.

28. The non-transitory computer-readable storage medium of claim 24 , wherein, to generate the set of reference samples, the instructions cause the processor to perform wraparound processing based on the size of the reference picture.

29. The non-transitory computer-readable storage medium of claim 28 , wherein, to perform the wraparound processing, the instructions caused the processor to generate a sample of the one or more set of reference samples based on the size of the reference picture and a wraparound offset.

30. The non-transitory computer-readable storage medium of claim 24 , wherein the size of the reference picture is different than a size of the current picture.

31. The non-transitory computer-readable storage medium of claim 24 , wherein the instructions further cause the processor to:

decode a residual block for the current block of the current picture; and

decode the current block of the current picture using the prediction block and the residual block.

32. The non-transitory computer-readable storage medium of claim 24 , wherein the instructions further cause the processor to:

generate a residual block for the current block of the current picture using the current block of the current picture and the prediction block; and

encode the residual block.

33. The non-transitory computer-readable storage medium of claim 24 , wherein the size of the reference picture is the same as a size of the current picture.

34. A device configured to decode video data comprising: means for determining a reference block of a reference picture for prediction of a current block of a current picture using motion information; means for generating a set of reference samples for the current block of the current picture, wherein, the means for generating the set of reference samples comprises means for performing wraparound processing based on a size of the reference picture and means for performing reference sample clipping on the reference block of the reference picture based on the size of the reference picture; and means for generating a prediction block for the current block of the current picture based on the set of reference samples, wherein the means for performing the wraparound processing comprises means for generating a sample of the one or more set of reference samples based on the size of the reference picture and a wraparound offset.

35. The device of claim 34 , wherein the size of the reference picture comprises a width of the reference picture in samples.

36. The device of claim 34 , wherein the size of the reference picture comprises a height of the reference picture in samples.

37. The device of claim 34 , wherein the means for performing reference sample clipping on the reference block comprises means for applying a clipping function that limits positions of the reference samples along a horizontal direction of the reference picture to a minimum of 0 and a maximum of a width of the reference picture in samples minus 1 and along a vertical direction of the reference picture to a minimum of 0 and a maximum of a height of the reference picture in samples minus 1.

38. The device of claim 34 , wherein the means for generating the set of reference samples comprises means for performing wraparound processing based on the size of the reference picture.

39. The device of claim 38 , wherein the means for performing the wraparound processing comprises for generating a sample of the one or more set of reference samples based on the size of the reference picture and a wraparound offset.

40. The device of claim 34 , wherein the size of the reference picture is different than a size of the current picture.

41. The device of claim 34 , further comprising:

means for decoding a residual block for the current block of the current picture; and

means for decoding the current block of the current picture using the prediction block and the residual block.

42. The device of claim 34 , wherein further comprising:

means for generating a residual block for the current block of the current picture using the current block of the current picture and the prediction block; and

means for encoding the residual block.

43. The device of claim 34 , wherein the size of the reference picture is the same as a size of the current picture.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2023
From: SEREGIN, VADIM; CHANG, YAO-JEN; COBAN, MUHAMMED ZEYD
To: QUALCOMM INCORPORATED
Reel/Frame 063675/0289 →
Continuity (4)
Continuation 17125486 · Dec 17, 2020
Provisional Application 62954204 · Dec 27, 2019
Provisional Application 62951709 · Dec 20, 2019
Related Publication 20230283769A1 · Sep 7, 2023
References Cited (29)
US 9628795B2 · Zhang et al. · 2017 [cited by applicant]
US 9924191B2 · Chen et al. · 2018 [cited by applicant]
US 10412387B2 · Pang et al. · 2019 [cited by applicant]
US 11425391B2 · Lim et al. · 2022 [cited by applicant]
US 11589037B2 · Seregin et al. · 2023 [cited by applicant]
US 20110090963A1 · Po et al. · 2011 [cited by applicant]
US 20170085917A1 · Hannuksela · 2017 [cited by examiner]
US 20180124420A1 · Lee et al. · 2018 [cited by applicant]
US 20190014342A1 · Li et al. · 2019 [cited by applicant]
US 20190082184A1 · Hannuksela · 2019 [cited by examiner]
US 20190158827A1 · Sim et al. · 2019 [cited by applicant]
US 20200260070A1 · Yoo · 2020 [cited by examiner]
US 20210092447A1 · Choi · 2021 [cited by examiner]
US 20210160482A1 · Chiu · 2021 [cited by examiner]
US 20210409718A1 · Wieckowski et al. · 2021 [cited by applicant]
US 20220060692A1 · Zhang · 2022 [cited by examiner]
US 20220132104A1 · Zhang · 2022 [cited by examiner]
KR 20190140387A · 2019 [cited by applicant]
WO 2015200835A1 · 2015 [cited by applicant]
WO 2016029144 · 2016 [cited by applicant]
WO 2019135447A1 · 2019 [cited by applicant]
Bross B., et al., “Versatile Video Coding (Draft 6)”, 127th MPEG, Jul. 8, 2019-Jul. 12, 2019, 15th JVET Meeting, Gothenburg, SE, Jul. 3, 2019-Jul. 12, 2019, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IE… [cited by applicant]
Bross B., et al., “Versatile Video Coding (Draft 7)”, 16th JVET Meeting, Oct. 1, 2019-Oct. 11, 2019, Geneva, CH (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16), No. JVET-P2001, m51515, Nov.… [cited by applicant]
He (Interdigital) Y., et al., “AHG12: On Subpicture Wraparound Motion Compensation Signaling”, 16. JVET Meeting; Oct. 1, 2019-Oct. 11, 2019; Geneva; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T … [cited by applicant]
International Search Report and Written Opinion—PCT/US2020/066004—ISA/EPO—Feb. 12, 2021. [cited by applicant]
ITU-T H.265: “Series H: Audiovisual and Multimedia Systems Infrastructure of Audiovisual Services—Coding of Moving Video”, High Efficiency Video Coding, The International Telecommunication Union, Jun. 2019, 696 Pages. [cited by applicant]
Seregin (Qualcomm) V., et al., “AHG12: On Motion Compensation for Sub-Pictures”, 17. JVET Meeting; Jan. 7, 2020-Jan. 17, 2020; Brussels; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16), No. … [cited by applicant]
Wang (Bytedance) Y-K., “AHG12: A Summary of Proposals on General and Misc. Subpicture Aspects”, 17. JVET Meeting; Jan. 7, 2020-Jan. 17, 2020; Brussels; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU… [cited by applicant]
Taiwan Search Report—TW109144979—TIPO—Jan. 31, 2024. [cited by applicant]