IP Library Granted Patent US 12,368,856
Granted Patent B2
US 12,368,856 · App. 18/533,692 · Granted Jul 22, 2025

Signaling output picture size for reference picture resampling

Inventors: Byeongdoo Choi (Palo Alto, CA); Stephan Wenger (Hillsborough, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/132H04N19/146H04N19/172H04N19/189
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,368,856
App. No.
18/533,692
Granted
Jul 22, 2025
Kind
B2
Abstract

There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform acquiring an input bitstream comprising metadata and video data, decoding the video data, determining whether the metadata comprises at least one flag signaling at least one component of a picture size of at least one picture of the video data, and signaling, in a case where it is determined that the metadata comprises the at least one flag, a display device to display the at least one picture from the video data according to the at least one flag.

Claims (41)

1. A method for video decoding performed by at least one processor, the method comprising:

obtaining coded video data and syntax of the video data;

determining whether a component of metadata of the video data comprises at least one flag signaling at least one component of a picture size of at least one picture of the video data;

determining, in response to determining that the component of the metadata comprises the at least one flag and based on the metadata specifying at least one of a picture width or height with respect to a plurality of pictures, whether any reference picture resampling (RPR) is applied to a picture width or height of a plurality of cropped output pictures of the video data such that each of a plurality of resampled output pictures is to have a constant picture size; and

decoding the video data based on whether the RPR is applied,

wherein whether the RPR is applied to the picture width or height is based on whether the syntax signals whether a cropping parameter, indicated by the at least one flag, is included in or is to be inferred from a sequence parameter set (SPS), and the cropping parameter represents at least one of the constant picture size and a width, in units of luma samples, of an output picture of the RPR.

2. The method for video decoding according to claim 1 , wherein the video data is in a versatile video coding (VVC) format.

3. The method for video decoding according to claim 1 ,

wherein the picture width or height of the picture is a picture width of the picture.

4. The method for video decoding according to claim 1 ,

wherein the picture width or height of the picture is a picture height of the picture.

5. The method for video decoding according to claim 1 , wherein decoding the video data further comprises determining that the RPR is to maintain a width value at a value indicated by the SPS of the video data.

6. The method for video decoding according to claim 1 , wherein decoding the video data further comprises determining that the RPR is to maintain a height value at a value indicated by the SPS of the video data.

7. The method for video decoding according to claim 1 , wherein decoding the video data further comprises determining that each of resampled output pictures of the RPR is to have the constant picture size.

8. A method for video encoding performed by at least one processor, the method comprising:

obtaining video data;

determining whether a component of metadata of the video data is to comprise at least one flag signaling at least one component of a picture size of at least one picture of the video data;

determining, in response to determining that the component of the metadata is to comprise the at least one flag and based on the metadata being determined to specify at least one of a picture width or height with respect to a plurality of pictures, whether any reference picture resampling (RPR) is to be applied to a picture width or height of a plurality of cropped output pictures of the video data such that each of a plurality of resampled output pictures is to have a constant picture size; and

encoding the video data and signaling syntax with the encoded video data;

wherein the syntax signals whether reference picture resampling (RPR) is applied to the picture width or height is based on whether a cropping parameter, to be indicated by the at least one flag, is included in or is to be inferred from a sequence parameter set (SPS), and the cropping parameter represents at least one of a constant picture size and a width, in units of luma samples, of an output picture of the RPR.

9. The method for video encoding according to claim 8 , wherein the video data is in a versatile video coding (VVC) format.

10. The method for video encoding according to claim 8 ,

wherein the picture width or height of the picture is a picture width of the picture.

11. The method for video encoding according to claim 8 ,

wherein the picture width or height of the picture is a picture height of the picture.

12. The method for video encoding according to claim 8 , wherein the syntax signals that the RPR is to maintain a width value at a value indicated by the SPS of the video data.

13. The method for video encoding according to claim 8 , wherein the syntax signals that the RPR is to maintain a height value at a value indicated by the SPS of the video data.

14. The method for video encoding according to claim 8 , wherein the syntax signals that each of resampled output pictures of the RPR is to have the constant picture size.

15. A method of processing visual media data performed by at least one processor, the method comprising:

obtaining at least one of a visual media file and a bitstream of the visual media data;

determining whether a component of metadata of the video data comprises or is to comprise at least one flag signaling at least one component of a picture size of at least one picture of the video data;

determining, in response to determining that the component of the metadata comprises or is to comprise the at least one flag and based on the metadata specifying at least one of a picture width or height with respect to a plurality of pictures, whether any reference picture resampling (RPR) is applied or is to be applied to a picture width or height of a plurality of cropped output pictures of the video data such that each of a plurality of resampled output pictures is to have a constant picture size; and

performing a conversion between the at least one of the visual media file and the bitstream of the visual media data and an other of the visual media file and the bitstream of the visual media data,

wherein bitstream comprises syntax signaling whether reference picture resampling (RPR) is applied to the picture width or height is based on whether a cropping parameter, indicated or to be indicated by the at least one flag, is included in or is to be inferred from a sequence parameter set (SPS), and the cropping parameter represents at least one of a constant picture size and a width, in units of luma samples, of an output picture of the RPR.

16. The method of processing visual media data according to claim 15 , wherein the video data is in a versatile video coding (VVC) format.

17. The method of processing visual media data according to claim 15 ,

wherein the picture width or height of the picture is a picture width of the picture.

18. The method of processing visual media data according to claim 15 ,

wherein the picture width or height of the picture is a picture height of the picture.

19. The method of processing visual media data according to claim 15 , wherein the syntax signals that the RPR is to maintain a width value at a value indicated by the SPS of the video data.

20. The method of processing visual media data according to claim 15 , wherein the syntax signals that the RPR is to maintain a height value at a value indicated by the SPS of the video data.

Continuity (4)
Continuation 17977903 · Oct 31, 2022
Continuation 17063253 · Oct 5, 2020
Provisional Application 62955514 · Dec 31, 2019
Related Publication 20240129477A1 · Apr 18, 2024
References Cited (30)
US 20090316775A1 · Cheng · 2009 [cited by applicant]
US 20100150231A1 · Huang et al. · 2010 [cited by applicant]
US 20120092453A1 · Suh · 2012 [cited by applicant]
US 20140269912A1 · Sullivan · 2014 [cited by applicant]
US 20150110203A1 · Wang et al. · 2015 [cited by applicant]
US 20190141340A1 · Reddiar · 2019 [cited by examiner]
US 20210195172A1 · Chang · 2021 [cited by examiner]
HU E030338T2 · 2017 [cited by applicant]
JP 2019525675A · 2019 [cited by applicant]
WO 2013105946A1 · 2013 [cited by applicant]
WO 2020263665A1 · 2020 [cited by applicant]
Bross et al.“Versatile Video Coding (Draft7)” Join tVideo ExpertsTeam (JVET) of ITU-TSG16WP3 and ISO/IECJTC1/SC29/WG11 16th Meeting:Geneva,CH,Oct. 1-11, 2019, Document: JVET-P2001-vE, 492 pages. [cited by examiner]
Bross et al.“Versatile Video Coding (Draft3)” Joint Video ExpertsTeam(JVET) of ITU-TSG16 WP3 and ISO/IECJTC1/SC29/WG11 12th Meeting:Macao,CN, Oct. 3-12, 2018, Document: JVET-L1001-v9, 235 pages. [cited by examiner]
Arturo A. Rodriguez, “Sample scale factor in VUI,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, Jan. 14-23, 2013, Proposal, pp. 1-5 (5 pages total), Document: JCTVC… [cited by applicant]
Stephan Wenger, “[AHG19] On Signaling of Adaptive Resolution Change,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Mar. 19-27, 2019, pp. 1-13 (13 pages total), Document: JVET-N0052. [cited by applicant]
Byeongdoo Choi, “AHG9: On constant picture output with RPR,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jan. 7-17, 2020, pp. 1-3 (3 pages total), Document: JVET-Q0288. [cited by applicant]
Chinese Office Action issued May 30, 2024 in Application No. 202080036170.9. [cited by applicant]
Benjamin Bross, et al., “Versatile Video Coding (Draft 6)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019. [cited by applicant]
International Search Report dated Feb. 5, 2021 from the International Searching Authority in International Application No. PCT/US2020/059695. [cited by applicant]
Vetro et al., “Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard”, Proceedings of the IEEE, Jan. 2011 (15 pages total). [cited by applicant]
Seregin et al., “AHG8: Indication for output picture size”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-Q0159, Brussels. BE, Jan. 7-17, 2020 (3 pages total). [cited by applicant]
Office Action issued Aug. 11, 2022 in Indian Application No. 202147047322. [cited by applicant]
Wang et al., “AHG9: Cleanups on parameter sets”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-Q0117-v1, Brussels. BE, Jan. 7-17, 2020 (10 pages total). [cited by applicant]
Written Opinion dated Feb. 5, 2021 from the International Searching Authority in International Application No. PCT/US2020/059695. [cited by applicant]
Bross et al. “Versatile Video Coding (Draft 7)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, Docuement: JVET-P2001-vE, 492 pages. [cited by applicant]
Office Action dated Oct. 25, 2022 from the Japanese Patent Office in JP Application No. 2021-559110. [cited by applicant]
International Search Report dated Dec. 31, 2019 from the International Searching Authority in International Application No. PCT/US2020/059695. [cited by applicant]
Office Action dated Oct. 31, 2023 from the Chinese Patent Office in CN Application No. 2023103100042540. [cited by applicant]
Benjamin Bross, et al., Versatile Video Coding (Draft 6), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-O2001-vE, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019 (455 pages total). [cited by applicant]
Written Opinion issued Jun. 17, 2024 in Singaporean Application No. 11202110949U. [cited by applicant]