IP Library Granted Patent US 12,513,322
Granted Patent B2
US 12,513,322 · App. 18/742,428 · Granted Dec 30, 2025

Reference picture resampling

Inventors: Byeongdoo Choi (Palo Alto, CA); Stephan Wenger (Hillsborough, CA); Shan Liu (San Jose, CA)
Assignee: Tencent America LLC
H04N19/44H04N19/105H04N19/132H04N19/172H04N19/1883H04N19/33H04N19/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,513,322
App. No.
18/742,428
Granted
Dec 30, 2025
Kind
B2
Abstract

In a method of decoding, a first flag of a sequence parameter set (SPS) that is referred to by a current picture is obtained. The current picture is decoded based on whether the first flag indicates the reference picture resampling is enabled. The first flag equal to a first value indicates that the reference picture resampling is enabled and the current picture is allowed to include slices that refer to a reference picture with at least one of a different spatial resolution or a different scaling window in an active entry of a reference pictures list. The first flag equal to a second value indicates that the reference picture resampling is disabled and no slice of the current picture refers to the reference picture with the at least one of the different spatial resolution or the different scaling window in the active entry of the reference picture list.

Claims (49)

1 . A method of decoding, the method comprising:

obtaining from a video bitstream a first flag of a sequence parameter set (SPS) that is referred to by a current picture, the first flag indicating whether reference picture resampling is enabled;

determining whether a picture spatial resolution is allowed to change within a coded layer video sequence (CL VS) referring to the SPS based on a second flag; and

decoding the current picture based on whether the first flag indicates the reference picture resampling is enabled, wherein

the first flag equal to a first value indicates that the reference picture resampling is enabled and the current picture is allowed to include slices that refer to a reference picture with at least one of a different spatial resolution or a different scaling window in an active entry of a reference pictures list,

the first flag equal to a second value indicates that the reference picture resampling is disabled and no slice of the current picture refers to the reference picture with the at least one of the different spatial resolution or the different scaling window in the active entry of the reference pictures list,

the second flag equal to a third value indicates that the picture spatial resolution is allowed to change within the CLVS, and

the second flag equal to a fourth value indicates that the picture spatial resolution does not change within the CLVS.

2 . The method of claim 1 , wherein the first flag is an SPS reference picture resampling enabled flag, the first value is 1, and the second value is 0.

3 . The method of claim 1 , wherein

when the first flag is the first value, the reference picture is in a same layer containing the current picture.

4 . The method of claim 1 , wherein

when the first flag is the first value, the reference picture is in a different layer than a layer containing the current picture.

5 . The method of claim 1 , wherein the second flag is an SPS resolution change in CLVS allowed flag, the third value is 1, and the fourth value is 0.

6 . The method of claim 1 , wherein the second flag is included in the SPS when the first flag is equal to the first value and inferred to be equal to 0 when the first flag is equal to the second value.

7 . A method of encoding, the method comprising:

determining whether reference picture resampling is enabled for a current picture;

encoding a first flag in a sequence parameter set (SPS) of the current picture in a video bitstream based on whether the reference picture resampling is enabled for the current picture;

encoding a second flag in the video bitstream based on whether a picture spatial resolution is allowed to change within a coded layer video sequence (CL VS) referring to the SPS;

encoding the current picture in the video bitstream based on whether the reference picture resampling is enabled for the current picture, wherein

the first flag equal to a first value indicates that the reference picture resampling is enabled and the current picture is allowed to include slices that refer to a reference picture with at least one of a different spatial resolution or a different scaling window in an active entry of a reference pictures list,

the first flag equal to a second value indicates that the reference picture resampling is disabled and no slice of the current picture refers to the reference picture with the at least one of the different spatial resolution or the different scaling window in the active entry of the reference pictures list,

the second flag equal to a third value indicates that the picture spatial resolution is allowed to change within the CLVS, and

the second flag equal to a fourth value indicates that the picture spatial resolution does not change within the CLVS.

8 . The method of claim 7 , wherein the first flag is an SPS reference picture resampling enabled flag, the first value is 1, and the second value is 0.

9 . The method of claim 7 , wherein

when the first flag is the first value, the reference picture is in a same layer containing the current picture.

10 . The method of claim 7 , wherein

when the first flag is the first value, the reference picture is in a different layer than a layer containing the current picture.

11 . The method of claim 7 , further comprising:

determining whether the picture spatial resolution is allowed to change within the CLVS referring to the SPS.

12 . The method of claim 7 , wherein the second flag is an SPS resolution change in CLVS allowed flag, the third value is 1, and the fourth value is 0.

13 . The method of claim 7 , wherein the second flag is encoded in the video bitstream when the first flag is equal to the first value and not encoded in the video bitstream when the first flag is equal to the second value.

14 . A non-transitory computer-readable storage medium storing instructions which when executed by a processor cause the processor to perform an encoding method comprising:

determining whether reference picture resampling is enabled for a current picture;

encoding a first flag in a sequence parameter set (SPS) of the current picture in a video bitstream based on whether the reference picture resampling is enabled for the current picture;

encoding a second flag in the video bitstream based on whether a picture spatial resolution is allowed to change within a coded layer video sequence (CLVS) referring to the SPS;

encoding the current picture in the video bitstream based on whether the reference picture resampling is enabled for the current picture; and

transmitting the video bitstream, wherein

the first flag equal to a first value indicates that the reference picture resampling is enabled and the current picture is allowed to include slices that refer to a reference picture with at least one of a different spatial resolution or a different scaling window in an active entry of a reference pictures list,

the first flag equal to a second value indicates that the reference picture resampling is disabled and no slice of the current picture refers to the reference picture with the at least one of the different spatial resolution or the different scaling window in the active entry of the reference pictures list,

the second flag equal to a third value indicates that the picture spatial resolution is allowed to change within the CLVS, and

the second flag equal to a fourth value indicates that the picture spatial resolution does not change within the CLVS.

15 . The non-transitory computer-readable storage medium of claim 14 , wherein the first flag is an SPS reference picture resampling enabled flag, the first value is 1, and the second value is 0.

16 . The non-transitory computer-readable storage medium of claim 14 , wherein

when the first flag is the first value, the reference picture is in a same layer containing the current picture.

17 . The non-transitory computer-readable storage medium of claim 14 , wherein

when the first flag is the first value, the reference picture is in a different layer than a layer containing the current picture.

18 . The non-transitory computer-readable storage medium of claim 14 , wherein the second flag is an SPS resolution change in CLVS allowed flag, the third value is 1, and the fourth value is 0.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 18, 2024
From: CHOI, BYEONGDOO; WENGER, STEPHAN; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 068018/0926 →
Continuity (7)
Continuation 17889061 · Aug 16, 2022
Continuation 17211236 · Mar 24, 2021
Provisional Application 63036174 · Jun 8, 2020
Provisional Application 63036342 · Jun 8, 2020
Provisional Application 63035647 · Jun 5, 2020
Provisional Application 63027835 · May 20, 2020
Related Publication 20240333953A1 · Oct 3, 2024
References Cited (25)
US 8665968B2 · Chen et al. · 2014 [cited by applicant]
US 20150304671A1 · Deshpande · 2015 [cited by applicant]
US 20160191931A1 · Hannuksela · 2016 [cited by applicant]
US 20170195670A1 · Budagavi · 2017 [cited by applicant]
US 20170353718A1 · Rodriguez et al. · 2017 [cited by applicant]
US 20200077092A1 · Lin et al. · 2020 [cited by applicant]
US 20200389659A1 · Seregin et al. · 2020 [cited by applicant]
US 20200404269A1 · Choi et al. · 2020 [cited by applicant]
US 20210014497A1 · Topiwala · 2021 [cited by examiner]
US 20210203996A1 · Hsiang · 2021 [cited by examiner]
US 20230029791A1 · Wang · 2023 [cited by examiner]
US 20230156233A1 · Samuelsson et al. · 2023 [cited by applicant]
WO 2021022270A2 · 2021 [cited by applicant]
WO 2021190438A1 · 2021 [cited by applicant]
Benjamin Bross, et al., “Versatile Video Coding (Draft 9)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-R2001-vA, 18th Meeting: by teleconference, Apr. 15-24, 2020, 525 pages. [cited by applicant]
Chang et al., “AHG8: On scaling window constraint”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-S0126r1, 19th Meeting: by teleconference, Jun. 22-Jul. 1, 2020, pp. 1-3 (3 page… [cited by applicant]
Choi et al., “AHG8/AHG9: On signaling reference picture resampling”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-S0057, 19th Meeting: by teleconference, Jun. 22-Jul. 1, 2020, … [cited by applicant]
Choi et al., “AHGB: Signaling and Filtering for Reference Picture Resampling”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-00332, Gothenburg, SE, Jul. 3-12, 2019 (8 pages tota… [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2021/026800, mailed on Jul. 16, 2021, 9 pages. [cited by applicant]
Office Action dated Dec. 22, 2022 from the Intellectual Property Office of India in IN Application No. 202137049175. [cited by applicant]
Office Action received for Chinese Patent Application No. 202180003416.7, mailed on Jan. 26, 2024, 16 pages (7 pages of English Translation and 9 pages of Original Document). [cited by applicant]
Wenger et al., “[AHG19] On Signaling of Adaptive Resolution Change”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N0052, Geneva, CH, Mar. 19-27, 2019 (11 pages total). [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 8)”, Joint Video Experts Team (JVET) of ITU:-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29WG 11, 17th Meeting Brussels BE, JVET-Q2001-vE, Jan. 7-17, 2020, pp. 1-3. [cited by applicant]
Office Action and Search Report received for Japanese Application No. 2023-115405, mailed on Apr. 15, 2025, 16 pages (7 pages of original office action and 9 pages of English Translation). [cited by applicant]
Wang et al., “AHG8/AHG9/AHG12: On the combination of RPR, subpictures, and scalability”, Joint Video Experts Team (JVET) of ITU:-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29WG 11, 18th Meeting: by teleconference, JVET-R0058-v5,… [cited by applicant]