IP Library › Granted Patent US 12,238,275
Granted Patent B2
US 12,238,275 · App. 17/945,714 · Granted Feb 25, 2025

Method and apparatus for signaling and construction of video coding reference picture lists

Inventors: Yan Ye (San Diego, CA); Yong He (San Diego, CA)
Assignee: InterDigital VC Holdings, Inc.
H04N19/105H04N19/103H04N19/117H04N19/124H04N19/13H04N19/139H04N19/15H04N19/503H04N19/577H04N19/61H04N19/70H04N19/172
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,238,275
App. No.
17/945,714
Granted
Feb 25, 2025
Kind
B2
Abstract

Improved method and apparatus for signaling of reference pictures used for temporal prediction. The signaling schemes and construction process for different reference picture lists in HEVC Working Draft 5 (WD5) are improved.

Claims (32)

1. A method for video decoding, comprising:

decoding a first syntax element indicating a number of entries in a reference picture list for a current slice;

decoding a syntax flag, wherein said syntax flag equal to a first value indicates that an ordered list of reference pictures is modified to form said reference picture list for said current slice and indicates that each entry in said reference picture list is explicitly signaled by a respective index, of a set of indices, into said ordered list of reference pictures, and wherein said ordered list of reference pictures includes one or more short term reference pictures associated with said current slice; and

for each entry in said reference picture list, decoding a syntax element specifying said respective index, of said set of indices, into said ordered list of reference pictures, said set of indices having a same number of indices as said number of entries in said reference picture list.

2. The method of claim 1 , wherein said ordered list of reference pictures includes one or more short term reference pictures that are temporally before said current slice, ordered by temporal distance from said current slice, followed by one or more short term reference pictures that are temporally after said current slice, ordered by temporal distance from said current slice.

3. The method of claim 1 , wherein no signaling is used to denote an end of reference picture list modification.

4. The method of claim 1 , wherein no signaling is used to denote a type of modification for reference picture list modification.

5. A computer readable storage medium having stored thereon instructions for video decoding according to method 1 .

6. A method for video encoding, comprising:

encoding a first syntax element indicating a number of entries in a reference picture list for a current slice;

encoding a syntax flag, wherein said syntax flag equal to a first value indicates that an ordered list of reference pictures is modified to form said reference picture list for said current slice and indicates that each entry in said reference picture list is explicitly signaled by a respective index, of a set of indices, into said ordered list of reference pictures, and wherein said ordered list of reference pictures includes one or more short term reference pictures associated with said current slice; and

for each entry in said reference picture list, encoding a syntax element specifying said respective index, of said set of indices, into said ordered list of reference pictures, said set of indices having a same number of indices as said number of entries in said reference picture list.

7. The method of claim 6 , wherein said ordered list of reference pictures includes one or more short term reference pictures that are temporally before said current slice, ordered by temporal distance from said current slice, followed by one or more short term reference pictures that are temporally after said current slice, ordered by temporal distance from said current slice.

8. The method of claim 6 , wherein no signaling is used to denote an end of reference picture list modification.

9. The method of claim 6 , wherein no signaling is used to denote a type of modification for reference picture list modification.

10. A computer readable storage medium having stored thereon instructions for video encoding according to method 6 .

11. An apparatus for video decoding, comprising one or more processors and at least a memory coupled to said one or more processors, wherein said one or more processors are configured to:

decoding a first syntax element indicating a number of entries in a reference picture list for a current slice;

decoding a syntax flag, wherein said syntax flag equal to a first value indicates that an ordered list of reference pictures is modified to form said reference picture list for said current slice and indicates that each entry in said reference picture list is explicitly signaled by a respective index, of a set of indices, into said ordered list of reference pictures, and wherein said ordered list of reference pictures includes one or more short term reference pictures associated with said current slice; and

for each entry in said reference picture list, decoding a syntax element specifying said respective index, of said set of indices, into said ordered list of reference pictures, said set of indices having a same number of indices as said number of entries in said reference picture list.

12. The apparatus of claim 11 , wherein said ordered list of reference pictures includes one or more short term reference pictures that are temporally before said current slice, ordered by temporal distance from said current slice, followed by one or more short term reference pictures that are temporally after said current slice, ordered by temporal distance from said current slice.

13. The apparatus of claim 11 , wherein no signaling is used to denote an end of reference picture list modification.

14. The apparatus of claim 11 , wherein no signaling is used to denote a type of modification for reference picture list modification.

15. The apparatus of claim 11 , wherein said reference picture list is reference picture list 0 or reference picture list 1.

16. An apparatus for video encoding, comprising one or more processors and at least a memory coupled to said one or more processors, wherein said one or more processors are configured to:

encoding a first syntax element indicating a number of entries in a reference picture list for a current slice;

encoding a syntax flag, wherein said syntax flag equal to a first value indicates that an ordered list of reference pictures is modified to form said reference picture list for said current slice and indicates that each entry in said reference picture list is explicitly signaled by a respective index, of a set of indices, into said ordered list of reference pictures, and wherein said ordered list of reference pictures includes one or more short term reference pictures associated with said current slice; and

for each entry in said reference picture list, encoding a syntax element specifying said respective index, of said set of indices, into said ordered list of reference pictures, said set of indices having a same number of indices as said number of entries in said reference picture list.

17. The apparatus of claim 16 , wherein said ordered list of reference pictures includes one or more short term reference pictures that are temporally before said current slice, ordered by temporal distance from said current slice, followed by one or more short term reference pictures that are temporally after said current slice, ordered by temporal distance from said current slice.

18. The apparatus of claim 16 , wherein no signaling is used to denote an end of reference picture list modification.

19. The apparatus of claim 16 , wherein no signaling is used to denote a type of modification for reference picture list modification.

20. The apparatus of claim 16 , wherein said reference picture list is reference picture list 0 or reference picture list 1.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2024
From: VID SCALE, INC.
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 068284/0031 →
Continuity (5)
Continuation 16923364 · Jul 8, 2020
Continuation 15260392 · Sep 9, 2016
Continuation 13738437 · Jan 10, 2013
Provisional Application 61588571 · Jan 19, 2012
Related Publication 20230026503A1 · Jan 26, 2023
References Cited (75)
US 8891613B2 · Wahadaniah et al. · 2014 [cited by applicant]
US 9467695B2 · Ye et al. · 2016 [cited by applicant]
US 20050152452A1 · Suzuki · 2005 [cited by applicant]
US 20050152458A1 · Tanaka · 2005 [cited by applicant]
US 20100020871A1 · Hannuksela et al. · 2010 [cited by applicant]
US 20100046619A1 · Koo et al. · 2010 [cited by applicant]
US 20100086036A1 · Jeon et al. · 2010 [cited by applicant]
US 20100091845A1 · Jeon et al. · 2010 [cited by applicant]
US 20100118933A1 · Pandit et al. · 2010 [cited by applicant]
US 20100135391A1 · Tian et al. · 2010 [cited by applicant]
US 20100202519A1 · Koo et al. · 2010 [cited by applicant]
US 20100208828A1 · Lu et al. · 2010 [cited by applicant]
US 20100296579A1 · Panchal et al. · 2010 [cited by applicant]
US 20100316360A1 · Jeon et al. · 2010 [cited by applicant]
US 20120069905A1 · Kato · 2012 [cited by examiner]
US 20120269275A1 · Hannuksela · 2012 [cited by examiner]
US 20130089134A1 · Wang et al. · 2013 [cited by applicant]
US 20130094774A1 · Misra · 2013 [cited by examiner]
US 20130114680A1 · Leontaris · 2013 [cited by examiner]
US 20140003521A1 · Lee et al. · 2014 [cited by applicant]
US 20200336737A1 · Ye · 2020 [cited by examiner]
CN 101461242A · 2009 [cited by applicant]
CN 101547368A · 2009 [cited by applicant]
CN 101816180A · 2010 [cited by applicant]
CN 101902656A · 2010 [cited by applicant]
CN 102263962A · 2011 [cited by applicant]
EP 1439705A3 · 2011 [cited by applicant]
EP 2770734A1 · 2014 [cited by applicant]
JP 2009532930A · 2009 [cited by applicant]
JP 2010524338A · 2010 [cited by applicant]
JP 2014511645A · 2014 [cited by applicant]
TW 200727603A · 2007 [cited by applicant]
TW 200742442A · 2007 [cited by applicant]
TW 200818919A · 2008 [cited by applicant]
TW 200904198 · 2009 [cited by applicant]
TW 200904198A · 2009 [cited by applicant]
TW 201105145A · 2011 [cited by applicant]
WO WO2006001653A1 · 2006 [cited by applicant]
WO WO2006062377A1 · 2006 [cited by applicant]
WO WO2007114608A1 · 2007 [cited by applicant]
WO WO2008023967A1 · 2008 [cited by applicant]
WO WO2008123917A2 · 2008 [cited by applicant]
WO WO2011075071A1 · 2011 [cited by applicant]
WO WO2012067966A1 · 2012 [cited by applicant]
WO WO2012099656A1 · 2012 [cited by applicant]
WO WO2012122176A1 · 2012 [cited by applicant]
WO WO2012124961A2 · 2012 [cited by applicant]
Bross et al., “High Efficiency Video Coding (HEVC) Text Specification Draft 6”, Document: JCTVC-H1003, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 8th Meeting: San Jos… [cited by applicant]
Sjoberg et al., “Overview of HEVC High-Level Syntax and Reference Picture Management”,IEEE Transactions on Circuits and Systemsfor Video Technology, IEEE Service Center, Piscataway,NJ, US, vol. 22, pp. 1858-1870, Dec. 1… [cited by applicant]
Bross et al., “WD4: Working Draft 4 of High-Efficiency Video Coding”, Document: JCTVC-F803_d6, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 6th Meeting: Torino, IT, 228… [cited by applicant]
Tourapis et al., “H.264/MPEG-4 AVC Reference Software Manual”, JM reference software JM18.2;Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG; 24th Meeting: Geneva, CH, 75 pages, Jun. 2007. [cited by applicant]
Suzuki et al., “Extension of uni-prediction simplification in B slices”, Document No. JCTVC-D421, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11_JCTVC-D421, 7 pages, Jan. … [cited by applicant]
Ye et al., “AHG21: Reference picture lists combination syntax”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-H0137, 6 pages, Feb. 2012. [cited by applicant]
Bross et al.,“WD5: Working Draft 5 of High-Efficiency Video Coding”, Document: JCTVC-G1103_d4, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 7th Meeting: Gevena, CH,pp. … [cited by applicant]
Boyce et al., “JCT-VC Break-Out Report: Reference Picture Buffering and List Construction (AHG21)”, BoG report: Reference picture buffering and list construction. Document No. JCTVC-G1002, 8 pages, Nov. 2011. [cited by applicant]
Bross et al., “WD5: Working Draft 5 of High-Efficiency Video Coding”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11; Document No. JCTVC-G1103, 238 pages, Nov. 2011. [cited by applicant]
He et al., “AHG21: Unification of Reference Picture List Modification Processes”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-H0138, 6 pages, Feb. 2012. [cited by applicant]
Yu, et al., “The Reference Picture Construction of Combined List for HEVC”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11_JCTVC-G717, 6 pages, Nov. 2011. [cited by applicant]
Anonymous, “Advanced Video Coding for Generic Audiovisual Services”, Telecommunication Standardization Sector of ITU, Recommendation ITU-T H.264, Series H: Audiovisual and MulitMedia Systems—Infrastructure of Audiovisua… [cited by applicant]
Wang, et al, “On reference picture list construction for uni-predicted partitions”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Document: JCTVC-E348, 6 pages, Mar. 16-… [cited by applicant]
Anonymous, Advanced video coding for generic audiovisual services, ITU-T Rec H.264 and ISO/IEC/MPEG 4 part 10, Mar. 2010,676 pages. [cited by applicant]
Flynn et al., “JCTVC AHG report: Reference picture buffering and list construction (AHG21)”, Document No. JCTVC-G021; 7th Meeting Geneva, CH, 21-30, 9 pages, Nov. 2011. [cited by applicant]
Bross et al., “WD5: Working Draft 5 of High-Efficiency Video Coding”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11; Document No. JCTVC-G1103_d9, 237 pages, Nov. 21-30, 2… [cited by applicant]
Wang et al., “AHG21: On DPB management”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 JCTVC-G314, ITU-T, 7 pages, Nov. 21-30, 2011. [cited by applicant]
Fang, et al., “The Construction of Combined List for HEVC”, Joint Collaborative Team on Video Coding (JCTVC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11_JCTVC-F573, 6 pages, Jul. 14, 2011. [cited by applicant]
Bross, et al., “High Efficiency Video Coding (HEVC) text specification draft 9”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, (JCTVC-K1003_v13), 317 pages, Oct. 10-19, … [cited by applicant]
Yu et al., “Modifications on Signaling Collocated Picture”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP3 and ISO/IEC JTC 1/SC 29/WG11, JCTVC-10266, Apr. 7, 2012, 4 pages. [cited by applicant]
Anonymous, “VC-1 Compressed Video Bitstream Format and Decoding Process—Amendment 2”, SMPTE Amendment 2:2011 Smpte 421M-2006, Society of Motion Picture and Television Engineers, Feb. 2011, 5 pages. [cited by applicant]
He, et al., “AHG15: Clarification of Mapping Process for Reference Picture Lists Combination in B Slices”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, JCTVC-I0220,… [cited by applicant]
Bross et al., WD5: Working Draft 5 of High-Efficiency Video Coding, JCTVC-G1103_d0, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 7th Meeting: Gevena, CH, pp. 1-215, Nov… [cited by applicant]
Fang et al., “The Construction of Combined List for HEVC”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-F573-r2, 6 pages, Jul. 14-22, 2011. [cited by applicant]
McCann, et al., “HM5: High Efficiency Video Coding (HEVC) Test Model 5 Encoder Description”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11; Document No. JCTVC-G1102, 45 p… [cited by applicant]
He et al., “AHG21: Unification of Reference Picture List Modification Processes”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 8th Meeting, San Jose, CA, USA, Document:… [cited by applicant]
Wahadaniah,et al., “AHG21: Construction and modification of predefined reference picture sets and reference picture lists”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11,… [cited by applicant]
Yu et al., “Implicit signaling of collocated picture for HEVC”, Document: JCTVC-H548, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 8th Meeting: San Jose. CA, USA, pp. 1… [cited by applicant]