IP Library Granted Patent US 12,701,264
Granted Patent B2
US 12,701,264 · App. 18/134,396 · Granted Aug 4, 2026

Method for parameter set reference constraints in coded video stream

Inventors: Byeongdoo Choi (Palo Alto, CA); Shan Liu (Palo Alto, CA); Stephan Wenger (Palo Alto, CA)
Assignee: TENCENT AMERICA LLC
H04N19/59H04N19/105H04N19/174
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,701,264
App. No.
18/134,396
Filed
Apr 13, 2023
Granted
Aug 4, 2026
Kind
B2
Art Unit
2485
USPC
375/240.12
Abstract

There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform obtaining video data comprising data of a plurality of semantically independent source pictures, determining, among the video data, whether references are associated with any of a first access unit (AU) and a second AU according to at least one picture order count (POC) signal value included with the video data, and outputting a first quantity of the references set to the first AU and a second quantity of the references set to the second AU based on the at least one POC signal value.

Claims (49)

1 . A method for video decoding in a decoder, the method comprising:

obtaining video data comprising data of a plurality of pictures, and of which a same value space of values of adaptation_parameter_set_id and aps_params_type is shared across spatial layers of the video data regardless of nuh_layer_id values, and of which a same value space of sps_video_parameter_set_id is shared in a sequence parameter set;

determining, among the video data, whether references are associated with any of a first access unit (AU) and a second AU based on comparing respective POC values with the POC signal value, determining that the at least first one of the references comprises a first value that is less than the POC signal value, and determining that the at least second one of the references comprises a second value that is equal to or greater than the POC signal value; and

decoding the video data based on at least a first one of the references being set to the first AU and at least a second one of the references being set to the second AU based on a picture order count (POC) signal value.

2 . The method according claim 1 ,

wherein the references comprise at least one of pictures, slices, and tiles of the video data.

3 . The method according to claim 1 ,

wherein the references comprise the slices, and

wherein the POC signal value is included in a slice header of the video data.

4 . The method according to claim 1 , wherein outputting the at least first one of the references set to the first AU and the at least second one of the references set to the second AU based on the POC signal value is further based on whether a quantity of the references comprises one of a plurality of POC values that is less than the POC signal value.

5 . The method according to claim 1 ,

wherein the POC signal value is included in a video parameter set (VPS) of the video data, and

wherein the method further comprises determining whether the VPS data comprises at least one flag indicating whether one or more of the references are divided into a plurality of sub-regions.

6 . The method according to claim 5 , further comprising:

determining, in a case where the at least one flag indicates that the one or more of the references are divided into the plurality of sub-regions, a signaling value, included in the sequence parameter set of the video data, specifying an offset of a portion of at least one of the sub-regions.

7 . The method according to claim 1 ,

wherein the pictures represent a spherical 360 picture.

8 . A method for video encoding, the method comprising:

obtaining video data comprising data of a plurality of pictures; and

encoding the video data such that a same value space of values of adaptation_parameter_set_id and aps_params_type is shared across spatial layers of the video data regardless of nuh_layer_id values, and of which a same value space of sps_video_parameter_set_id is shared in a sequence parameter set, and

encoding the video data further comprises determining, among the video data, whether references are associated with any of a first access unit (AU) and a second AU based on comparing respective POC values with the POC signal value, determining that the at least first one of the references comprises a first value that is less than the POC signal value, and determining that the at least second one of the references comprises a second value that is equal to or greater than the POC signal value, and based on at least a first one of the references being set to the first AU and at least a second one of the references being set to the second AU based on a picture order count (POC) signal value.

9 . The method according claim 8 ,

wherein the references comprise at least one of pictures, slices, and tiles of the video data.

10 . The method according to claim 8 ,

wherein the references comprise the slices, and

wherein the POC signal value is included in a slice header of the video data.

11 . The method according to claim 8 , wherein the at least first one of the references set to the first AU and the at least second one of the references set to the second AU based on the POC signal value is further based on whether a quantity of the references comprises one of a plurality of POC values that is less than the POC signal value.

12 . The method according to claim 8 ,

wherein the POC signal value is included in a video parameter set (VPS) of the video data, and

wherein the method further comprises determining whether the VPS data comprises at least one flag indicating whether one or more of the references are divided into a plurality of sub-regions.

13 . The method according to claim 12 , further comprising:

determining, in a case where the at least one flag indicates that the one or more of the references are divided into the plurality of sub-regions, a signaling value, included in the sequence parameter set of the video data, specifying an offset of a portion of at least one of the sub-regions.

14 . The method according to claim 8 ,

wherein the pictures represent a spherical 360 picture.

15 . A method of encoding visual media data, the method comprising:

generating a bitstream of the visual media data according to an encoding process;

the bitstream of the visual media data comprising encoded video data such that a same value space of values of adaptation_parameter_set_id and aps_params_type is shared across spatial layers of the video data regardless of nuh_layer_id values, and a same value space of sps_video_parameter_set_id is shared in a sequence parameter set, and

the encoding process comprises encoding and transmitting the video data based on determining, among the video data, whether references are associated with any of a first access unit (AU) and a second AU based on comparing respective POC values with the POC signal value, determining that the at least first one of the references comprises a first value that is less than the POC signal value, and determining that the at least second one of the references comprises a second value that is equal to or greater than the POC signal value, and based on at least a first one of the references being set to the first AU and at least a second one of the references being set to the second AU based on a picture order count (POC) signal value, and

transmitting the generated bitstream of the visual media data.

16 . The method according claim 15 ,

wherein the references comprise at least one of pictures, slices, and tiles of the video data.

17 . The method according to claim 15 ,

wherein the references comprise the slices, and

wherein the POC signal value is included in a slice header of the video data.

18 . The method according to claim 15 , wherein the at least first one of the references set to the first AU and the at least second one of the references set to the second AU based on the POC signal value is further based on whether a quantity of the references comprises one of a plurality of POC values that is less than the POC signal value.

19 . The method according to claim 15 ,

wherein the POC signal value is included in a video parameter set (VPS) of the video data, and

wherein the method further comprises determining whether the VPS data comprises at least one flag indicating whether one or more of the references are divided into a plurality of sub-regions.

20 . The method according to claim 19 , wherein he video encoding method further comprises determining, in a case where the at least one flag indicates that the one or more of the references are divided into the plurality of sub-regions, a signaling value, included in the sequence parameter set of the video data, specifying an offset of a portion of at least one of the sub-regions.

Continuity (4)
Continuation 17564011 · Dec 28, 2021
Continuation 17063085 · Oct 5, 2020
Provisional Application 62954883 · Dec 30, 2019
Related Publication 20230254506A1 · Aug 10, 2023
References Cited (80)
US 20080137744A1 · Moriya · 2008 [cited by applicant]
US 20080232467A1 · Guchi · 2008 [cited by applicant]
US 20100020884A1 · Pandit et al. · 2010 [cited by applicant]
US 20130182755A1 · Chen · 2013 [cited by applicant]
US 20130272372A1 · Hannuksela · 2013 [cited by examiner]
US 20130287366A1 · Wang · 2013 [cited by applicant]
US 20140063185A1 · Chen · 2014 [cited by applicant]
US 20140168362A1 · Hannuksela et al. · 2014 [cited by applicant]
US 20140218473A1 · Hannuksella et al. · 2014 [cited by applicant]
US 20140294076A1 · Misra et al. · 2014 [cited by applicant]
US 20140301484A1 · Wang · 2014 [cited by examiner]
US 20140321529A1 · Jung · 2014 [cited by applicant]
US 20140341289A1 · Schwarz et al. · 2014 [cited by applicant]
US 20140341291A1 · Schwarz et al. · 2014 [cited by applicant]
US 20150003529A1 · Thirumalai et al. · 2015 [cited by applicant]
US 20150030074A1 · Nakagami et al. · 2015 [cited by applicant]
US 20150103903A1 · Ramasubramonian · 2015 [cited by applicant]
US 20150103912A1 · Lee · 2015 [cited by applicant]
US 20150103923A1 · Ramasubramonian · 2015 [cited by applicant]
US 20150139320A1 · Wang · 2015 [cited by applicant]
US 20150146787A1 · Hendry · 2015 [cited by applicant]
US 20150156501A1 · Hannuksela · 2015 [cited by applicant]
US 20150163520A1 · Martin · 2015 [cited by applicant]
US 20150172667A1 · Hendry · 2015 [cited by applicant]
US 20150181233A1 · Ramasubramonian · 2015 [cited by applicant]
US 20150195561A1 · Wang · 2015 [cited by applicant]
US 20150264366A1 · Hendry · 2015 [cited by applicant]
US 20150271525A1 · Hendry · 2015 [cited by applicant]
US 20150271526A1 · Hendry · 2015 [cited by applicant]
US 20150304665A1 · Hannuksela et al. · 2015 [cited by applicant]
US 20150373342A1 · Hendry · 2015 [cited by applicant]
US 20150382018A1 · Hendry · 2015 [cited by examiner]
US 20160065983A1 · Choi · 2016 [cited by applicant]
US 20160088306A1 · Sjoberg · 2016 [cited by applicant]
US 20160261877A1 · Wang · 2016 [cited by applicant]
US 20160269740A1 · Choi · 2016 [cited by applicant]
US 20160323590A1 · Li · 2016 [cited by applicant]
US 20160353115A1 · Samuelsson · 2016 [cited by applicant]
US 20160381393A1 · Tsukuba et al. · 2016 [cited by applicant]
US 20170013259A1 · Li · 2017 [cited by applicant]
US 20170026655A1 · Deshpande · 2017 [cited by examiner]
US 20170118466A1 · Nakagami · 2017 [cited by applicant]
US 20170280141A1 · Chou · 2017 [cited by applicant]
US 20180063550A1 · Tech · 2018 [cited by applicant]
US 20190215532A1 · He · 2019 [cited by applicant]
US 20190238864A1 · Xiu et al. · 2019 [cited by applicant]
US 20190268608A1 · Ma · 2019 [cited by applicant]
US 20190373245A1 · Lee et al. · 2019 [cited by applicant]
US 20200053359A1 · Lee · 2020 [cited by applicant]
US 20200120359A1 · Hanhart · 2020 [cited by applicant]
US 20200145663A1 · Li · 2020 [cited by applicant]
US 20200177916A1 · Niamut · 2020 [cited by applicant]
US 20200351507A1 · Li · 2020 [cited by applicant]
US 20210037248A1 · Kondo · 2021 [cited by applicant]
US 20210092394A1 · Tsai · 2021 [cited by applicant]
CN 113692744A · 2021 [cited by applicant]
CN 113796080A · 2021 [cited by applicant]
CN 113874875A · 2021 [cited by applicant]
EP 4032284A1 · 2022 [cited by applicant]
EP 4035383A1 · 2022 [cited by applicant]
EP 4081936A1 · 2022 [cited by applicant]
WO 2017158236A2 · 2017 [cited by applicant]
WO 2019137171A1 · 2019 [cited by applicant]
WO 2019182704A1 · 2019 [cited by applicant]
WO 2021055738A1 · 2021 [cited by applicant]
WO 2021061628A1 · 2021 [cited by applicant]
WO 2021133452A1 · 2021 [cited by applicant]
Byeongdoo Choi et al., “MV-HEVC/SHVC HLS: Random access of multiple layers”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JCTVC-N0121r1, Jul. 25, 2013-Aug. 2, 2013… [cited by applicant]
Benjamin Bross et al., “Versatile Video Coding (Draft 7)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-P2001-vE, Oct. 1-11, 2019, 16th Meeting, Geneva, CH (489 pages total). [cited by applicant]
Byeongdoo Choi et al., “AHG8: Region-wise scalability support with reference picture resampling”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-00336, Jul. 3-12, 2019, 15th Meet… [cited by applicant]
Byeongdoo Choi et al., “AHG8/AHG9: On video parameter set ID”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-Q0280-v2, Jan. 7-17, 2020, 17th Meeting, Brussels, BE (2 pages total… [cited by applicant]
Byeongdoo Choi et al., “AHG9: On adaptation parameter set identification”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-Q0285, Jan. 7-17, 2020, 17th Meeting, Brussels, BE (4 pa… [cited by applicant]
Extended European Search Report issued Mar. 27, 2023 in European Application No. 20908723.8. [cited by applicant]
Benjamin Bross et al., “Versatile Video Coding (Draft 6)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3and ISO/IEC JTC 1/SC 29/WG 11, Jul. 3, 2019-Jul. 12, 2019, 455pages. [cited by applicant]
Byeongdoo Choi et al., “AHG8: On spatial scalability support with reference picture resampling”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-O0333, Jul. 3-12, 2019, 15th Meeti… [cited by applicant]
Communication dated Feb. 6, 2023, issued by the Intellectual Property Office of Singapore in application No. 11202111496X. [cited by applicant]
International Search Report dated Jan. 15, 2021 from the International Searching Authority in International Application No. PCT/US2020055759. [cited by applicant]
Office Action issued Nov. 14, 2022 in Japanese Application No. 2021-559386. [cited by applicant]
Written Opinion dated Jan. 15, 2021 from the International Bureau in International Application No. PCT/US2020055759. [cited by applicant]
Communication dated Aug. 27, 2024, issued in Singapore Application No. 11202111496X. [cited by applicant]