IP Library Granted Patent US 12,432,357
Granted Patent B2
US 12,432,357 · App. 18/072,326 · Granted Sep 30, 2025

Method for alignment across layers in coded video stream

Inventors: Byeongdoo Choi (Palo Alto, CA); Shan Liu (San Jose, CA); Stephan Wenger (Hillsborough, CA)
Assignee: TENCENT AMERICA LLC
H04N19/167H04N19/103H04N19/117H04N19/159H04N19/177H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,432,357
App. No.
18/072,326
Granted
Sep 30, 2025
Kind
B2
Abstract

A method, computer program, and computer system is provided for aligning across layers in a coded video stream. A video bitstream having multiple layers is decoded. One or more subpicture regions are identified from among the multiple layers of the decoded video bitstream, the subpicture regions including a background region and one or more foreground subpicture regions. An enhanced subpicture is decoded and displayed based on a determination that a foreground subpicture region is selected. The background region is decoded and displayed based on a determination that a foreground subpicture region was not selected.

Claims (28)

1. A method of aligning across layers in a coded video stream, executable by a processor, comprising:

receiving a video bitstream having multiple layers;

identifying one or more subpictures that are independently decodable from among the multiple layers of the video bitstream based on one or more picture order count values within an access unit associated with respective subpictures among the one or more subpictures, wherein the access unit includes a plurality of subpictures with two or more picture order count values, wherein the one or more picture order count values are used to determine respective access unit count values for the one or more subpictures, and wherein the respective access unit count values indicate a distinct composition time instance for the one or more subpictures;

decoding the one or more subpictures; and

aligning the one or more subpictures across the multiple layers.

2. The method of claim 1 , wherein the respective access unit count values are determined based on a division of the one or more picture order count values by an integer value.

3. The method of claim 1 , wherein the respective access unit count values are determined based on a shift operation on the one or more picture order count values.

4. The method of claim 1 , wherein a picture cycle count value indicates a maximum number of picture order count values within a same access unit.

5. The method of claim 4 , wherein the picture cycle count value is determined based a number of spatial layers in the video bitstream.

6. The method of claim 1 , wherein the one or more subpictures within a same access unit have a same TemporalID.

7. The method of claim 1 , wherein the one or more subpictures within a same access unit have different spatial layer identifier.

8. The method of claim 1 , wherein motion vector scaling within the access unit based on the one or more picture order count values is disabled for temporal motion vector prediction of a current subpicture among the one or more subpictures.

9. The method of claim 8 , wherein the motion vector scaling within the access unit is based on a spatial resolution ratio between a spatial resolution of a reference picture and the spatial resolution of the current subpicture.

10. A computer system for aligning across layers in a coded video stream, the computer system comprising:

one or more computer-readable non-transitory storage media configured to store computer program code; and

one or more computer processors configured to access said computer program code and operate as instructed by said computer program code, said computer program code including:

receiving code configured to cause the one or more computer processors to receive a video bitstream having multiple layers;

identifying code configured to cause the one or more computer processors to identify one or more subpictures that are independently decodable from among the multiple layers of the video bitstream based on one or more picture order count values within an access unit associated with respective subpictures among the one or more subpictures, wherein the access unit includes a plurality of subpictures with two or more picture order count values, wherein the one or more picture order count values are used to determine respective access unit count values for the one or more subpictures, and wherein the respective access unit count values indicate a distinct composition time instance for the one or more subpictures;

first decoding code configured to cause the one or more computer processors to decode the one or more subpictures; and

aligning code configured to cause the one or more computer processors to align the one or more subpictures across the multiple layers.

11. The computer system of claim 10 , wherein the respective access unit count values are determined based on a division of the one or more picture order count values by an integer value.

12. The computer system of claim 10 , wherein the respective access unit count values are determined based on a shift operation on the one or more picture order count values.

13. The computer system of claim 10 , wherein a picture cycle count value indicates a maximum number of picture order count values within a same access unit.

14. The computer system of claim 13 , wherein the picture cycle count value is determined based a number of spatial layers in the video bitstream.

15. The computer system of claim 10 , wherein the one or more subpictures within a same access unit have a same TemporalID.

16. The computer system of claim 10 , wherein motion vector scaling within the access unit based on the one or more picture order count values is disabled for temporal motion vector prediction of a current subpicture among the one or more subpictures.

17. The computer system of claim 16 , wherein the motion vector scaling within the access unit is based on a spatial resolution ratio between a spatial resolution of a reference picture and the spatial resolution of the current subpicture.

18. A non-transitory computer readable medium having stored thereon a computer program for aligning across layers in a coded video stream, the computer program configured to cause one or more computer processors to: receive a video bitstream having multiple la yers; identify one or more subpictures that are independently decodable from among the multiple layers of the video bitstream based on one or more picture order count values within an access unit associated with respective subpictures among the one or more subpictures, wherein the access unit includes a plurality of subpictures with two or more picture order count values, wherein the one or more picture order count values are used to determine respective access unit count values for the one or more subpictures, and wherein the respective access unit count values indicate a distinct composition time instance for the one or more subpictures; decode the one or more subpictures; and align the one or more subpictures across the multiple layers.

Continuity (3)
Continuation 17063025 · Oct 5, 2020
Provisional Application 62954844 · Dec 30, 2019
Related Publication 20230132814A1 · May 4, 2023
References Cited (20)
US 20070183676A1 · Hannuksela et al. · 2007 [cited by applicant]
US 20070192676A1 · Bodin · 2007 [cited by applicant]
US 20100046609A1 · Toma · 2010 [cited by applicant]
US 20130113996A1 · Zhu · 2013 [cited by examiner]
US 20140003504A1 · Ugur et al. · 2014 [cited by applicant]
US 20140301463A1 · Rusanovskyy et al. · 2014 [cited by applicant]
US 20150195577A1 · Hannuksela · 2015 [cited by applicant]
US 20150373338A1 · Hendry · 2015 [cited by examiner]
US 20170302949A1 · Malamal Vadakital · 2017 [cited by examiner]
US 20180089903A1 · Pang · 2018 [cited by applicant]
US 20200236371A1 · Nishi · 2020 [cited by applicant]
CN 1593065A · 2005 [cited by applicant]
WO 2021133459A1 · 2021 [cited by applicant]
Benjamin Bross et al., “Versatile Video Coding (Draft 6)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting, JVET-O2001-vE, Jul. 3-12, 2019, Gothenburg, SE, 455 pages. [cited by applicant]
International Search Report dated Jan. 21, 2021 in Application No. PCT/US2020/056301. [cited by applicant]
Written Opinion of the International Searching Authority dated Jan. 21, 2021 in Application No. PCT/US2020/056301. [cited by applicant]
Extended European Search Report dated Nov. 25, 2022 in European Application No. 20909272.5. [cited by applicant]
Communication dated Dec. 6, 2024, issued in Chinese Application No. 202080036505.7. [cited by applicant]
Communication issued Sep. 9, 2024 from the Korean Intellectual Property Office in Korean Patent Application No. 10-2021-7033802. [cited by applicant]
Benjamin Bross et al., “Versatile Video Coding (Draft 7)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting, JVET-P2001-vE, Oct. 1-11, 2019, Geneva, CH, 489 pages. [cited by applicant]