IP Library Granted Patent US 12,470,739
Granted Patent B2
US 12,470,739 · App. 18/668,535 · Granted Nov 11, 2025

Method for signaling of mixed NAL unit type in coded video stream

Inventors: Byeongdoo Choi (Palo Alto, CA); Stephan Wenger (Hillsborough, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/46H04N19/174H04N19/188H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,470,739
App. No.
18/668,535
Granted
Nov 11, 2025
Kind
B2
Abstract

A method, computer program, and computer system is provided for coding video data. Video data including one or more subpictures is received. A network abstraction layer (NAL) unit type associated with each of the one or more subpictures is identified based on checking a flag corresponding to mixed NAL units in the one or more subpictures. The video data is decoded based on the identified NAL unit types.

Claims (32)

1 . A method for decoding video data, executable by a processor, comprising:

receiving video data comprising one or more pictures;

determining whether motion vector scaling is disabled across multiple pictures, the multiple pictures comprising the one or more pictures;

based on determining that motion vector scaling is not disabled, determining a motion vector scaling process for a current picture based on at least one of an access unit associated with the current picture or a picture order count (POC) associated with the current picture; and

decoding the video data based on the determined motion vector scaling process and whether an POC cycle syntax, which is a poc_cycle_au syntax, is signaled with the video data and indicating a POC value used for all of the multiple pictures, a first value of the poc_cycle_au syntax indicates that the POC value increases uniformly per access unit (AU), a slice_poc_cycle_au syntax is not explicitly signaled, and a value of an access unit count (AUC) for each AU is calculated by dividing a value of the POC by the poc_cycle_au syntax.

2 . The method of claim 1 , wherein a second value of the poc_cycle_au syntax indicates that the POC value does not increase uniformly per AU, and in a case of the second value, a access_unit_cnt syntax is not signaled with the video data, a slice_access_unit_cnt syntax is signaled in a slice header for each slice or picture, and the value of the AUC is calculated by dividing a value of the POC by a slice_poc_cycle_au syntax.

3 . The method of claim 2 , wherein determining whether motion vector scaling is disabled comprises determining that motion vector scaling is disabled across multiple pictures associated with a same access unit.

4 . The method of claim 3 , wherein based on determining that motion vector scaling is disabled across multiple pictures associated with the same access unit, the method further comprises:

determining that a reference picture associated with the current picture is associated with the same access unit as the current picture; and

based on determining that the reference picture associated with the current picture is associated with the same access unit as the current picture, disabling the motion vector scaling process for temporal motion vector prediction for the current picture.

5 . The method of claim 4 , wherein disabling that the motion vector scaling process for the temporal motion vector prediction for the current picture comprises a motion vector scaling function for the current picture returning a value of one.

6 . A method for encoding video data, executable by a processor, comprising:

receiving video data comprising one or more pictures;

determining whether motion vector scaling is to be disabled across multiple pictures, the multiple pictures comprising the one or more pictures;

based on motion vector scaling to not be disabled, determining a motion vector scaling process for a current picture based on at least one of an access unit associated with the current picture or a picture order count (POC) associated with the current picture; and

encoding the video data based on the determined motion vector scaling process and whether an POC cycle syntax, which is a poc_cycle_au syntax, is to be signaled with the video data and indicating a POC value used for all of the multiple pictures, a first value of the poc_cycle_au syntax indicates that the POC value increases uniformly per access unit (AU), a slice_poc_cycle_au syntax is not explicitly signaled, and a value of an access unit count (AUC) for each AU is calculated by dividing a value of the POC by the poc_cycle_au syntax.

7 . The method of claim 6 , wherein a second value of the poc_cycle_au syntax indicates that the POC value does not increase uniformly per AU, and in a case of the second value, a access_unit_cnt syntax is not signaled with the video data, a slice_access_unit_cnt syntax is signaled in a slice header for each slice or picture, and the value of the AUC is calculated by dividing a value of the POC by a slice_poc_cycle_au syntax.

8 . The method of claim 7 , wherein determining whether motion vector scaling is disabled comprises determining that motion vector scaling is disabled across multiple pictures associated with a same access unit.

9 . The method of claim 8 , wherein based on determining that motion vector scaling is disabled across multiple pictures associated with the same access unit, the method further comprises:

determining that a reference picture associated with the current picture is associated with the same access unit as the current picture; and

based on determining that the reference picture associated with the current picture is associated with the same access unit as the current picture, disabling the motion vector scaling process for temporal motion vector prediction for the current picture.

10 . The method of claim 9 , wherein disabling that the motion vector scaling process for the temporal motion vector prediction for the current picture comprises a motion vector scaling function for the current picture returning a value of one.

11 . A method of processing visual media data, executable by a processor, comprising:

performing a conversion between a visual media file and a bitstream of a visual media data according to a format rule,

wherein the bitstream indicates whether motion vector scaling is disabled across multiple pictures, the multiple pictures comprising the one or more pictures,

wherein the bitstream further indicates, based on motion vector scaling not being disabled, a motion vector scaling process for a current picture based on at least one of an access unit associated with the current picture or a picture order count (POC) associated with the current picture, and

wherein the bitstream further indicates the visual media data based on the motion vector scaling process and whether an POC cycle syntax, which is a poc_cycle_au syntax, is signaled with the video data and indicating a POC value used for all of the multiple pictures, a first value of the poc_cycle_au syntax indicates that the POC value increases uniformly per access unit (AU), a slice_poc_cycle_au syntax is not explicitly signaled, and a value of an access unit count (AUC) for each AU is calculated by dividing a value of the POC by the poc_cycle_au syntax.

12 . The method of claim 11 , wherein a second value of the poc_cycle_au syntax indicates that the POC value does not increase uniformly per AU, and in a case of the second value, a access_unit_cnt syntax is not signaled with the video data, a slice_access_unit_cnt syntax is signaled in a slice header for each slice or picture, and the value of the AUC is calculated by dividing a value of the POC by a slice_poc_cycle_au syntax.

13 . The method of claim 12 , wherein whether motion vector scaling is disabled is based on that motion vector scaling being disabled across multiple pictures associated with a same access unit.

14 . The method of claim 13 , wherein the bitstream indicates, based on the motion vector scaling being disabled across multiple pictures associated with the same access unit, that:

a reference picture associated with the current picture is associated with the same access unit as the current picture,

based on the reference picture associated with the current picture being associated with the same access unit as the current picture, the motion vector scaling process is disabled for temporal motion vector prediction for the current picture.

Continuity (4)
Continuation 17941691 · Sep 9, 2022
Continuation 17095289 · Nov 11, 2020
Provisional Application 63003137 · Mar 31, 2020
Related Publication 20240305809A1 · Sep 12, 2024
References Cited (27)
US 20090232199A1 · Kobayashi · 2009 [cited by examiner]
US 20130094585A1 · Misra et al. · 2013 [cited by applicant]
US 20130114742A1 · Hannuksela · 2013 [cited by applicant]
US 20130177084A1 · Wang · 2013 [cited by examiner]
US 20140064384A1 · Wang · 2014 [cited by applicant]
US 20140334546A1 · Shibahara et al. · 2014 [cited by applicant]
US 20150304671A1 · Deshpande · 2015 [cited by examiner]
US 20160234523A1 · Hattori et al. · 2016 [cited by applicant]
US 20180343463A1 · Xiu et al. · 2018 [cited by applicant]
US 20200186795A1 · Wang et al. · 2020 [cited by applicant]
US 20210297655A1 · He · 2021 [cited by applicant]
US 20220078486A1 · Hannuksela · 2022 [cited by applicant]
US 20220191543A1 · He et al. · 2022 [cited by applicant]
WO 2020185962A1 · 2020 [cited by applicant]
Choi et al., “AHG9/AHG12: On mixed NAL unit types”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-R0120, 18th Meeting: by teleconference, Apr. 15-24, 2020 (2 pages total). [cited by applicant]
Extended European Search Report dated May 18, 2022 from the European Patent Office in EP Application No. 21781229.6. [cited by applicant]
Benjamin Bross et al., “Versatile Video Coding (Draft 8)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-Q2001-vE, Jan. 7-17, 2020, 511 pages, 17th Meeting, Brussels, BE. [cited by applicant]
International Search Report issued Jun. 3, 2021 in International Application No. PCT/US2021/022482. [cited by applicant]
Written Opinion of the International Searching Authority issued Jun. 3, 2021 in International Application No. PCT/US2021/022482. [cited by applicant]
Notice of Reasons for Refusal dated Oct. 4, 2022 from the Japanese Patent Office in Japanese Application No. 2021-561945. [cited by applicant]
Benjamin Bross, et al., Versatile Video Coding (Draft 8), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-Q2001-v9, Jan. 7-17, 2020, 13 pages, 17th Meeting, Brussels, BE. [cited by applicant]
Benjamin Bross et al: “Versatile Video Coding (Draft 8)”, 17. JVET Meeting; Jan. 7, 2020-Jan. 17, 2020; Brussels; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16 ), No. JVET-Q2001-vE; JVET-Q2… [cited by applicant]
Y-K Wang (Bytedance): “AHG8/AHG9/AHG12: On mixed subpicture types within a picture”, 130. MPEG Meeting; Apr. 20, 2020-Apr. 24, 2020; Alpbach; (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. m52989 ; JVET-R0… [cited by applicant]
Extended European Search Report dated Jun. 2, 2025 from the European Patent Office in Application No. 25158556.8. [cited by applicant]
U.S. Appl. No. 17/941,691, filed Sep. 9, 2022. [cited by applicant]
U.S. Appl. No. 17/095,289, filed Nov. 11, 2020. [cited by applicant]
U.S. Appl. No. 63/003,137, filed Mar. 31, 2020. [cited by applicant]