IP Library Granted Patent US 12,413,758
Granted Patent B2
US 12,413,758 · App. 18/402,413 · Granted Sep 9, 2025

Constraint flags in general constraints information

Inventors: Byeongdoo Choi (Vancouver, WA); Shan Liu (San Jose, CA); Stephan Wenger (Hillsborough, CA)
Assignee: TENCENT AMERICA LLC
H04N19/44H04N19/176H04N19/46H04N19/70H04N19/93
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,413,758
App. No.
18/402,413
Granted
Sep 9, 2025
Kind
B2
Abstract

A method of video encoding includes determining whether a plurality of constraint flags of a constraint information group are to be signaled for a subset of coding blocks, and signaling a gate flag indicating whether the plurality of constraint flags of the constraint information group are signaled. The gate flag is signaled in constraint information in a syntax structure of a coded video bitstream. In accordance with the signaled gate flag indicating that the plurality of constraint flags of the constraint information group are signaled, the method further includes signaling the plurality of constraint flags of the constraint information group in the constraint information in the syntax structure of the coded video bitstream. In accordance with the plurality of constraint flags being signaled in the constraint information, the method further includes encoding the subset of coding blocks based on the plurality of constraint flags.

Claims (67)

1. A method of video encoding in an encoder, the method comprising:

determining whether each constraint information group of at least one constraint information group and including a plurality of constraint flags is to be signaled for a subset of coding blocks in constraint information in a video bitstream;

signaling, in the constraint information, a gate flag of each constraint information group indicating whether the respective constraint information group of the at least one constraint information group corresponding to the respective gate flag is signaled in the constraint information, the constraint information being for the subset of coding blocks in the video bitstream, each constraint information group including the respective plurality of constraint flags for the subset of coding blocks;

generating prediction information for the subset of coding blocks based on whether a first constraint information group in the at least one constraint information group is signaled in the constraint information;

based on whether the first constraint information group including the plurality of constraint flags is signaled in the constraint information, encoding the subset of coding blocks, wherein

when the first constraint information group of the gate flag is determined to be signaled in the constraint information,

the generating the prediction information includes generating the prediction information for the subset of coding blocks based on the plurality of constraint flags in the first constraint information group of the gate flag; and

an offset and a length are signaled in the constraint information indicating that the plurality of constraint flags in the first constraint information group of the gate flag is signaled in the constraint information.

2. The method of claim 1 , wherein

the plurality of constraint flags in the first constraint information group is determined to be signaled in the constraint information.

3. The method of claim 1 , wherein

a plurality of constraint flags of a second constraint information group in the at least one constraint information group is determined not to be signaled in the constraint information.

4. The method of claim 1 , wherein the gate flag of a second constraint information group in the at least one constraint information group indicates that a plurality of constraint flags of the second constraint information group in the at least one constraint information group is not signaled, and the plurality of constraint flags of the second constraint information group is not signaled in the constraint information.

5. The method of claim 1 , wherein the constraint information is a high level syntax structure for at least one picture, and the subset of coding blocks includes coding blocks in the at least one picture.

6. The method of claim 1 , wherein

the plurality of constraint flags in the first constraint information group is determined to be signaled,

the plurality of constraint flags is signaled according to a predetermined order, and

the method further includes

run-encoding the plurality of constraint flags; and

generating the prediction information for the subset of coding blocks based on the plurality of constraint flags.

7. The method of claim 2 , wherein

the plurality of constraint flags is signaled according to a predetermined order, and

the generating the prediction information further includes run-encoding the plurality of constraint flags.

8. The method of claim 2 , wherein

the at least one constraint information group includes plural constraint information groups and plural corresponding gate flags indicating presence of each of the plural constraint information groups, and

an offset and a length are signaled in the constraint information for each of the plural constraint information groups indicating a position of and a number of contiguous constraint flags in the respective one of the plural constraint information groups.

9. The method of claim 8 , wherein

a syntax element indicating a number of offsets included in the constraint information is signaled in the constraint information.

10. The method of claim 1 , wherein

one or more constraint information groups including the first constraint information group are signaled in the video bitstream, and

one or more syntax elements in the constraint information are byte aligned, the one or more syntax elements including the gate flag of each of the one or more constraint information groups and including the plurality of constraint flags in the one or more constraint information groups.

11. A method of video decoding, the method comprising:

obtaining a gate flag of each of at least one constraint information group in constraint information signaled in a coded video bitstream, each gate flag indicating whether a constraint information group of the at least one constraint information group corresponding to the respective gate flag is present in the constraint information, the constraint information being for a subset of coding blocks in the coded video bitstream;

determining whether a first constraint information group of the at least one constraint information group is present in the constraint information based on the gate flag of the first constraint information group of the at least one constraint information group, the first constraint information group including a plurality of constraint flags for the subset of coding blocks;

determining prediction information for the subset of coding blocks based on whether the first constraint information group of the gate flag is present in the constraint information; and

reconstructing the subset of coding blocks based on the prediction information, wherein

when the first constraint information group of the gate flag is determined to be present in the constraint information;

the determining the prediction information includes determining the prediction information for the subset of coding blocks based on the plurality of constraint flags in the first constraint information group of the gate flag; and

an offset and a length are present in the constraint information indicating that the plurality of constraint flags in the first constraint information group of the gate flag is present in the constraint information.

12. The method of claim 11 , wherein

the plurality of constraint flags in the first constraint information group is determined to be present in the constraint information.

13. The method of claim 11 , wherein

a plurality of constraint flags of a second constraint information group in the at least one constraint information group is determined not to be present in the constraint information.

14. The method of claim 11 , wherein the gate flag of a second constraint information group in the at least one constraint information group indicates that a plurality of constraint flags of the second constraint information group in the at least one constraint information group is not present in the constraint information, and the plurality of constraint flags of the second constraint information group is not present in the constraint information.

15. The method of claim 11 , wherein the constraint information is a high level syntax structure for at least one picture, and the subset of coding blocks includes coding blocks in the at least one picture.

16. The method of claim 11 , wherein

the plurality of constraint flags in the first constraint information group is determined to be present in the constraint information,

the plurality of constraint flags is signaled according to a predetermined order, and

the determining the prediction information further includes run-decoding the plurality of constraint flags and determining the prediction information for the subset of coding blocks based on the plurality of constraint flags.

17. The method of claim 12 , wherein

the plurality of constraint flags is signaled according to a predetermined order, and

the determining the prediction information further includes run-encoding the plurality of constraint flags.

18. The method of claim 12 , wherein

the at least one constraint information group includes plural constraint information groups and plural corresponding gate flags indicating presence of each of the plural constraint information groups, and

an offset and a length are present in the constraint information for each of the plural constraint information groups indicating a position of and a number of contiguous constraint flags in the respective one of the plural constraint information groups.

19. The method of claim 18 , wherein

a syntax element indicating a number of offsets included in the constraint information is present in the constraint information.

20. A method of processing visual media data, the method comprising:

processing a video bitstream of the visual media data according to a format rule, wherein

the video bitstream includes a gate flag of each constraint information group indicating whether the respective constraint information group of at least one constraint information group corresponding to the respective gate flag is present in constraint information, the constraint information being for a subset of coding blocks in the video bitstream, each constraint information group including respective plurality of constraint flags for the subset of coding blocks; and

the format rule specifies that:

each gate flag of a respective one of the at least one constraint information group in the constraint information signaled in the video bitstream is obtained;

whether a first constraint information group of the at least one constraint information group is present in the constraint information is determined based on the gate flag of the first constraint information group of the at least one constraint information group, the first constraint information group including a plurality of constraint flags for the subset of coding blocks; and

when the first constraint information group of the first gate flag is determined to be present in the constraint information,

an offset and a length are present in the constraint information indicating that the plurality of constraint flags in the first constraint information group of the gate flag is present in the constraint information;

prediction information for the subset of coding blocks is determined based on the plurality of constraint flags in the first constraint information group of the gate flag; and

the subset of coding blocks is reconstructed based on the prediction information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 2, 2024
From: CHOI, BYEONGDOO; LIU, SHAN; WENGER, STEPHAN
To: TENCENT AMERICA LLC
Reel/Frame 065997/0469 →
Continuity (8)
Continuation 17888026 · Aug 15, 2022
Continuation 17220672 · Apr 1, 2021
Provisional Application 63028222 · May 21, 2020
Provisional Application 63027848 · May 20, 2020
Provisional Application 63024140 · May 13, 2020
Provisional Application 63010272 · Apr 15, 2020
Provisional Application 63005345 · Apr 5, 2020
Related Publication 20240137545A1 · Apr 25, 2024
References Cited (34)
US 11889119B2 · Deng · 2024 [cited by examiner]
US 20180077411A1 · Gisquet et al. · 2018 [cited by applicant]
US 20210176475A1 · Hsu et al. · 2021 [cited by applicant]
US 20210176491A1 · Wu · 2021 [cited by applicant]
US 20210258598A1 · Hendry et al. · 2021 [cited by applicant]
US 20210314623A1 · Chang et al. · 2021 [cited by applicant]
US 20210321138A1 · Samuelsson et al. · 2021 [cited by applicant]
US 20210360289A1 · He · 2021 [cited by examiner]
US 20210368207A1 · Li · 2021 [cited by examiner]
US 20220086473A1 · Wang · 2022 [cited by applicant]
US 20220353495A1 · Zhu et al. · 2022 [cited by applicant]
US 20220394304A1 · Deng et al. · 2022 [cited by applicant]
US 20230027478A1 · Deng et al. · 2023 [cited by applicant]
US 20230085304A1 · Naser et al. · 2023 [cited by applicant]
US 20230096533A1 · De Lagrange et al. · 2023 [cited by applicant]
US 20230156196A1 · Park et al. · 2023 [cited by applicant]
US 20240107068A1 · Wang · 2024 [cited by examiner]
US 20240187652A1 · Naser · 2024 [cited by examiner]
WO 2020057572A1 · 2020 [cited by applicant]
WO 2021191114A1 · 2021 [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 4),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, JVET-M1001-v7, 16 pages. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 8),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020, JVET-Q2001-vE, 514 pages. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 9),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 18th Meeting: by teleconference, Apr. 15-24, 2020, JVET-R2001-v8, 528 pages. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 9),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 18th Meeting: by teleconference, Apr. 15-24, 2020, JVET-R2001-vA, 528 pages. [cited by applicant]
Chen et al., “AHG9: On picture identification and PH repetition,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020, JVET-Q0177-v1, 15 pages. [cited by applicant]
Extended European Search Report in EP21782626.2, mailed Apr. 13, 2022, 7 pages. [cited by applicant]
Naser et al., “AhG 9: Cleanup of Constraint Flags,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 18th Meeting: by teleconference, Apr. 15-24, 2020, JVET-R0173-r1, 7 pages. [cited by applicant]
Office Action in IN202137049168, mailed Nov. 9, 2022, 5 pages. [cited by applicant]
Office Action in JP2021563119, mailed Dec. 12, 2022, 19 pages. [cited by applicant]
Skupin et al., “AHG12: On CBR subpicture extraction,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020, JVET-Q0404, 11 pages. [cited by applicant]
Office Action received for Australian Patent Application No. 2023203809, mailed on Jul. 24, 2024, 3 pages. [cited by applicant]
Bordes et al., “AHG17: On general constraint information,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, Document: JVET-O0417-v1, 3 pag… [cited by applicant]
Naser et al., “AhG9: Cleanup of Constraint Flags,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 18th Meeting: by teleconference, Apr. 15-24, 2020, Document: JVET-R0173-r2, 7 pages. [cited by applicant]
Office Action in CN20218003503.2, mailed Jan. 11, 2024, 10 pages. [cited by applicant]