IP Library Granted Patent US 12,075,079
Granted Patent B1
US 12,075,079 · App. 18/187,356 · Granted Aug 27, 2024

Method and apparatus for encoding or decoding video

Inventors: Jie Chen (Beijing, CN); Ru-Ling Liao (Beijing, CN); Yan Ye (San Mateo, CA); Jiancong Luo (San Mateo, CA)
Assignee: Alibaba Group Holding Limited
H04N19/463H04N19/109H04N19/137H04N19/159H04N19/172H04N19/51
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,075,079
App. No.
18/187,356
Granted
Aug 27, 2024
Kind
B1
Abstract

The present disclosure provides a computer-implemented method for encoding video. The method includes coding one or more first flags in a sequence parameter set (SPS) of a bitstream, and coding at least one second flag in the SPS if one or more coding modes are enabled for a video sequence associated with the SPS. The one or more first flags indicate whether the one or more coding modes are enabled for the video sequence. The at least one second flag indicates whether a multi-level control is activated for the one or more coding modes.

Claims (54)

1. A method of decoding a bitstream to output one or more pictures for a video stream, the method comprising:

receiving a bitstream; and

decoding, using coded information of the bitstream, one or more pictures,

wherein the decoding comprises:

determining whether a first plurality of sequence level flags are present in the bitstream, based on a second plurality of sequence level flags, respectively;

determining whether a plurality of picture level flags are present in the bitstream, based on the first plurality of sequence level flags, respectively; and

in response to one or more of the plurality of picture level flags being present in the bitstream, enabling or disabling one or more coding modes for a target picture based on the one or more of the plurality of picture level flags, respectively.

2. The method of claim 1 , wherein the one or more coding modes comprise at least one of:

a prediction refinement with optical flow (PROF) mode, a bi-directional optical flow (BDOF) mode, or a decoder side motion vector refinement (DMVR) mode.

3. The method of claim 1 , wherein the first plurality of sequence level flags is present in a Sequence Parameter Set (SPS) of the bitstream.

4. The method of claim 1 , wherein:

the one or more of the plurality of picture level flags are present in a picture header; and the target picture refers to the picture header.

5. The method of claim 1 , further comprising:

determining whether a plurality of coding modes are enabled for a video sequence associated with the bitstream, based on the second plurality of sequence level flags, respectively.

6. The method of claim 5 , wherein the plurality of coding modes comprises at least one of:

a prediction refinement with optical flow (PROF) mode, a bi-directional optical flow (BDOF) mode, or a decoder side motion vector refinement (DMVR) mode.

7. The method of claim 5 , wherein the second plurality of sequence level flags comprises a first sequence level flag associated with a prediction refinement with optical flow (PROF) mode, and the method further comprises:

determining, based on a second sequence level flag, whether an affine mode is enabled for the video sequence; and

in response to the affine mode being enabled, determining that the first sequence level flag is signaled in the bitstream and determining, based on the first sequence level flag, whether the PROF mode is enabled for the video sequence.

8. A method of encoding a video sequence into a bitstream, the method comprising:

receiving a video sequence;

encoding one or more pictures of the video sequence; and

generating a bitstream,

wherein the encoding comprises:

encoding a second plurality of sequence level flags in the bitstream, the second plurality of sequence level flags respectively indicating whether a first plurality of sequence level flags are present in the bitstream;

in response to one or more of the first plurality of sequence level flags are present in the bitstream, encoding the first plurality of sequence level flags in the bitstream, the first plurality of sequence level flags respectively indicating whether a plurality of picture level flags are present in the bitstream; and

in response to one or more of the plurality of picture level flags being present in the bitstream, encoding the one or more of the plurality of picture level flags based on one or more coding modes associated with a target picture, respectively.

9. The method of claim 8 , wherein the one or more coding modes comprise at least one of:

a prediction refinement with optical flow (PROF) mode, a bi-directional optical flow (BDOF) mode, or a decoder side motion vector refinement (DMVR) mode.

10. The method of claim 8 , wherein the first plurality of sequence level flags is encoded in a Sequence Parameter Set (SPS) of the bitstream.

11. The method of claim 8 , wherein:

the one or more of the plurality of picture level flags are encoded in a picture header that the target picture refers to.

12. The method of claim 8 , wherein encoding the one or more of the plurality of picture level flags comprises:

setting values of the one or more of the plurality of picture level flags based on whether the respective coding modes are enabled or disabled for the target picture.

13. The method of claim 8 , wherein the second plurality of sequence level flags respectively indicate whether a plurality of coding modes are enabled for a video sequence associated with the bitstream.

14. The method of claim 13 , wherein the plurality of coding modes comprises at least one of:

a prediction refinement with optical flow (PROF) mode, a bi-directional optical flow (BDOF) mode, or a decoder side motion vector refinement (DMVR) mode.

15. The method of claim 13 , wherein the second plurality of sequence level flags comprises a first sequence level flag indicating whether a prediction refinement with optical flow (PROF) mode is enabled for the video sequence, and the method further comprises:

encoding a second sequence level flag indicating whether an affine mode is enabled for the video sequence; and

in response to the affine mode being enabled for the video sequence, encoding the first sequence level flag, or

in response to the affine mode being disabled for the video sequence, skipping the encoding of the first sequence level flag.

16. A non-transitory computer-readable storage medium storing a bitstream of a video, the non-transitory computer-readable storage medium being part of a computing device configured to execute a set of instructions to cause the computing device to decode the bitstream according to operations comprising:

determining whether a first plurality of sequence level flags are present in the bitstream, based on a second plurality of sequence level flags, respectively;

determining whether a plurality of picture level flags are present in the bitstream, based on the first plurality of sequence level flags, respectively; and

in response to one or more of the plurality of picture level flags being present in the bitstream, enabling or disabling one or more coding modes for a target picture based on the one or more of the plurality of picture level flags, respectively.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the one or more coding modes comprises at least one of:

a prediction refinement with optical flow (PROF) mode, a bi-directional optical flow (BDOF) mode, or a decoder side motion vector refinement (DMVR) mode.

18. The non-transitory computer-readable storage medium of claim 16 , wherein:

the one or more of the plurality of picture level flags are present in a picture header; and the target picture refers to the picture header.

19. The non-transitory computer-readable storage medium of claim 16 , wherein the operations further comprise:

determining whether a plurality of coding modes are enabled for a video sequence associated with the bitstream, based on the second plurality of sequence level flags, respectively.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the second plurality of sequence level flags comprises a first sequence level flag associated with a prediction refinement with optical flow (PROF) mode, and the operations further comprise:

determining, based on a second sequence level flag, whether an affine mode is enabled for the video sequence; and

in response to the affine mode being enabled, determining that the first sequence level flag is signaled in the bitstream and determining, based on the first sequence level flag, whether the PROF mode is enabled for the video sequence.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2026
From: ALIBABA INNOVATION PRIVATE LIMITED
To: HFI INNOVATION INC.
Reel/Frame 075499/0876 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2026
From: ALIBABA GROUP HOLDING LIMITED
To: ALIBABA INNOVATION PRIVATE LIMITED
Reel/Frame 074832/0914 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2023
From: CHEN, JIE; LIAO, RU-LING; YE, YAN; LUO, JIANCONG
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 063049/0132 →
Continuity (3)
Continuation 16998221 · Aug 20, 2020
Provisional Application 62902921 · Sep 19, 2019
Provisional Application 62899169 · Sep 12, 2019