IP Library Granted Patent US 12,323,600
Granted Patent B2
US 12,323,600 · App. 17/198,194 · Granted Jun 3, 2025

Resource constrained video encoding

Inventors: Jizheng Xu (Los Angeles, CA); Weijia Zhu (Los Angeles, CA); Li Zhang (Los Angeles, CA)
Assignee: LEMON INC.
H04N19/156H04L65/70H04N19/513
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,323,600
App. No.
17/198,194
Granted
Jun 3, 2025
Kind
B2
Abstract

Example implementations include a method for video processing, comprising performing a conversion between a current video unit of a video and a bitstream of the video according to a rule, wherein the rule specifies performing the conversion based on a predefined bitstream.

Claims (58)

1. A method for video processing, comprising:

performing a conversion between a current video unit of a video and a bitstream of the video based on a constrained resource according to a rule;

wherein the rule specifies a combination of the following:

a same prediction mode for a plurality of samples within the current video unit,

a same merge candidate index for the plurality of samples within the current video unit, wherein the same merge candidate index comprises 0 or 1,

and

a temporal motion vector prediction for the plurality of samples within the current video unit being disabled, and

wherein the constrained resource comprises at least one of the following:

a bitrate being below a first predefined threshold,

an available memory resource being below a second predefined threshold, and

an encoding time length being below a third predefined threshold.

2. The method of claim 1 , wherein the plurality of samples include all samples in the current video unit, or all inter-coded samples in the current video unit.

3. The method of claim 1 , wherein the prediction mode includes at least one of an inter prediction mode, a skip mode, or a merge mode.

4. The method of claim 1 , wherein the rule further specifies: restricting a plurality of coding units within the current video unit to a same size.

5. The method of claim 1 , wherein the rule further specifies: disabling a filtering method for the plurality of samples within the current video unit.

6. The method of claim 5 , wherein the filtering method includes at least one of the following: a deblocking filter, a sample adaptive offset (SAO), an adaptive loop filter (ALF), a cross-component adaptive loop filter (CC-ALF), a luma mapping with chroma scaling (LMCS).

7. The method of claim 1 , wherein in response to the current video unit being an inter video unit, the rule further specifies: using a zero motion vector for a plurality of regions of the current video unit.

8. The method of claim 7 , wherein all motion vectors in the current video unit point to one or more same reference pictures, and/or all coding units in the current video unit satisfy at least one of having no residue, having a deblocking disabled, having a sample adaptive offset disabled, having an adaptive loop filter disabled, having a cross-component adaptive loop filter disabled, having reference picture resampling disabled.

9. The method of claim 1 , wherein in response to the current video unit being an inter video unit, the rule further specifies: copying a collocated picture or a nearest picture for the current video unit.

10. The method of claim 1 , wherein the conversion includes encoding the current video unit into the bitstream.

11. The method of claim 1 , wherein the conversion includes decoding the current video unit from the bitstream.

12. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

perform a conversion between a current video unit of a video and a bitstream of the video based on a constrained resource according to a rule;

wherein the rule specifies a combination of the following:

a same prediction mode for a plurality of samples within the current video unit,

a same merge candidate index for the plurality of samples within the current video unit, wherein the same merge candidate index comprises 0 or 1,

and

a temporal motion vector prediction for the plurality of samples within the current video unit being disabled, and

wherein the constrained resource comprises at least one of the following:

a bitrate being below a first predefined threshold,

an available memory resource being below a second predefined threshold, and

an encoding time length being below a third predefined threshold.

13. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

perform a conversion between a current video unit of a video and a bitstream of the video based on a constrained resource according to a rule;

wherein the rule specifies a combination of the following:

a same prediction mode for a plurality of samples within the current video unit,

a same merge candidate index for the plurality of samples within the current video unit, wherein the same merge candidate index comprises 0 or 1,

and

a temporal motion vector prediction for the plurality of samples within the current video unit being disabled, and

wherein the constrained resource comprises at least one of the following:

a bitrate being below a first predefined threshold,

an available memory resource being below a second predefined threshold, and

an encoding time length being below a third predefined threshold.

14. A non-transitory computer-readable recording medium storing computer executable program, when executed by a video processing apparatus, cause the video processing apparatus to perform a method comprising:

generating a bitstream of the video based on a current video unit of the video based on a constrained resource according to a rule by performing a conversion;

wherein the rule specifies a combination of the following:

a same prediction mode for a plurality of samples within the current video unit,

a same merge candidate index for the plurality of samples within the current video unit, wherein the same merge candidate index comprises 0 or 1,

and

a temporal motion vector prediction for the plurality of samples within the current video unit being disabled, and

wherein the constrained resource comprises at least one of the following:

a bitrate being below a first predefined threshold,

an available memory resource being below a second predefined threshold, and

an encoding time length being below a third predefined threshold.

15. The method of claim 10 , further comprising:

generating a predefined stream in response to the constrained resource based on at least one of the following: a fixed quantization parameter (QP), a resolution value, or a picture.

16. The method of claim 15 , wherein the fixed quantization parameter equals to K, and wherein K is an integer.

17. The method of claim 15 , wherein the predefined stream is used for a session which is defined as: one or more continuous tiles, one or more continuous slices, or one or more continuous pictures.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2021
From: BYTEDANCE INC.
To: LEMON INC.
Reel/Frame 057603/0324 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2021
From: XU, JIZHENG; ZHANG, LI; ZHU, WEIJIA
To: BYTEDANCE INC.
Reel/Frame 057572/0528 →
Continuity (1)
Related Publication 20220295075A1 · Sep 15, 2022
References Cited (12)
US 20080165861A1 · Wen · 2008 [cited by examiner]
US 20130336407A1 · Chen · 2013 [cited by examiner]
US 20140307789A1 · Kim · 2014 [cited by examiner]
US 20170099498A1 · Sharman · 2017 [cited by examiner]
US 20170272755A1 · Holcomb · 2017 [cited by examiner]
US 20170289566A1 · He · 2017 [cited by examiner]
US 20180242015A1 · Katsavounidis · 2018 [cited by examiner]
US 20190052877A1 · Zhang · 2019 [cited by examiner]
US 20190273921A1 · Abe · 2019 [cited by examiner]
US 20220094961A1 · Bae · 2022 [cited by examiner]
US 20220109835A1 · Lee · 2022 [cited by examiner]
US 20220124322A1 · Lee · 2022 [cited by examiner]