IP Library Granted Patent US 10,271,053
Granted Patent B2
US 10,271,053 · App. 15/002,362 · Granted Apr 23, 2019

Multistage panic rate control scheme for encoders

Inventors: Wei Zhou (Milpitas, CA); Swaroop Chanda (Santa Clara, CA); Wayne D. Michelsen (Menlo Park, CA); Jane Perera (Saratoga, CA)
Assignee: ARRIS Enterprises LLC
H04N19/136H04N19/115H04N19/124H04N19/152H04N19/179H04N19/194H04N19/50H04N19/132
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,271,053
App. No.
15/002,362
Granted
Apr 23, 2019
Kind
B2
Abstract

A method of encoding video is provides encoding of panic scenes efficiently. The method includes receiving an input video at an encoder, reviewing lookahead information from a second encoder that processed the input video ahead of the encoder that indicates positions of panic scenes within the input video that caused the second encoder to enter a panic encoding mode during which it skipped the encoding of frames, entering a pre-panic stage with the encoder ahead of said panic scenes, entering a semi-panic stage with the encoder during the panic scenes when it produces a bitstream having a number of bits exceeding a predetermined data size within an encoder buffer, and entering a full panic stage when the semi-panic stage does not bring the number of bits in the bitstream below the predetermined data size.

Claims (38)

1. A method of encoding video, comprising:

receiving an input video;

routing frames of said input video to a lookahead encoder and to a frame buffer;

processing said frames with said lookahead encoder into a lookahead bitstream and temporality storing bits of said lookahead bitstream in a lookahead encoder buffer;

generating lookahead information with said lookahead encoder and storing said lookahead information in a lookahead information queue, wherein said lookahead information indicates whether or not said lookahead encoder encoded portions of said lookahead bitstream using a panic rate control scheme to avoid overflowing said lookahead encoder buffer;

loading said frames into a primary encoder from said frame buffer, such that said primary encoder receives said frames on a delayed basis relative to said lookahead encoder;

reviewing said lookahead information with said primary encoder to determine which portions of said input video caused said lookahead encoder to process portions of said lookahead bitstream using said panic rate control scheme, and in response encoding said portions of said input video with a multistage panic rate control scheme comprising:

a pre-panic stage during which said primary encoder gradually reduces a quantization parameter while encoding said portions of said input video;

a semi-panic stage during which said primary encoder discards at least some transform coefficients while encoding said portions of said input video; and

a full panic stage during which said primary encoder skips the encoding of at least some frames within said portions of said input video,

wherein said primary encoder is configured to adaptively move between said pre-panic stage, said semi-panic stage, and said full panic stage to keep an amount of data stored within said primary encoder buffer below a predetermined threshold,

wherein said pre-panic stage comprises:

loading a frame to said primary encoder from said frame buffer;

reviewing lookahead information with said primary encoder that is related to a future frame at a predetermined number of frames ahead of said frame;

adjusting a complexity level value at said primary encoder when said lookahead information indicates that said future frame was processed by said lookahead encoder using said panic rate control scheme;

calculating a new value for said quantization parameter based on said complexity level; and

encoding said frame using said new value for said quantization parameter. and

wherein said complexity level value is adjusted by alpha blending a current value for said complexity level with a future value for said complexity level described by said lookahead information.

2. The method of claim 1 , wherein when said new value for said quantization parameter is different from an immediately previous value for said quantization parameter by more than a threshold value, the value of said quantization parameter is gradually changed over multiple frames until said new value is reached.

3. The method of claim 1 , wherein said semi-panic stage and said full panic stage together comprise a plurality of granular panic levels, and said primary encoder is configured to adaptively move between said plurality of granular panic levels to keep the amount of data stored within said primary encoder buffer below said predetermined threshold.

4. The method of claim 1 , wherein said semi-panic stage and said full panic stage together comprise:

loading a new sub-GOP comprising a series of frames to said primary encoder from said frame buffer;

reviewing lookahead information with said primary encoder that is related to the frames of said sub-GOP;

lowering said primary encoder to a lower one of said plurality of granular panic levels from a current panic level according to a panic level change control rule set when said lookahead information indicates that the frames of said sub-GOP was processed by said lookahead encoder without using said panic rate control scheme;

increasing said primary encoder to a higher one of said plurality of granular panic levels from said current panic level according to said panic level change control rule set when said lookahead information indicates that the frames of said sub-GOP was processed by said lookahead encoder using said panic rate control scheme and the amount of data stored within said primary encoder buffer is above said predetermined threshold; and

performing one or more panic control actions based on the primary encoder's panic level.

5. The method of claim 4 , wherein said panic level change control rule set comprises:

rules allowing an increase of said panic level by one level for each sub-GOP processed by said lookahead encoder using said panic rate control scheme.

6. The method of claim 4 , wherein said panic level change control rule set comprises:

a first set of rules allowing a decrease of said panic level by one level from at least one high level for each sub-GOP processed by said lookahead encoder without using said panic rate control scheme;

a second set of rules allowing a decrease of said panic level by one level from at least one medium level for each group of two sub-GOPs in a row that were processed by said lookahead encoder without using said panic rate control scheme; and

a third set of rules allowing a decrease of said panic level by one level from at least one low level for each group of three sub-GOPs in a row that were processed by said lookahead encoder without using said panic rate control scheme.

7. The method of claim 4 , wherein said more panic control actions comprise:

discarding all AC transform coefficients of bidirectionally predicted B-frames in said sub-GOP at a first panic level;

discarding all AC transform coefficients of B-frames in said sub-GOP and all except for the first AC transform coefficients of forward predicted P-frames in said sub-GOP at a second panic level;

discarding all AC and DC transform coefficients of B-frames in said sub-GOP and all AC and DC transform coefficients of P-frames in said sub-GOP at a third panic level;

discarding all AC and DC transform coefficients of P-frames in said sub-GOP and skipping the encoding of all B-frames at a fourth panic level; and

skipping the encoding of all B-frames and all P-frames at a fifth panic level.

Assignments (10)
SECURITY INTEREST Recorded Apr 8, 2026
From: ARRIS ENTERPRISES LLC; RUCKUS IP HOLDINGS LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 075476/0814 →
RELEASE OF SECURITY INTEREST AT REEL/FRAME 049905/0504 Recorded Dec 19, 2024
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: ARRIS ENTERPRISES LLC (F/K/A ARRIS ENTERPRISES, INC.); ARRIS TECHNOLOGY, INC.; ARRIS SOLUTIONS, INC.; COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; RUCKUS WIRELESS, LLC (F/K/A RUCKUS WIRELESS, INC.)
Reel/Frame 071477/0255 →
SECURITY INTEREST Recorded Dec 17, 2024
From: ARRIS ENTERPRISES LLC; COMMSCOPE TECHNOLOGIES LLC; COMMSCOPE INC., OF NORTH CAROLINA; OUTDOOR WIRELESS NETWORKS LLC; RUCKUS IP HOLDINGS LLC
To: APOLLO ADMINISTRATIVE AGENCY LLC
Reel/Frame 069889/0114 →
SECURITY INTEREST Recorded Nov 19, 2021
From: ARRIS SOLUTIONS, INC.; ARRIS ENTERPRISES LLC; COMMSCOPE TECHNOLOGIES LLC; COMMSCOPE, INC. OF NORTH CAROLINA; RUCKUS WIRELESS, INC.
To: WILMINGTON TRUST
Reel/Frame 060752/0001 →
ABL SECURITY AGREEMENT Recorded Jul 3, 2019
From: COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; ARRIS ENTERPRISES LLC; ARRIS TECHNOLOGY, INC.; RUCKUS WIRELESS, INC.; ARRIS SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 049892/0396 →
PATENT SECURITY AGREEMENT Recorded Jul 3, 2019
From: ARRIS ENTERPRISES LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 049820/0495 →
TERM LOAN SECURITY AGREEMENT Recorded Jul 3, 2019
From: COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; ARRIS ENTERPRISES LLC; ARRIS TECHNOLOGY, INC.; RUCKUS WIRELESS, INC.; ARRIS SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 049905/0504 →
CHANGE OF NAME Recorded Jun 25, 2019
From: ARRIS ENTERPRISES, INC.
To: ARRIS ENTERPRISES LLC
Reel/Frame 049586/0470 →
CHANGE OF NAME Recorded Mar 14, 2017
From: ARRIS ENTERPRISES INC
To: ARRIS ENTERPRISES LLC
Reel/Frame 041995/0031 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2016
From: ZHOU, WEI; CHANDA, SWAROOP; MICHELSEN, WAYNE D.; PERERA, JANE
To: ARRIS ENTERPRISES, INC.
Reel/Frame 037539/0850 →
Continuity (1)
Related Publication 20170208332A1 · Jul 20, 2017