IP Library Granted Patent US 10,819,997
Granted Patent B2
US 10,819,997 · App. 15/002,372 · Granted Oct 27, 2020

Encoding video data according to target decoding device decoding complexity

Inventors: Shailesh Ramamurthy (Bengaluru, IN); Padmagowri Pichumani (Bangalore, IN); Vinay Kulkarni (Bangalore, IN); Anil Kumar Nellore (Bangalore, IN); Padmassri Chandrashekar (Bangalore, IN)
Assignee: ARRIS Enterprises LLC
H04N19/436H04N19/103H04N19/156H04N19/164H04N19/172H04N19/115H04N19/122H04N19/124H04N19/137H04N19/147H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,819,997
App. No.
15/002,372
Granted
Oct 27, 2020
Kind
B2
Abstract

A method and system is provided for encoding video data according to target decoding device complexity. One embodiment is evidenced by a method of encoding video data for decoding on a target decoding device having parallel processing, comprising: receiving uncoded video data, computing a relationship between each of a plurality of encoding parameters and target decoding device decoding costs, selecting encoding parameters to minimize encoding costs, wherein the encoding costs include the target decoding device decoding costs, and encoding the uncoded video data according to the selected encoding parameters.

Claims (44)

1. A method of encoding video data for decoding on a target decoding device having parallel processing, comprising:

(a) receiving uncoded video data;

(b) computing a relationship between each of a plurality of encoding parameters and target decoding device decoding costs;

(c) selecting HEVC encoding parameters to minimize encoding costs, wherein the encoding costs include the target decoding device decoding costs; and

(d) encoding the uncoded video data according to the selected encoding parameters,

(e) wherein when the target decoding device performs synchronized parallel processing by means of multiple cores, shared cache wavefront-parallel-processing (WPP) is used for encoding as indicated by the selected encoding parameters;

(f) wherein when the target decoding device performs free running parallel processing using multiple cores or shared cache, tiling is used for encoding as indicated by the selected encoding parameters,

(g) wherein free running comprises freely defining a size and shape of the tiles by controlling a number of row and column partitions wherein the selected encoding parameters set the tile size and shape as the wavefront to determine which of the parallel cores are used for processing each of the tiles.

2. The method of claim 1 , wherein the encoding parameters are selected subject to a target decoding cost determined on a unit basis, where the unit is a tile or wavefront.

3. The method of claim 1 , wherein the encoding parameters are selected subject to an upper bound on moving average decoding cost.

4. The method of claim 1 , wherein computing a relationship between each of a plurality of encoding parameters and target decoding device decoding costs comprises:

associating each encoding parameter with a cost factor indicative of target decoding complexity;

computing cost factor values for each encoding parameter;

computing target decoding cost from the cost factor values.

5. The method of claim 1 , wherein the encoded video data comprises a plurality of variants of an adaptive bitstream, and the method further comprises:

generating the plurality of variants, by performing steps (a)-(d) for each variant, wherein each of the variants has a different upper bound on moving average decoding cost;

signaling at least one of the plurality of variants in the encoded video data.

6. The method of claim 1 , wherein the encoded video data comprises a complexity-scalable video stream comprising a plurality of complexity layers, and the method further comprises:

generating the plurality of complexity layers, by performing steps (a)-(d) for each complexity layer;

signaling at least one of the plurality of complexity layers in the encoded video data.

7. The method of claim 1 , wherein the encoded video data comprises a plurality of variants, each variant generated with a different parallelization coding parameter associated with a class of target decoding devices.

8. The method of claim 1 , wherein the encoding parameters include at least one of:

a bit rate first coding parameter;

a prediction block size first coding parameter;

a transform unit size first coding parameter; and

a quantization factor (Q p ) of a transform block first coding parameter.

9. The method of claim 8 , wherein:

the prediction block first coding parameter is selected based on one or more of motion compensation, motion vector prediction and intra prediction processes by the target decoding device;

the transform unit size first coding parameter is selected based on a complexity of one or more of an inverse discrete cosine transform and reconstruction processes at the target decoding device; and

the quantization factor is selected according to a distortion and a number of bits to encode the transform block.

10. The method of claim 8 , wherein the target encoding costs (C T ) include at least one of:

an entropy decoding cost (C ENTROPY ) associated with the bit rate encoding parameter;

a motion vector and compensation complexity cost (C MC, MVP ), associated with the prediction block size;

a reconstruction time cost (C RECON ), associated with the transform unit size; and

an inverse discrete cosine transfer cost (C IDCT ), associated with the quantization factor of the transform block.

11. The method of claim 10 , wherein the encoding costs are represented by J=D+λR+μC t , and wherein:

J is a measure of the encoding costs;

D is a measure of a distortion of the encoded video data;

R is a measure of a number of bits needed to encode a block of the video data;

λ is a measure of a slope of a ratio of R and D;

μ is a decoding complexity weighting factor; and

C T is a total cost to decode the block of the video data.

12. The method of claim 11 , wherein C T =C Entropy +C MC,MVP +C IDCT +C Recon .

13. The method of claim 1 , wherein the plurality of encoding parameters includes enabling or disabling of decoder in-loop filtering of the target decoding device.

Assignments (10)
SECURITY INTEREST Recorded Apr 8, 2026
From: ARRIS ENTERPRISES LLC; RUCKUS IP HOLDINGS LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 075476/0814 →
RELEASE OF SECURITY INTEREST AT REEL/FRAME 049905/0504 Recorded Dec 19, 2024
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: ARRIS ENTERPRISES LLC (F/K/A ARRIS ENTERPRISES, INC.); ARRIS TECHNOLOGY, INC.; ARRIS SOLUTIONS, INC.; COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; RUCKUS WIRELESS, LLC (F/K/A RUCKUS WIRELESS, INC.)
Reel/Frame 071477/0255 →
SECURITY INTEREST Recorded Dec 17, 2024
From: ARRIS ENTERPRISES LLC; COMMSCOPE TECHNOLOGIES LLC; COMMSCOPE INC., OF NORTH CAROLINA; OUTDOOR WIRELESS NETWORKS LLC; RUCKUS IP HOLDINGS LLC
To: APOLLO ADMINISTRATIVE AGENCY LLC
Reel/Frame 069889/0114 →
SECURITY INTEREST Recorded Nov 19, 2021
From: ARRIS SOLUTIONS, INC.; ARRIS ENTERPRISES LLC; COMMSCOPE TECHNOLOGIES LLC; COMMSCOPE, INC. OF NORTH CAROLINA; RUCKUS WIRELESS, INC.
To: WILMINGTON TRUST
Reel/Frame 060752/0001 →
ABL SECURITY AGREEMENT Recorded Jul 3, 2019
From: COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; ARRIS ENTERPRISES LLC; ARRIS TECHNOLOGY, INC.; RUCKUS WIRELESS, INC.; ARRIS SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 049892/0396 →
TERM LOAN SECURITY AGREEMENT Recorded Jul 3, 2019
From: COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; ARRIS ENTERPRISES LLC; ARRIS TECHNOLOGY, INC.; RUCKUS WIRELESS, INC.; ARRIS SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 049905/0504 →
PATENT SECURITY AGREEMENT Recorded Jul 3, 2019
From: ARRIS ENTERPRISES LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 049820/0495 →
CHANGE OF NAME Recorded Jun 25, 2019
From: ARRIS ENTERPRISES, INC.
To: ARRIS ENTERPRISES LLC
Reel/Frame 049586/0470 →
CHANGE OF NAME Recorded Mar 14, 2017
From: ARRIS ENTERPRISES INC
To: ARRIS ENTERPRISES LLC
Reel/Frame 041995/0031 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2016
From: RAMAMURTHY, SHAILESH; PICHUMANI, PADMAGOWRI; KULKARNI, VINAY; NELLORE, ANIL KUMAR; CHANDRASHEKAR, PADMASSRI
To: ARRIS ENTERPRISES, INC.
Reel/Frame 037539/0900 →
Continuity (1)
Related Publication 20170208335A1 · Jul 20, 2017
Cited By (1)
US 12,413,738