IP Library › Granted Patent US 7,773,672
Granted Patent B2
US 7,773,672 · App. 11/421,007 · Granted Aug 10, 2010

Scalable rate control system for a video encoder

Assignee: Freescale Semiconductor, Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,773,672
App. No.
11/421,007
Granted
Aug 10, 2010
Kind
B2
Abstract

A rate control system for a video encoder including rate control logic which determines a first QP corresponding to a selected encoding layer of multiple encoding layers, and scaling logic configured to scale the first QP to a second QP corresponding to any other encoding layer based on at least one encoding layer parameter. A template of stored QP values may be used to reduce computational complexity, such as a QP value for each frame interval or a QP value for each of multiple rate control interval complexity values. The QP values in the template may be predetermined or programmed and updated during periodic training sessions. Several encoding layer parameters are contemplated, such as any combination of bit rate, frame rate and frame resolution. The scaling logic may be configured to scale from any one encoding layer to another and vice-versa for bi-directional scaling.

Claims (31)

1. A rate control system for a video encoder, comprising:

a template comprising a plurality of predetermined and pre-stored quantization parameter (QP) values corresponding to a selected one of a plurality of encoding layers, wherein said template stores a plurality of QP values including at least one QP value for each of a set of motion complexity values each indicative of relative motion in which said plurality of motion complexity values range from low motion to high motion;

rate control logic which determines a new motion complexity value for each new rate control interval and which uses said new motion complexity value as an index to retrieves a first QP value from said template; and

scaling logic configured to scale said first QP value corresponding to said selected encoding layer to a second QP value corresponding to any other one of said plurality of encoding layers based on at least one encoding layer parameter.

2. The rate control system of claim 1 , wherein said rate control logic periodically performs a training session for calculating and storing a QP value for each interval of a selected video frame, and wherein said rate control logic retrieves a corresponding stored QP value for each interval of at least one subsequent video frame.

3. The rate control system of claim 1 , wherein said template stores at least one QP value for each of a plurality of rate control interval complexity values.

4. The rate control system of claim 3 , wherein said plurality of rate control interval complexity values comprises a plurality of mean of sum of absolute difference values.

5. The rate control system of claim 3 , wherein said template stores a plurality of QP values for each of said plurality of rate control interval complexity values, wherein each of said plurality of QP values further corresponds to one of a plurality of target bits per pixel parameters.

6. The rate control system of claim 1 , wherein each of said plurality of encoding layers is based on a plurality of encoding layer parameters, including a corresponding bit rate, a corresponding temporal resolution, and a corresponding spatial resolution.

7. The rate control system of claim 6 , wherein said scaling logic is configured to convert said first QP value to said second QP value by converting between a plurality of different bit rates, a plurality of different temporal resolutions, and a plurality of different spatial resolutions.

8. The rate control system of claim 7 , wherein said scaling logic converts said first QP value to said second QP value by adding a QP offset, and wherein said QP offset is determined based on any selected ones of a ratio of first and second bit rates, a ratio of first and second video frame rates, and a ratio of first and second video frame resolutions.

9. The rate control system of claim 1 , wherein said scaling logic is configured to scale from any one of said plurality of encoding layers to any other one of said plurality of encoding layers and vice-versa.

10. A scalable video encoding system, comprising:

a video encoder which encodes video information based on a quantization parameter (QP);

system control logic which provides at least one target encoding layer parameter indicating a corresponding one of a plurality of encoding layers; and

a rate control system which determines said QP corresponding to a selected one of said plurality of encoding layers, comprising:

a template which stores a plurality of predetermined and pre-stored QP values corresponding to said selected one of said plurality of encoding layers, wherein said template stores a plurality of QP values including at least one QP value for each of a set of motion complexity values each indicative of relative motion in which said plurality of motion complexity values range from low motion to high motion;

rate control logic which calculates a new complexity value for each new rate control interval and which uses said new complexity value to retrieve a corresponding QP value from said template; and

scaling logic which is configured to scale said QP value retrieved from said template to correspond to any other one of said plurality of encoding layers based on said at least one target encoding layer parameter.

11. The scalable video encoding system of claim 10 , wherein each of said plurality of encoding layers is based on a selected bit rate, a selected temporal resolution, and a selected spatial resolution of said video information.

12. The scalable video encoding system of claim 11 , wherein said rate control system is configured to scale said QP value based on a plurality of different bit rates, a plurality of different temporal resolutions, and a plurality of different spatial resolutions.

13. The scalable video encoding system of claim 12 , wherein said rate control system is configured to add a QP offset to said QP value, and wherein said QP offset is determined based on any selected ones of a ratio of first and second bit rates, a ratio of first and second video frame rates, and a ratio of first and second video frame resolutions.

14. The scalable video encoding system of claim 10 , wherein said rate control system conducts a training session to program said template with a QP value for each rate control interval of a selected video frame.

15. The scalable video encoding system of claim 10 , wherein each of said plurality of QP values stored in said template corresponds to one of a plurality of frame complexity values.

16. The scalable video encoding system of claim 15 , wherein said video encoder provides a frame complexity value and pixel encoding information after encoding each interval of a video frame, and wherein said rate control system updates said template based on said frame complexity value and said pixel encoding information.

17. A method of scaling a quantization parameter (QP) for video encoding, comprising:

determining a first QP corresponding to a selected one of a plurality of encoding layers comprising retrieving a QP value from a template of predetermined and pre-stored QP values, wherein the template stores a plurality of QP values including at least one QP value for each of a set of motion complexity values each indicative of relative motion in which said plurality of motion complexity values range from low motion to high motion;

receiving a plurality of encoding parameters indicating a second one of the plurality of encoding layers; and

scaling the first QP to a second QP which corresponds with the second one of the plurality of encoding layers.

18. The method of claim 17 , wherein said receiving a plurality of encoding parameters comprises receiving a target bit rate, a target frame rate, and a target frame resolution.

19. The method of claim 17 , wherein said scaling the first QP to a second QP comprises adding a QP offset based on a change of at least one of bit rate, frame rate and frame resolution.

Assignments (29)
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040925 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Feb 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V. F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 052917/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040928 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Jan 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 052915/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 037486 FRAME 0517. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS. Recorded Dec 10, 2019
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 053547/0421 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042985 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0387 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042762 FRAME 0145. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051145/0184 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051030/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 050745/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE TO CORRECT THE APPLICATION NO. FROM 13,883,290 TO 13,833,290 PREVIOUSLY RECORDED ON REEL 041703 FRAME 0536. ASSIGNOR(S) HEREBY CONFIRMS THE THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS.. Recorded Feb 20, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SHENZHEN XINGUODU TECHNOLOGY CO., LTD.
Reel/Frame 048734/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042985/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042762/0145 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE PATENTS 8108266 AND 8062324 AND REPLACE THEM WITH 6108266 AND 8060324 PREVIOUSLY RECORDED ON REEL 037518 FRAME 0292. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS. Recorded Feb 1, 2017
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 041703/0536 →
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 040928/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 21, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V., F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 040925/0001 →
PATENT RELEASE Recorded Aug 17, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 039707/0471 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12092129 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Jul 14, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 039361/0212 →
SECURITY AGREEMENT SUPPLEMENT Recorded Mar 7, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 038017/0058 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2016
From: FREESCALE SEMICONDUCTOR, INC.
To: NORTH STAR INNOVATIONS INC.
Reel/Frame 037694/0264 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 13, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037518/0292 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 12, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037486/0517 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037356/0143 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037354/0225 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037356/0553 →
SECURITY AGREEMENT Recorded Nov 6, 2013
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 031591/0266 →
SECURITY AGREEMENT Recorded Jun 18, 2013
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 030633/0424 →
SECURITY AGREEMENT Recorded May 13, 2010
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 024397/0001 →
SECURITY AGREEMENT Recorded Mar 15, 2010
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A.
Reel/Frame 024085/0001 →
SECURITY AGREEMENT Recorded Feb 2, 2007
From: FREESCALE SEMICONDUCTOR, INC.; FREESCALE ACQUISITION CORPORATION; FREESCALE ACQUISITION HOLDINGS CORP.; FREESCALE HOLDINGS (BERMUDA) III, LTD.
To: CITIBANK, N.A. AS COLLATERAL AGENT
Reel/Frame 018855/0129 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 30, 2006
From: PRIETO, YOLANDA; HE, ZHONGLI
To: FREESCALE SEMICONDUCTOR INC.
Reel/Frame 017703/0426 →
Continuity (1)
Related Publication 20070280349A1 · Dec 6, 2007