IP Library Granted Patent US 9,883,202
Granted Patent B2
US 9,883,202 · App. 11/539,522 · Granted Jan 30, 2018

Scaling video processing complexity based on power savings factor

Inventors: Zhongli He (Austin, TX); Yong Yan (Austin, TX)
Assignee: NXP USA, INC.
H04N19/577H04N19/11H04N19/117H04N19/119H04N19/132H04N19/154H04N19/156H04N19/176H04N19/523H04N19/61
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,883,202
App. No.
11/539,522
Granted
Jan 30, 2018
Kind
B2
Abstract

A method of scaling complexity of a video processing system including determining a power saving factor based on an operating parameter and adjusting processing of video information based on the power saving factor to reduce computation complexity. The operating parameter may include available power and/or available processing capacity. A method of complexity scalability for a video processing system using prioritized layered coding including determining a power saving factor based on one or more metrics, such as power capacity and/or available processing capacity, and reducing processing complexity of multiple prioritized coding functions in a predetermined order of priority based on the level of the power saving factor. A video processing system including a power management circuit which determines the power saving factor and a video encoder system which correspondingly adjusts computation complexity.

Claims (30)

1. A method of scaling complexity of a video processing system, comprising:

determining a frame size, a frame rate and a frame type suitable for a given power level;

determining a power saving factor based on at least one operating parameter of the video processing system, the at least one operating parameter including available power, wherein the power saving factor is at a first level corresponding to said given power level and is adjusted in response to decreases of available power; and

adjusting processing of video information by the video processing system when the power saving factor indicates less available power than the given power level to reduce computation complexity while maintaining the frame size, the frame rate and the frame type equal to that determined for the given power level, wherein said adjusting processing of video information comprises:

performing prediction error adjustment to adjust an amount of sub-pixel interpolation when the power saving factor is at least a second level which indicates less available power than when at the first level; and

performing fast mode decision to reduce processing performed for selecting between an intracoding mode and an intercoding mode for each video block of a frame when the power saving factor is at least a third level which indicates less available power than when at the second level.

2. The method of claim 1 , wherein said determining a power saving factor based on at least one operating parameter of the video processing system comprises determining the power saving factor based on available power and available processing capacity.

3. The method of claim 1 , wherein said adjusting processing of video information based on the power saving factor comprises successively reducing processing complexity of a plurality of prioritized coding methods from a lowest priority to a highest priority in response to changes of the power saving factor indicating successively decreasing level of available power.

4. The method of claim 3 , further comprising prioritizing the coding methods based on coding efficiency and computation cost.

5. The method of claim 1 , wherein said performing prediction error adjustment comprises reducing an amount of sub-pixel interpolation in response to a change of the power saving factor indicating less available power than the given power level.

6. The method of claim 1 , wherein said adjusting processing of video information comprises forcing the intracoding mode when the power saving factor indicates that available power is less than a predetermined level and when a motion error metric is at least a predetermined threshold.

7. The method of claim 1 , wherein said adjusting processing of video information comprises successively reducing processing of intra prediction for intracoding mode in response to changes of the power saving factor indicating successively decreasing level of available power.

8. The method of claim 1 , wherein said adjusting processing of video information comprises successively reducing motion search processing in response to changes of the power saving factor indicating successively decreasing available power.

9. The method of claim 8 , wherein said successively reducing motion search comprises sequentially reducing a motion search window in response to changes of the power saving factor indicating sequentially decreasing levels of available power.

10. The method of claim 1 , wherein said adjusting processing of video information further comprises:

reducing motion search processing when the power saving factor is at least a fourth level which indicates less available power than when at the third level.

11. The method of claim 10 , further comprising reducing intra prediction processing when the power saving factor is at least the third level.

12. The method of claim 11 , wherein said reducing intra prediction processing comprises successively reducing intra prediction processing with successive changes of the power saving factor indicating less available power than when at the third level.

13. The method of claim 10 , wherein said reducing motion search processing comprises successively reducing motion processing with successive increases of the power saving factor indicating less available power than when at the fourth level.

14. The method of claim 10 , further comprising forcing intracoding mode when the power saving factor is at least a fifth level indicating less available power than when at the fourth level and when a motion error metric is at least a predetermined threshold.

15. The method of claim 10 , further comprising disabling deblock filtering when the power saving factor is at least a fifth level which indicates less available power than when at the fourth level.

16. A method of scaling complexity of a video processing system, comprising:

determining a frame size, a frame rate and a frame type for a power saving factor that indicates a given power level;

determining a level of the power saving factor based on at least one operating parameter of the video processing system, the at least one operating parameter including available power, wherein the power saving factor is at a first level corresponding to said given power level and increases with decreasing available power level; and

adjusting processing complexity of at least one coding method by the video processing system for a given video sequence in response to increases of the power saving factor while maintaining frame size, frame rate and frame type equal to that determined for the given power level, wherein said adjusting processing complexity comprises:

performing prediction error adjustment to adjust an amount of sub-pixel interpolation when the power saving factor is at least a second level which is greater than the first level; and

performing fast mode decision to reduce processing performed for selecting between an intracoding mode and an intercoding mode for each video block of a frame when the power saving factor is at least a third level which is greater than the second level.

17. The method of claim 16 , wherein said adjusting processing complexity further comprises limiting processing of intra prediction for an intracoding mode when the power saving factor is at least the third level.

18. The method of claim 16 , wherein said adjusting processing complexity further comprises adjusting motion search processing when the power saving factor is at least a fourth level which is greater than the third level.

19. The method of claim 16 , wherein said adjusting processing complexity further comprises forcing intracoding mode for at least one video block when the power saving factor is at least a fourth level which is greater than the third level.

Assignments (31)
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040925 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Feb 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V. F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 052917/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040928 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Jan 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 052915/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 037486 FRAME 0517. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS. Recorded Dec 10, 2019
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 053547/0421 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042985 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042762 FRAME 0145. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051145/0184 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051030/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0387 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 050745/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 050744/0097 →
CORRECTIVE ASSIGNMENT TO CORRECT THE TO CORRECT THE APPLICATION NO. FROM 13,883,290 TO 13,833,290 PREVIOUSLY RECORDED ON REEL 041703 FRAME 0536. ASSIGNOR(S) HEREBY CONFIRMS THE THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS.. Recorded Feb 20, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SHENZHEN XINGUODU TECHNOLOGY CO., LTD.
Reel/Frame 048734/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042762/0145 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042985/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE PATENTS 8108266 AND 8062324 AND REPLACE THEM WITH 6108266 AND 8060324 PREVIOUSLY RECORDED ON REEL 037518 FRAME 0292. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS. Recorded Feb 1, 2017
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 041703/0536 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NATURE OF CONVEYANCE PREVIOUSLY RECORDED AT REEL: 040626 FRAME: 0683. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER AND CHANGE OF NAME EFFECTIVE NOVEMBER 7, 2016. Recorded Jan 12, 2017
From: NXP SEMICONDUCTORS USA, INC. (MERGED INTO); FREESCALE SEMICONDUCTOR, INC. (UNDER)
To: NXP USA, INC.
Reel/Frame 041414/0883 →
CHANGE OF NAME Recorded Nov 16, 2016
From: FREESCALE SEMICONDUCTOR INC.
To: NXP USA, INC.
Reel/Frame 040626/0683 →
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 040928/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 21, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V., F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 040925/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12092129 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Jul 14, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 039361/0212 →
SUPPLEMENT TO THE SECURITY AGREEMENT Recorded Jun 16, 2016
From: FREESCALE SEMICONDUCTOR, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 039138/0001 →
SECURITY AGREEMENT SUPPLEMENT Recorded Mar 7, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 038017/0058 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 13, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037518/0292 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 12, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037486/0517 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037354/0225 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037356/0143 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037356/0553 →
SECURITY AGREEMENT Recorded Nov 6, 2013
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 031591/0266 →
SECURITY AGREEMENT Recorded Jun 18, 2013
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 030633/0424 →
SECURITY AGREEMENT Recorded May 13, 2010
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 024397/0001 →
SECURITY AGREEMENT Recorded Mar 15, 2010
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A.
Reel/Frame 024085/0001 →
SECURITY AGREEMENT Recorded Feb 2, 2007
From: FREESCALE SEMICONDUCTOR, INC.; FREESCALE ACQUISITION CORPORATION; FREESCALE ACQUISITION HOLDINGS CORP.; FREESCALE HOLDINGS (BERMUDA) III, LTD.
To: CITIBANK, N.A. AS COLLATERAL AGENT
Reel/Frame 018855/0129 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 6, 2006
From: HE, ZHONLI; YAN, YONG
To: FREESCALE SEMICONDUCTOR INC.
Reel/Frame 018361/0951 →
Continuity (1)
Related Publication 20080084491A1 · Apr 10, 2008