IP Library Granted Patent US 10,045,032
Granted Patent B2
US 10,045,032 · App. 13/748,879 · Granted Aug 7, 2018

Efficient region of interest detection

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,045,032
App. No.
13/748,879
Granted
Aug 7, 2018
Kind
B2
Abstract

An apparatus having a circuit. The circuit may be configured to (i) calculate a plurality of complexity values while compressing a current picture in a video signal. Each complexity value generally characterizes how a corresponding one of a plurality of blocks in the current picture was compressed. The circuit may also be configured to (ii) adjust the complexity values below a first threshold to a default value and (iii) generate a region of interest by grouping the blocks having non-default values of the complexity values above a second threshold.

Claims (60)

1. A video encoding apparatus comprising: a processor to:

receive a video signal;

compress a current picture in the video signal;

calculate a plurality of complexity values for all blocks of said current picture, wherein each of said complexity values characterizes how a corresponding one of a plurality of blocks in said current picture was compressed;

identify one or more of the blocks that have complexity values satisfying a discrimination threshold as candidate blocks associated with said current picture, wherein the discrimination threshold is based on at least one of an average of the plurality of complexity values, or a function of a maximum of the complexity values;

identify one or more of the candidate blocks that have complexity values satisfying a decision threshold as included within an initial ROI, wherein the decision threshold is based on an average of the complexity values of only the candidate blocks;

move a boundary of the initial ROI toward blocks with complexity values satisfying an adjustment threshold to define a final ROI, wherein the adjustment threshold is based on a local minimum of complexity values from one or more of the candidate blocks adjacent to a boundary of the initial ROI and excluded from the initial ROI;

superimpose said final ROI on a next picture in said video signal; and

compress said next picture with a higher bit rate inside said final ROI than outside said final ROI.

2. The apparatus according to claim 1 , wherein said processor is further to:

weight the plurality of complexity values toward a center of said current picture, and then identify the one or more blocks as candidate blocks based on the weighted complexity values and the discrimination threshold; or

reduce a dynamic range of the candidate block complexity values by applying a logarithmic function to the candidate block complexity values.

3. The apparatus according to claim 1 , wherein said processor is further to;

determine the discrimination threshold based on at least one of the average of the plurality of complexity values, or the function of a maximum of the complexity values;

determine the decision threshold based on the average of the candidate block complexity values; and

determine the adjustment threshold based on the local minimum of complexity values from the candidate blocks adjacent to the initial ROI boundary.

4. The apparatus according to claim 1 , wherein said processor is further to expand said initial ROI to include QxP adjacent blocks around each of the candidate blocks satisfying the decision threshold, wherein Q and P range from 2 to 4 adjacent blocks.

5. The apparatus according to claim 1 , wherein said processor is further to search in a plurality of directions from the boundary of the initial ROI to find one or more high complexity values within the initial ROI; and

terminate the search of a current row of blocks in response to finding a high complexity block satisfying the adjustment threshold.

6. The apparatus according to claim 5 , wherein said processor is further to move the boundary to the high complexity block satisfying the adjustment threshold to define the final ROI.

7. A method of video encoding, comprising:

receiving a video signal;

compressing a current picture in the video signal;

calculating a plurality of complexity values for all blocks of said current picture, wherein each of said complexity values characterizes how a corresponding one of a plurality of blocks in said current picture was compressed;

identifying one or more of the blocks that have complexity values satisfying a discrimination threshold as candidate blocks associated with said current picture, wherein the discrimination threshold is based on at least one of an average of the plurality of complexity values, or a function of a maximum of the complexity values;

identifying one or more of the candidate blocks that have complexity values satisfying a decision threshold as included within an initial ROI, wherein the decision threshold is based on an average of the complexity values of only the candidate blocks;

moving a boundary of the initial ROI toward blocks with complexity values satisfying an adjustment threshold to define a final ROI, wherein the adjustment threshold is based on a local minimum of complexity values from one or more of the candidate blocks adjacent to a boundary of the initial ROI and excluded from the initial ROI;

superimposing the final ROI on a next picture in said video signal; and

compressing said next picture with a higher bit rate inside said final ROI than outside said final ROI.

8. The method of claim 7 , further comprising:

weighting the plurality of complexity values toward a center of said current picture, and then identify the one or more blocks as candidate blocks based on the weighted complexity values and the discrimination threshold; or

reducing a dynamic range of the candidate block complexity values by applying a logarithmic function to the candidate block complexity values.

9. The method of claim 7 , further comprising:

determining the discrimination threshold based on at least one of the average of the plurality of complexity values, or the function of a maximum of the complexity values;

determining the decision threshold based on the average of the candidate block complexity values; and

determine the adjustment threshold based on the local minimum of complexity values from the candidate blocks adjacent to the initial ROI boundary.

10. The method of claim 7 , further comprising:

expanding said initial ROI to include QxP adjacent blocks around each of the candidate blocks satisfying the decision threshold, wherein Q and P each range from 2 to 4 adjacent blocks.

11. The method of claim 7 , further comprising:

searching in a plurality of directions from the boundary of the initial ROI to find one or more high complexity values within the initial ROI; and

terminating the search of a current row of blocks in response to finding a high complexity block satisfying the adjustment threshold.

12. The method of claim 11 , further comprising:

moving the boundary to the high complexity block satisfying the adjustment threshold to define the final ROI.

13. A non-transitory computer readable media, with instructions stored thereon, which when executed by a processor, cause the processor to perform a method comprising:

receiving a video signal;

compressing a current picture in the video signal;

calculating a plurality of complexity values for all blocks of said current picture, wherein each of said complexity values characterizes how a corresponding one of a plurality of blocks in said current picture was compressed;

identifying one or more of the blocks that have complexity values satisfying a discrimination threshold as candidate blocks associated with said current picture, wherein the discrimination threshold is based on at least one of an average of the plurality of complexity values, or a function of a maximum of the complexity values;

identifying one or more of the candidate blocks that have complexity values satisfying a decision threshold as included within an initial ROI, wherein the decision threshold is based on an average of the complexity values of only the candidate blocks;

moving a boundary of the initial ROI toward blocks with complexity values satisfying an adjustment threshold to define a final ROI, wherein the adjustment threshold is based on a local minimum of complexity values from one or more of the candidate blocks adjacent to a boundary of the initial ROI and excluded from the initial ROI;

superimposing the final ROI on a next picture in said video signal; and

compressing said next picture with a higher bit rate inside said final ROI than outside said final ROI.

14. The apparatus according to claim 1 , wherein:

the adjustment threshold is 200-400% of a minimum complexity value for candidate blocks to the left, right, above, or below the initial ROI boundary; and

the processor is to search in multiple directions, starting at the boundary of the initial ROI and moving toward the center of the initial ROI, for one or more blocks within the initial ROI that have higher complexity values than the adjustment threshold.

15. The apparatus according to claim 1 , wherein the discrimination threshold is a function of a maximum complexity value divided by a number between approximately 3 and 5.

16. The method of claim 7 , wherein:

the adjustment threshold is 200-400% of a minimum complexity value for candidate blocks to the left, right, above, or below the initial ROI boundary; and

moving the boundary further comprises searching in multiple directions, starting at the boundary of the initial ROI and moving toward the center of the initial ROI, for one or more blocks within the initial ROI that have higher complexity values than the adjustment threshold.

17. The method of claim 7 , wherein, wherein the discrimination threshold is a function of the maximum complexity value divided by a number between approximately 3 and 5.

Assignments (5)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENT RIGHTS (RELEASES RF 032856-0031) Recorded Feb 2, 2016
From: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT
To: LSI CORPORATION; AGERE SYSTEMS LLC
Reel/Frame 037684/0039 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AT REEL/FRAME NO. 32856/0031 Recorded May 29, 2015
From: DEUTSCHE BANK AG NEW YORK BRANCH
To: LSI CORPORATION
Reel/Frame 035797/0943 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2015
From: LSI CORPORATION
To: INTEL CORPORATION
Reel/Frame 035090/0477 →
PATENT SECURITY AGREEMENT Recorded May 8, 2014
From: LSI CORPORATION; AGERE SYSTEMS LLC
To: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT
Reel/Frame 032856/0031 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2013
From: DZIK, DARIUSZ
To: LSI CORPORATION
Reel/Frame 029686/0578 →