IP Library Granted Patent US 8,526,756
Granted Patent B2
US 8,526,756 · App. 13/258,759 · Granted Sep 3, 2013

Method and system arranged for filtering an image

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,526,756
App. No.
13/258,759
Granted
Sep 3, 2013
Kind
B2
Abstract

A method and a system, the system includes: a memory unit, an image region definer, a spectral analyzer, a determination module, and an image processor. The spectral analyzer is arranged to divide a frequency spectrum of each image region into at least three image region frequency range components (IRFRCs); and calculate an energy level for each IRFRC. The comparator configured to compare the energy level of each IRFRC to at least one frequency region threshold to provide a comparison result for each IRFRC; wherein each frequency region threshold is calculated based on an intensity parameter of an image section and based on an energy parameter of at least one reference image section; a determination module arranged to determine a processing operation for each IRFRC, based on a comparison result associated with the IRFRC and based on a configurable decision rule.

Claims (70)

1. A computer implemented method for filtering image data, the method comprising:

receiving image data at the computer, wherein the image comprises a plurality of pixels;

defining, for each image pixel out of multiple image pixels of the plurality of pixels, an image region;

dividing a frequency spectrum of each image region into at least three image region frequency range components;

calculating an energy level for each of the image region frequency range components;

comparing the energy level of each image region frequency range component to at least one frequency region threshold to provide a comparison result for each image region frequency range component, wherein each frequency region threshold is calculated based on an intensity parameter of an image section and based on an energy parameter of at least one reference image section;

determining, a processing operation for each image region frequency range component, based on the comparison result associated with the image region frequency range component and based on a configurable decision rule, wherein the processing operation is selected from a filtering operation and a bypass operation;

processing each image region frequency range component according to said determining to provide processed image data; and

displaying a processed image based on the processed image data.

2. The method according to claim 1 comprising:

performing vertical processing of image data to provide vertical processed image data; and

performing horizontal processing of the vertical processed image data to provide horizontal processed image data;

wherein the performing of vertical processing comprises:

dividing a vertical frequency spectrum of each image region into at least three image region vertical frequency range components;

calculating an energy level for each of the vertical image region frequency range component;

comparing the energy level of each vertical image region frequency range component to at least one vertical frequency region threshold to provide a comparison result for each image region vertical frequency range component;

determining, a processing operation for each image region vertical frequency range component; and

processing each image region vertical frequency range component according to the determination.

3. The method according to claim 1 comprising calculating a frequency region threshold associated with an image region, wherein the image section is the image region and the at least one reference image section comprises image regions of previous images that are located at a same location as the image region.

4. The method according to claim 1 comprising calculating a frequency region threshold associated with a image region, wherein the image section is an entire image and the at least one reference image section comprises the image region and image regions of previous images that are located at a same location as the image region.

5. The method according to claim 1 comprising calculating a frequency region threshold associated with a image region, wherein the image comprises a video portion and a graphic portion and the image section is defined so as not to include the graphic portion.

6. The method according to claim 1 comprising dividing a frequency spectrum of each image region into at least five image region frequency range components.

7. The method according to claim 1 comprising dividing a vertical frequency spectrum of each image region into at least five image region vertical frequency range components.

8. The method according to claim 1 wherein the image data represents a Luma component of the image.

9. The method according to claim 1 comprising:

calculating the intensity parameter of the image section as an average gray level of pixels of the image section; and

calculating the energy parameter of at least one reference image section as an average value of reference image section first derivative values.

10. The method according to claim 1 comprising:

calculating, in parallel, energy levels for different image region frequency range components; and

comparing, in parallel, energy levels of different image region frequency components to different frequency region thresholds to provide comparison results.

11. The method according to claim 1 comprising:

defining, for an image region frequency range component multiple frequency region threshold sets; and

selecting a set of frequency region thresholds based on an intensity parameter of an image section associated with the image region.

12. The method according to claim 1 comprising:

calculating, for an image region frequency range component multiple frequency region thresholds that are proportional to an energy parameter of at least one reference image section associated with the image region.

13. The method according to claim 1 , wherein

the determining comprises determining whether to apply deflicker filtering to an image region high frequency range component; and

the processing comprises performing deflicker filtering to the image region high frequency range component.

14. A system arranged to filter an image, the system comprising:

a memory unit arranged to receive image data wherein the image comprises a plurality of pixels;

a image region definer arranged to define, for each image pixel out of multiple image pixels, an image region;

a spectral analyzer arranged to

divide a frequency spectrum of each image region into at least three image region frequency range components, and

calculate an energy level for each of the image region frequency range component;

a comparator configured to compare the energy level of each image region frequency range component to at least one frequency region threshold to provide a comparison result for each image region frequency range component, wherein each frequency region threshold is calculated based on an intensity parameter of an image section and based on an energy parameter of at least one reference image section;

a determination module arranged to determine a processing operation for each image region frequency range component, said determining based on a comparison result associated with the image region frequency range component and based on a configurable decision rule, wherein the processing operation is selected from a filtering operation and a bypass operation; and

an image processor arranged to process each image region frequency range component according to the determination to provide processed image data and send display instructions, based on the processed image data, that cause the display to display the processed image data.

15. The system according to claim 14 wherein the spectral analyzer comprises:

a vertical spectral analyzer and a horizontal spectral analyzer;

wherein the determination module comprises a vertical determination module and a horizontal determination module; and

wherein the comparator comprises a vertical comparator and a horizontal comparator.

16. The system according to claim 14 further comprising:

a frequency region threshold calculator arranged to calculate at least one frequency region threshold for each image region frequency component, wherein

the image section is the image region, and

the at least one reference image section comprises image regions of previous images that are located at a same location as the image region.

17. The system according to claim 14 further comprising:

a frequency region threshold calculator arranged to calculate at least one frequency region threshold for each image region frequency component, wherein

the image section is an entire image, and

the at least one reference image section comprises the image region and image regions of previous images that are located at a same location as the image region.

18. The system according to claim 14 further comprising:

a frequency region threshold calculator arranged to

calculate the intensity parameter of the image section as an average gray level of pixels of the image section, and

calculate the energy parameter of at least one reference image section as an average value of reference image section first derivative values.

19. The system according to claim 14 , wherein

the spectral analyzer is arranged to calculate, in parallel, energy levels for different image region frequency range components, and

the comparator is arranged to compare, in parallel, energy levels of different image region frequency components to different frequency region thresholds to provide comparison results.

20. The system according to claim 14 further comprising:

a frequency region threshold calculator arranged to

define, for an image region frequency range component multiple frequency region threshold sets, and

select a set of frequency region thresholds based on an intensity parameter of an image section associated with the image region.

Assignments (31)
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040925 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Feb 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V. F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 052917/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040928 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Jan 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 052915/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 037486 FRAME 0517. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS. Recorded Dec 10, 2019
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 053547/0421 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042762 FRAME 0145. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051145/0184 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051030/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042985 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0387 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 050745/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 050744/0097 →
CORRECTIVE ASSIGNMENT TO CORRECT THE TO CORRECT THE APPLICATION NO. FROM 13,883,290 TO 13,833,290 PREVIOUSLY RECORDED ON REEL 041703 FRAME 0536. ASSIGNOR(S) HEREBY CONFIRMS THE THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS.. Recorded Feb 20, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SHENZHEN XINGUODU TECHNOLOGY CO., LTD.
Reel/Frame 048734/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042985/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042762/0145 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE PATENTS 8108266 AND 8062324 AND REPLACE THEM WITH 6108266 AND 8060324 PREVIOUSLY RECORDED ON REEL 037518 FRAME 0292. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS. Recorded Feb 1, 2017
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 041703/0536 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NATURE OF CONVEYANCE PREVIOUSLY RECORDED AT REEL: 040652 FRAME: 0241. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER AND CHANGE OF NAME. Recorded Jan 5, 2017
From: FREESCALE SEMICONDUCTOR, INC.
To: NXP USA, INC.
Reel/Frame 041260/0850 →
MERGER Recorded Nov 8, 2016
From: FREESCALE SEMICONDUCTOR, INC.
To: NXP USA, INC.
Reel/Frame 040652/0241 →
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 040928/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 21, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V., F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 040925/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12092129 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Jul 14, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 039361/0212 →
SUPPLEMENT TO THE SECURITY AGREEMENT Recorded Jun 16, 2016
From: FREESCALE SEMICONDUCTOR, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 039138/0001 →
SECURITY AGREEMENT SUPPLEMENT Recorded Mar 7, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 038017/0058 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 13, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037518/0292 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 12, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037486/0517 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037357/0334 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037357/0285 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037357/0387 →
SECURITY AGREEMENT Recorded Nov 6, 2013
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 031591/0266 →
SECURITY AGREEMENT Recorded Jun 18, 2013
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 030633/0424 →
SECURITY AGREEMENT Recorded Jan 31, 2012
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 027622/0477 →
SECURITY AGREEMENT Recorded Jan 31, 2012
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 027622/0075 →
SECURITY AGREEMENT Recorded Jan 31, 2012
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 027621/0928 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2011
From: ZARUBINSKY, MICHAEL; BEER-GINGOLD, SHLOMO; KOSASHVILI, MICHELLE
To: FREESCALE SEMICONDUCTOR INC
Reel/Frame 026949/0335 →