IP Library Granted Patent US 8,441,498
Granted Patent B2
US 8,441,498 · App. 12/516,785 · Granted May 14, 2013

Device and method for processing color image data

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,441,498
App. No.
12/516,785
Granted
May 14, 2013
Kind
B2
Abstract

The present invention relates to a video processing device comprising a luminance and saturation detector (LSHD) for detecting the luminance values (lum) and the saturation values (sat) of pixels of an input video signal (IN); and a white-point, saturation and hue modulator (WSH) for transforming luminance and saturation properties (lum, sat) of the pixels of the input video signal (IN) into white-point, saturation and hue correction factors (W, Wc; S, Sc; H, Hc). The video device also comprises a color gamut matrix generating unit (CGMG) for generating a color gamut matrix in the perception domain based on the white-point, saturation and hue correction factors (Wc, Sc, Hc) of the white-point, saturation and hue modulator (WSH); a color gamut mapping unit ( 20 ) for multiplying the pixels of the input video signal (IN) with a color gamut matrix generated by the color gamut matrix generating unit (CGMG); and a clipping unit ( 31 ) for clipping the results of the a color gamut mapping unit ( 20 ) which are out of a predefined range.

Claims (38)

1. A video processing device, comprising:

a luminance and saturation detector adapted to detect the luminance values and the saturation values of pixels of an input video signal, wherein the luminance and saturation detector includes:

a RGB squaring unit adapted to square amplitudes of sub-pixels of the pixels of the input video signal,

a RGB shuffler unit adapted to rank the sub-pixels based on the respective squared amplitude values of the sub-pixels,

a luminance and saturation calculation unit adapted to calculate, for each pixel, the luminance value, an internal saturation and a first saturation correction factor, and

a saturation correction unit adapted to output the saturation value for each pixel, wherein said saturation value for said pixel is a corrected saturation value based on said internal saturation and the first saturation correction factor;

a white-point, saturation and hue modulator adapted to transform the luminance and saturation values of each pixel of the input video signal into a corresponding white-point correction factor, a second saturation correction factor, and a hue correction factor;

a color gamut matrix generating unit adapted to generate a color gamut matrix in the perception domain based on the white-point correction factor, the second saturation correction factor, and the hue correction factor;

a color gamut mapping unit adapted to multiply the pixels of the input video signal with the color gamut matrix; and

a clipping unit adapted to clip the results of the color gamut mapping unit which are out of a predefined range.

2. The video processing device according to claim 1 , wherein the white-point, saturation and hue modulator comprises:

a white point modulator adapted to determine, for each pixel, the white-point correction factor as (1−L d )+(WL m −WL m *L d ), wherein L d is the luminance value corresponding to said pixel and WL m , is an input parameter of the white point modulator;

a saturation modulator adapted to determine, for each pixel, the second saturation correction factor based on the saturation value from the luminance and saturation calculation unit; and

a hue modulator adapted to determine, for each pixel, the hue correction factor based on the saturation value from the luminance and saturation calculation unit.

3. The video processing device according to claim 2 , wherein the color gamut matrix generating unit is adapted to generate the color gamut matrix based upon measured characteristics of a display module.

4. The video processing device according to claim 3 , further comprising a memory adapted to store display module specific parameters.

5. The device of claim 2 , wherein the saturation modulator is adapted to generate, for each pixel, the second saturation correction factor as (1−S d )+(SS m −SS m *S d ), wherein S d is the saturation value corresponding to said pixel and SS m is an input parameter of the saturation modulator.

6. The device of claim 2 , wherein the hue modulator is adapted to generate, for each pixel, the hue correction factor as (1−S d )+(HS m −HS m *Sd), wherein S d is the saturation value corresponding to said pixel and HS m is an input parameter of the hue modulator.

7. The device of claim 1 , wherein the luminance and saturation calculation unit is adapted to calculate, for each pixel, the luminance value as the maximum of the squared amplitudes of the sub-pixels of said pixel.

8. The device of claim 1 , wherein the luminance and saturation calculation unit is adapted to calculate, for each pixel, the first saturation correction factor as (med−min)/(max+min), wherein max is the maximum of the squared amplitudes of the sub-pixels of said pixel, min is the minimum of the squared amplitudes of the sub-pixels of said pixel, and med is the median of the squared amplitudes of the sub-pixels of said pixel.

9. The device of claim 1 , wherein the saturation correction unit is adapted to output the saturation value for each pixel as s i *(1 31 c s /4), wherein s i and c s are the internal saturation and the first saturation correction factor, respectively, corresponding to said pixel.

10. A method of processing color image data, comprising the steps of:

squaring amplitudes of sub-pixels of pixels of an input video signal;

ranking the sub-pixels based on respective squared amplitude values of the sub-pixels;

calculating, for each pixel, a luminance value, an internal saturation, and a first saturation correction factor;

generating a saturation value for each pixel based on the internal saturation and the first saturation correction factor for said pixel;

transforming the luminance and saturation values of the pixels of the input video signal into a white-point correction factor, a second saturation correction factor, and a hue correction factor wherein the white-point correction factor is calculated for each pixel as (1−L d )+(WL m −WL m *L d ), wherein L d is the luminance value corresponding to said pixel and WL m is an input parameter;

generating a color gamut matrix in the perception domain based on the white-point correction factor, the second saturation correction factor, and the hue correction factor;

multiplying the pixels of the input video signal with the color gamut matrix; and

clipping the results of the color gamut mapping unit which are out of a predefined range.

11. The method of claim 10 , wherein transforming the luminance and saturation values of the pixels of the input video signal into the white-point correction factors, the second saturation correction factors, and the hue correction factors includes, for each pixel:

generating the corresponding white-point correction factor as (1−L d )+(WL m −WL m *L d ), wherein L d is the luminance value corresponding to said pixel and WL m is an input parameter; and

generating the corresponding second saturation correction factor and hue correction factor based on the corresponding saturation value.

12. The method of claim 11 , wherein the second saturation correction factor for each pixel is generated as (1−S d )+(SS m −SS m *S d ), wherein S d is the saturation value corresponding to said pixel and SS m is an input parameter.

13. The method of claim 11 , wherein the hue correction factor for each pixel is generated as (1−S d )+(HS m −HS m * Sd), wherein S d is the saturation value corresponding to said pixel and HS m is an input parameter.

14. The method of claim 10 , wherein the luminance value for each pixel is calculated as the maximum of the squared amplitudes of the sub-pixels of said pixel.

15. The method of claim 10 , wherein the first saturation correction factor for each pixel is calculated as (med−min)/(max+min), wherein max is the maximum of the squared amplitudes of the sub-pixels of said pixel, min is the minimum of the squared amplitudes of the sub-pixels of said pixel, and med is the median of the squared amplitudes of the sub-pixels of said pixel.

16. The method of claim 10 , wherein the saturation value for each pixel is generated as s i *(1−c s /4), wherein s i and c s are the internal saturation and the first saturation correction factor, respectively, corresponding to said pixel.

Assignments (20)
RELEASE OF SECURITY INTEREST Recorded Jun 23, 2021
From: MUFG UNION BANK, N.A.
To: MAXLINEAR, INC.; EXAR CORPORATION; MAXLINEAR COMMUNICATIONS LLC
Reel/Frame 056656/0204 →
SUCCESSION OF AGENCY (REEL 042453 / FRAME 0001) Recorded Jul 1, 2020
From: JPMORGAN CHASE BANK, N.A.
To: MUFG UNION BANK, N.A.
Reel/Frame 053115/0842 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042762 FRAME 0145. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051145/0184 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042985 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0387 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051030/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 050745/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2018
From: MAXLINEAR INC.; ENTROPIC COMMUNICATIONS LLC
To: DYNAMIC DATA TECHNOLOGIES LLC
Reel/Frame 047914/0274 →
SECURITY AGREEMENT Recorded May 12, 2017
From: MAXLINEAR, INC.; ENTROPIC COMMUNICATIONS, LLC (F/K/A ENTROPIC COMMUNICATIONS, INC.); EXAR CORPORATION
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042453/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042985/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042762/0145 →
PATENT RELEASE Recorded Aug 17, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 039707/0471 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12092129 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Jul 14, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 039361/0212 →
SECURITY AGREEMENT SUPPLEMENT Recorded Mar 7, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 038017/0058 →
MERGER AND CHANGE OF NAME Recorded May 19, 2015
From: ENTROPIC COMMUNICATIONS, INC.; EXCALIBUR SUBSIDIARY, LLC; ENTROPIC COMMUNICATIONS, LLC
To: ENTROPIC COMMUNICATIONS, LLC
Reel/Frame 035717/0628 →
MERGER AND CHANGE OF NAME Recorded May 18, 2015
From: EXCALIBUR ACQUISITION CORPORATION; ENTROPIC COMMUNICATIONS, INC.; ENTROPIC COMMUNICATIONS, INC.
To: ENTROPIC COMMUNICATIONS, INC.
Reel/Frame 035706/0267 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2012
From: TRIDENT MICROSYSTEMS, INC.; TRIDENT MICROSYSTEMS (FAR EAST) LTD.
To: ENTROPIC COMMUNICATIONS, INC.
Reel/Frame 028146/0178 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2010
From: TRIDENT MICROSYSTEMS (EUROPE) B.V.; NXP HOLDING 1 B.V.
To: TRIDENT MICROSYSTEMS (FAR EAST) LTD.
Reel/Frame 023928/0641 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2010
From: NXP
To: NXP HOLDING 1 B.V.
Reel/Frame 023928/0489 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 28, 2009
From: LAMMERS, MATHEUS J. G.; DE GREEF, PETRUS M.
To: NXP, B.V.
Reel/Frame 022750/0292 →