IP Library Granted Patent US 9,482,797
Granted Patent B2
US 9,482,797 · App. 14/186,936 · Granted Nov 1, 2016

Pixel array, camera using the same and color processing method based on the pixel array

Inventors: Mao Peng (Guangdong, CN); Jingjun Fu (Guangdong, CN); Wenge Hu (Guangdong, CN)
Assignees: BYD Company Limited; Shenzhen BYD Auto R&D Company Limited
G02B5/201H01L27/14621H04N9/045H04N9/07H01L27/14625
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,482,797
App. No.
14/186,936
Granted
Nov 1, 2016
Kind
B2
Abstract

A pixel array is provided. The pixel array comprises a plurality of two-dimensionally arranged 4*4 Bayer matrix units, in which the matrix unit comprises a plurality of pixels, any of a green filter, a red filter and a blue filter is disposed in one pixel, and one or more of the green filters are replaced by white color filters in the matrix units. A camera using the same and a color processing method based on the pixel array are also provided.

Claims (58)

1. A pixel array used for performing color processing, comprising:

a plurality of two-dimensionally arranged 4*4 Bayer matrix units, wherein the matrix unit comprises a plurality of pixels, each pixel including any of a green filter, a red filter and a blue filter, and one or more of the green filters are replaced by white filters in the matrix units, wherein:

a first pixel value with an infrared component of a color in each pixel is obtained, when a light comprising an infrared composition passes through the green filter, the red filter, the blue filter or the white filter;

a second pixel value with an infrared component of a mission color in each pixel is obtained, by interpolating for the first pixel value with the infrared component in each pixel;

an infrared component value of each pixel is obtained, according to the first pixel value and the second pixel value; and

a third pixel value not affected by the infrared component of the colors in each pixel is obtained, according to the first pixel value, the second pixel value and the infrared component value; wherein

when the light comprising the infrared composition passes through the red filter, the first pixel value with the infrared component of a red color is R′=R+a*IR;

when the light comprising the infrared composition passes through the green filter, the first pixel value with the infrared component of a green color is G′=G+b*IR;

when the light comprising the infrared composition passes through the blue filter, the first pixel value with the infrared component of a blue color is B′=B+c*IR; and

when the light comprising the infrared composition passes through the white color filter, the first pixel value with the infrared component of a white color is W′=(R/a+G/b+B/c+IR)*d,

where a is a gain value of the red filter, b is a gain value of the green filter, c is a gain value of the blue filter, d is a gain value of the white filter, and IR is the infrared component value, R is the pixel value of the pixel disposed with the red filter, and R′ is the first pixel value of the red color with the infrared component of the pixel disposed with the red filter; G is the pixel value of the pixel disposed with the green filter, and G′ is the first pixel value of the green color with the infrared component of the pixel disposed with the green filter; B is the pixel value of the pixel disposed with the blue filter, and B′ is the first pixel value of the blue color with the infrared component of the pixel disposed with the blue filter; W is the pixel value of the pixel disposed with the white filter, and W′ is the first pixel value of the white color with the infrared component of the pixel disposed with the white filter.

2. The pixel array of claim 1 , wherein a density of the white filter is the same as a density of the green filter or the red filter or the blue filter in the matrix units.

3. The pixel array of claim 1 , wherein a density of the white filter is less than a density of the red filter or the blue filter in the matrix units.

4. A camera, comprising:

a lens which comprises a plurality of two-dimensionally arranged 4*4 Bayer matrix units used for performing color processing,

wherein the matrix unit comprises a plurality of pixels, each pixel including any of a green filter, a red filter and a blue filter, and one or more of the green filters are replaced by white filters in the matrix units, wherein:

a first pixel value with an infrared component of a color in each pixel is obtained, when a light comprising an infrared composition passes through the green filter, the red filter, the blue filter or the white filter;

a second pixel value with an infrared component of a missing color in each pixel is obtained, by interpolating for the first pixel value with the infrared component in each pixel;

an infrared component value of each pixel is obtained, according to the first pixel value and the second pixel value; and

a third pixel value not affected by the infrared component of the colors in each pixel is obtained, according to the first pixel value, the second pixel value and the infrared component value; wherein

when the light comprising the infrared composition passes through the red filter, the first pixel value with the infrared component of a red color is R′=R+a*IR;

when the light comprising the infrared composition passes through the green filter, the first pixel value with the infrared component of a green color is G′=G+b*IR;

when the light comprising the infrared composition passes through the blue filter, the first pixel value with the infrared component of a blue color is B′=B+c*IR; and

when the light comprising the infrared composition passes through the white color filter, the first pixel value with the infrared component of a white color is W′=(R/a+G/b+B/c+IR)*d,

where a is a gain value of the red filter, b is a gain value of the green filter, c is a gain value of the blue filter, d is a gain value of the white filter, and IR is the infrared component value, R is the pixel value of the pixel disposed with the red filter, and R′ is the first pixel value of the red color with the infrared component of the pixel disposed with the red filter; G is the pixel value of the pixel disposed with the green filter, and G′ is the first pixel value of the green color with the infrared component of the pixel disposed with the green filter; B is the pixel value of the pixel disposed with the blue filter, and B′ is the first pixel value of the blue color with the infrared component of the pixel disposed with the blue filter; W is the pixel value of the pixel disposed with the white filter, and W′ is the first pixel value of the white color with the infrared component of the pixel disposed with the white filter.

5. A color processing method based on a pixel array, the pixel array comprising a plurality of two-dimensionally arranged 4*4 Bayer matrix units, wherein the matrix unit comprises a plurality of pixels, each pixel including any of a green filter, a red filter or a blue filter, and one or more of the green filters are replaced by white filters in the matrix units, the method comprising:

obtaining a first pixel value with an infrared component of a color in each pixel when a light comprising an infrared composition passes through the green filter, the red filter, the blue filter or the white filter;

interpolating for the first pixel value with the infrared component in each pixel to obtain a second pixel value with an infrared component of a missing color in each pixel;

obtaining an infrared component value of each pixel according to the first pixel value and the second pixel value; and

obtaining a third pixel value not affected by the infrared component of the colors in each pixel according to the first pixel value, the second pixel value and the infrared component value; wherein,

when the light comprising the infrared composition passes through the red filter, the first pixel value with the infrared component of a red color is R′=R+a*IR;

when the light comprising the infrared composition passes through the green filter, the first pixel value with the infrared component of a green color is G′=G+b*IR;

when the light comprising the infrared composition passes through the blue filter, the first pixel value with the infrared component of a blue color is B′=B+c*IR; and

when the light comprising the infrared composition passes through the white color filter, the first pixel value with the infrared component of a white color is W′=(R/a+G/b+B/c+IR)*d,

where a is a gain value of the red filter, b is a gain value of the green filter, c is a gain value of the blue filter, d is a gain value of the white filter, and IR is the infrared component value, R is the pixel value of the pixel disposed with the red filter, and R′ is the first pixel value of the red color with the infrared component of the pixel disposed with the red filter; G is the pixel value of the pixel disposed with the green filter, and G′ is the first pixel value of the green color with the infrared component of the pixel disposed with the green filter; B is the pixel value of the pixel disposed with the blue filter, and B′ is the first pixel value of the blue color with the infrared component of the pixel disposed with the blue filter; W is the pixel value of the pixel disposed with the white filter, and W′ is the first pixel value of the white color with the infrared component of the pixel disposed with the white filter.

6. The color processing method of claim 5 , wherein the step of interpolating for the first pixel value with the infrared component of each pixel to obtain a second pixel value with an infrared component of a missing color in each pixel comprises:

when the first pixel value with the infrared component of a red color of the pixel is R′(i,j), a second pixel value with an infrared component of a missing color in the pixel is calculated according to the following formulas:

G ′( i,j )=½*( G ′( i,j− 1)+ G ′( i,j+ 1));

B ′( i,j )=¼*( B ′( i− 1, j− 1)+ B ′( i− 1, j+ 1)+ B ′( i+ 1, j− 1)+ B ′( i+ 1, j+ 1)); and

W ′( i,j )=½*( W ′( i− 1, j )+ W ′( i+ 1, j ));

when the first pixel value with the infrared component of the green color of the pixel is G′(i,j), a second pixel value with an infrared component of a missing color in the pixel is calculated according to the following formulas:

R ′( i,j )=½*( R ′( i,j− 1)+ R ′( i,j+ 1));

B ′( i,j )=½*( B ′( i− 1, j )+ B ′( i+ 1, j )); and

W ′( i,j )=¼*( W ′( i− 1, j− 1)+ W ′( i− 1, j+ 1)+ W ′( i+ 1, j− 1)+ W ′( i+ 1, j+ 1));

when the first pixel value with the infrared component of the blue color of the pixel is B′(i,j), a second pixel value with an infrared component of a missing color in the pixel is calculated according to the following formulas:

R ′( i,j )=¼*( R ′( i− 1, j− 1)+ R ′( i− 1, j+ 1)+ R ′( i+ 1, j− 1)+ R ′( i+ 1, j+ 1));

G ′( i,j )=½*( G ′( i− 1, j )+ G ′( i+ 1, j )); and

W ′( i,j )=½*( W ′( i,j− 1)+ W ( i,j+ 1));

when the first pixel value with the infrared component of the white color of the pixel is W′(i,j), a second pixel value with an infrared component of a missing color in the pixel is calculated according to the following formulas:

R ′( i,j )=½*( R ′( i− 1, j )+ R ′( i+ 1, j ));

G ′( i,j )=¼*( G ′( i− 1, j− 1)+ G ′( i− 1, j+ 1)+ G ′( i+ 1, j− 1)+ G ′( i+ 1, j+ 1)); and

B ′( i,j )=½*( B ′( i,j− 1)+ B ′( i,j+ 1));

where i is a row number of the pixel array, and j is a column number of the pixel array.

7. The color processing method of claim 6 , wherein the step of obtaining an infrared component value of each pixel according to the first pixel value and the second pixel values comprises calculating the infrared component value according to the formula of IR(i,j)=−(1/d*W′(i,j)−1/a*R′(i,j)−1/g*G′(i,j)′−1/c*B′(i,j))/2.

8. The color processing method of claim 7 , wherein the step of obtaining a third pixel value not affected by the infrared component of the colors in each pixel according to the first pixel value, the second pixel values and the infrared component value comprises calculating the third pixel value of the colors according the following formulas:

R ( i,j )=( R ′( i,j )+ a/d*W ′( i,j )− a/b*G ′( i,j )− a/c*B ′( i,j ))/2;

G ( i,j )=( G ′( i,j )+ b/d*W ′( i,j )− b/a*R ′( i,j )− b/c*B ′( i,j )/2; and

B ( i,j )=( B ′( i,j )+ c/d*W ′( i,j )− c/a*R ′( i,j )− c/b*G ′( i,j ))/2.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2020
From: SHENZHEN BYD AUTO R&D COMPANY LIMITED; BYD COMPANY LIMITED
To: BYD COMPANY LIMITED
Reel/Frame 051556/0053 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2014
From: PENG, MAO; FU, JINGJUN; HU, WENGE
To: SHENZHEN BYD AUTO R&D COMPANY LIMITED; BYD COMPANY LIMITED
Reel/Frame 032273/0747 →
Priority Claims (1)
CN 2011 1 0252562 · Aug 30, 2011 · national
Continuity (2)
Continuation PCTCN2012080620 · Aug 27, 2012
Related Publication 20140168446A1 · Jun 19, 2014