IP Library Granted Patent US 11,553,146
Granted Patent B2
US 11,553,146 · App. 17/332,164 · Granted Jan 10, 2023

Image signal processor and image processing system

Inventors: Yoon Gyoo Lee (Gyeonggi-do, KR); Seong Hee Park (Gyeonggi-do, KR); Ji Soo Son (Gyeonggi-do, KR)
Assignee: SK hynix Inc.
H04N5/357H04N9/0455
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,553,146
App. No.
17/332,164
Granted
Jan 10, 2023
Kind
B2
Abstract

An image processing system includes: an image sensor suitable for generating an RYYB (Red Yellow Yellow Blue) bayer image by applying an RYYB color filter array; an interpolation logic suitable for generating a Y image at a position of an R image portion in the RYYB bayer image by interpolating a YY image portion in the RYYB bayer image; and a guided filtering logic suitable for guided-filtering the R image portion in the RYYB bayer image by using, as a guide image, the Y image at the position of the R image portion.

Claims (37)

1. An image processing system, comprising:

an image sensor suitable for generating an RYYB (Red Yellow Yellow Blue) bayer image by applying an RYYB color filter array;

an interpolation logic suitable for generating a Y image at a position of an R image portion in the RYYB bayer image by interpolating a YY image portion in the RYYB bayer image; and

a guided filtering logic suitable for guided-filtering the R image portion in the RYYB bayer image by using, as a guide image, the Y image at the position of the R image portion.

2. The image processing system of claim 1 , wherein the R image portion in the RYYB bayer image is replaced with an R image that is guided-filtered by the guided filtering logic.

3. The image processing system of claim 1 , wherein the image sensor includes:

a pixel array including a plurality of pixels to which the RYYB color filter array is applied; and

an analog-to-digital conversion circuit suitable for generating the RYYB bayer image by performing analog-to-digital conversion on the pixel signals output from the pixel array.

4. An image processing system, comprising:

an image sensor suitable for generating an RWWB (Red White White Blue) bayer image by applying an RWWB color filter array;

an interpolation logic suitable for generating a W image at a position of an R image portion in the RWWB bayer image by interpolating a WW image portion of the RWWB bayer image, and generating a W image at a position of a B image portion in the RWWB bayer image by interpolating the WW image portion of the RWWB bayer image; and

a guided filtering logic suitable for guided-filtering the R image portion in the RWWB bayer image by using, as a guide image, the W image at the position of the R image portion, and guided-filtering the B image portion in the RWWB bayer image by using, as a guide image, the W image at the position of the B image portion.

5. The image processing system of claim 4 , wherein the R image portion and the B image portion in the RWWB bayer image are replaced respectively with an R image which is guided-filtered by the guided-filtering logic and a B image which is guided-filtered by the guided filtering logic.

6. The image processing system of claim 4 , wherein the image sensor includes:

a pixel array including a plurality of pixels to which the RWWB color filter array is applied; and

an analog-to-digital conversion circuit suitable for generating the RWWB bayer image by performing analog-to-digital conversion on the pixel signals output from the pixel array.

7. An image signal processor receiving and processing an RYYB (Red Yellow Yellow Blue) bayer image from an image sensor, comprising:

an interpolation logic suitable for generating a Y image at a position of an R image portion in the RYYB bayer image by interpolating a YY image portion in the RYYB bayer image; and

a guided filtering logic suitable for guided-filtering the R image portion in the RYYB bayer image by using, as a guide image, the Y image at the position of the R image portion.

8. The image signal processor of claim 7 , wherein the R image portion in the RYYB bayer image is replaced with an R image that is guided-filtered by the guided filtering logic.

9. An image signal processor receiving and processing an RWWB (Red White White Blue) bayer image from an image sensor, comprising:

an interpolation logic suitable for generating a W image at a position of an R image portion in the RWWB bayer image by interpolating a WW image portion in the RWWB bayer image, and generating a W image at a position of a B image portion in the RWWB bayer image by interpolating the WW image portion in the RWWB bayer image; and

a guided filtering logic suitable for guided-filtering the R image portion in the RWWB bayer image by using, as a guide image, the W image at the position of the R image portion, and guided-filtering the B image portion in the RWWB bayer image by using, as a guide image, the W image at the position of the B image portion.

10. The image signal processor of claim 9 , wherein the R image portion and the B image portion in the RWWB bayer image are replaced respectively with an R image which is guided-filtered by the guided-filtering logic and a B image which is guided-filtered by the guided filtering logic.

11. An image processing system, comprising:

an image sensor suitable for generating a bayer image by applying a color filter array including a plurality of colors including at least a first color and a second color;

an interpolation logic suitable for generating a first color image at a position of a second color image portion in the bayer image by interpolating a first color image portion in the bayer image; and

a guided filtering logic suitable for guided-filtering the second color image portion in the bayer image by using, as a guide image, the first color image at the position of the second color image portion.

12. The image processing system of claim 11 , wherein the first color image portion in the bayer image has a higher signal-to-noise ratio than the second color image portion in the bayer image.

13. The image processing system of claim 12 , wherein the second color image portion in the bayer image is replaced with a second color image that is guided-filtered by the guided filtering logic.

14. An image processing system, comprising:

an image sensor suitable for generating a bayer image by applying a color filter array that includes a plurality of colors including at least a first color and a second color; and

an interpolation logic suitable for generating a first color image at a position of a second color image portion in the bayer image by interpolating a first color image portion in the bayer image.

15. The image processing system of claim 14 , wherein the first color image at the position of the second color image portion which is generated by the interpolation logic is used as a guide image for the second color image portion in the bayer image.

16. The image processing system of claim 14 , wherein the first color is Y (yellow), and the second color is R (red).

17. The image processing system of claim 14 , wherein the first color is W (white), and the second color is R (red).

18. The image processing system of claim 14 , wherein the first color is W (white), and the second color is B (blue).

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2024
From: SK HYNIX INC.
To: MIMIRIP LLC
Reel/Frame 067335/0246 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2021
From: LEE, YOON GYOO; PARK, SEONG HEE; SON, JI SOO
To: SK HYNIX INC.
Reel/Frame 056372/0941 →