IP Library › Granted Patent US 11,765,467
Granted Patent B2
US 11,765,467 · App. 17/337,879 · Granted Sep 19, 2023

Image sensor, electronic device including the image sensor and configured to generate output image data based on high conversion gain pixel signals, and low conversion gain pixel signals, and operating method therof

Inventors: Jeongguk Lee (Seoul, KR); Yunseok Choi (Seoul, KR); Dochang Ahn (Suwon-si, KR); Soyoung Jeong (Seoul, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N23/76H04N5/265H04N23/741H04N23/84
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,765,467
App. No.
17/337,879
Granted
Sep 19, 2023
Kind
B2
Abstract

Provided is an image sensor including: a pixel array including a plurality of pixel groups each including first pixels to which a first conversion gain is applied and second pixels to which a second conversion gain is applied; a readout circuit configured to receive a first pixel signal corresponding to the first pixels and a second pixel signal corresponding to the second pixels through a single readout with respect to each of the plurality of pixel groups, generate first image data, based on first pixel signals of the plurality of pixel groups, and generate second image data, based on second pixel signals of the plurality of pixel groups; and an image signal processor configured to generate output image data by merging the first image data and the second image data in units of a pixel group.

Claims (54)

1. An image sensor comprising:

a pixel array including a plurality of pixel groups each including first pixels to which a first conversion gain is applied and second pixels to which a second conversion gain is applied;

a readout circuit configured to receive a first pixel signal corresponding to the first pixels and a second pixel signal corresponding to the second pixels through a single readout with respect to each of the plurality of pixel groups, generate first image data based on first pixel signals of the plurality of pixel groups, and generate second image data based on second pixel signals of the plurality of pixel groups, the first image data being the first pixel signals converted into digital data, the second image data being the second pixel signals converted into digital data; and

an image signal processor configured to generate output image data by merging the first image data and the second image data in units of a pixel group.

2. The image sensor of claim 1 , wherein, with respect to each of the plurality of pixel groups, the first pixel signal is read out by summing first pixel values of the first pixels, and the second pixel signal is read out by summing second pixel values of the second pixels.

3. The image sensor of claim 1 , wherein each of the first conversion gain and the second conversion gain is a high conversion gain or a low conversion gain.

4. The image sensor of claim 1 , wherein each of the plurality of pixel groups comprises 2n first pixels and 2n second pixels, wherein n is a positive integer.

5. The image sensor of claim 4 , wherein

the first pixels of each of the plurality of pixel groups comprise red pixels, blue pixels, first green pixels, or second green pixels, and

the second pixels of each of the plurality of pixel groups comprise white pixels or yellow pixels.

6. The image sensor of claim 4 , wherein the first pixels and the second pixels of each of the plurality of pixel groups comprise red pixels, blue pixels, first green pixels, or second green pixels.

7. The image sensor of claim 1 , wherein each of the plurality of pixel groups comprises third pixels to which a third conversion gain is applied.

8. The image sensor of claim 7 , wherein the first pixels, the second pixels, and the third pixels of each of the plurality of pixel groups comprise red pixels, blue pixels, first green pixels, or second green pixels.

9. The image sensor of claim 7 , wherein the readout circuit is further configured to,

receive a third pixel signal corresponding to the third pixels to which the third conversion gain is applied through the single readout with respect to each of the plurality of pixel groups, and

generate third image data, based on third pixel signals of the plurality of pixel groups.

10. The image sensor of claim 9 , wherein the image signal processor is further configured to generate the output image data by merging the first image data, the second image data, and the third image data in units of pixel groups.

11. The image sensor of claim 1 , wherein each of the plurality of pixel groups comprises third pixels to which a third conversion gain is applied and fourth pixels to which a fourth conversion gain is applied.

12. The image sensor of claim 11 , wherein,

in each of the plurality of pixel groups, the first pixels are arranged at an upper left side of the corresponding pixel group,

in each of the plurality of pixel groups, the second pixels are arranged at an upper right side of the corresponding pixel group,

in each of the plurality of pixel groups, the third pixels are arranged at a lower left side of the corresponding pixel group, and

in each of the plurality of pixel groups, the fourth pixels are arranged in a lower right side of the corresponding pixel group.

13. The image sensor of claim 11 , wherein the readout circuit is further configured to,

receive a third pixel signal corresponding to the third pixels and a fourth pixel signal corresponding to the fourth pixels through the single readout with respect to each of the plurality of pixel groups, and

generate third image data, based on third pixel signals of the plurality of pixel groups, and generates fourth image data, based on four pixel signals of the plurality of pixel groups sensor.

14. The image sensor of claim 13 , wherein the image signal processor is further configured to generate the output image data by merging the first image data, the second image data, the third image data, and the fourth image data in units of pixel groups.

15. An electronic device comprising:

an image sensor in which a plurality of pixel groups each including a plurality of pixels are arranged, the image sensor being configured to generate a plurality of pixel signals corresponding to a plurality of conversion gains through a single readout with respect to each of the plurality of pixel groups, generate a plurality of pieces of image data corresponding to the plurality of pixel signals based on the plurality of pixel signals, the plurality of pieces of image data being the plurality of pixel signals converted into digital data, respectively, and generate output image data by merging the plurality of pieces of image data; and

a processor configured to perform image processing on the output image data.

16. The electronic device claim 15 , wherein,

each of the plurality of pixel group comprises pixels corresponding to the plurality of conversion gains, and

the image sensor is further configured to generate a plurality of pixel signals corresponding to the plurality of conversion gains by summing pixel values of the pixels corresponding to the plurality of conversion gains with respect to each of the plurality of pixel groups.

17. The electronic device claim 15 , wherein,

each of the plurality of pixel groups comprises,

first RGB pixels corresponding to a first conversion gain, and

white pixels corresponding to a second conversion gain, and

the image sensor is further configured to generate a first pixel signal corresponding to the first RGB pixels and a second pixel signal corresponding to the white pixels with respect to each of the plurality of pixel groups.

18. The electronic device claim 15 , wherein,

each of the plurality of pixel groups comprises,

first RGB pixels corresponding to a first conversion gain, and

second RGB pixels corresponding to a second conversion gain, and

the image sensor is further configured to generate a first pixel signal corresponding to the first RGB pixels and a second pixel signal corresponding to the second RGB pixels with respect to each of the plurality of pixel groups.

19. The electronic device claim 15 , wherein,

the image sensor is further configured to generate a first output image data corresponding to a first frame section and second output image data corresponding to a second frame section, and

the processor is further configured to generate multi-frame image data by merging the first output image data and the second output image data.

20. An operating method of an image sensor, the operating method comprising:

outputting a first pixel signal corresponding to first pixels corresponding to a first conversion gain through a single readout, from each of a plurality of pixel groups included in a pixel array;

outputting a second pixel signal corresponding to second pixels corresponding to a second conversion gain through the single readout, from each of the plurality of pixel groups included in the pixel array;

generating first image data based on first pixel signals of the plurality of pixel groups, the first image data being the first pixel signals converted into digital data;

generating second image data a based on second pixel signals of the plurality of pixel groups, the second image data being the second pixel signals converted into digital data; and

generating output image data by merging the first image data and the second image data in units of pixel groups.

21. The operating method of claim 20 , wherein the outputting of the first pixel signal comprises outputting the first pixel signal by summing first pixel values of the first pixels, and

the outputting of the second pixel signal comprises the second pixel signal by summing second pixel values of the second pixels.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2021
From: LEE, JEONGGUK; CHOI, YUNSEOK; AHN, DOCHANG; JEONG, SOYOUNG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 056482/0799 →
Priority Claims (2)
KR 10-2020-0067909 · Jun 4, 2020 · national
KR 10-2021-0042229 · Mar 31, 2021 · national
Continuity (1)
Related Publication 20210385389A1 · Dec 9, 2021