IP Library › Granted Patent US 11,736,812
Granted Patent B2
US 11,736,812 · App. 17/521,506 · Granted Aug 22, 2023

Image sensing device for correcting image using block areas and method of operating the same

Inventors: Ji Hee Han (Gyeonggi-do, KR); Jeong Yong Song (Gyeonggi-do, KR); Jae Yoon Yoo (Gyeonggi-do, KR)
Assignee: SK hynix Inc.
H04N23/76G06T7/80H04N9/77H04N23/71G06T2207/10024G06T2207/20021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,736,812
App. No.
17/521,506
Granted
Aug 22, 2023
Kind
B2
Abstract

Provided herein may be an image sensing device and a method of operating the same. The image sensing device may include an image sensor configured to acquire an image including a plurality of pixel values, a memory configured to store reference gain values of each of a plurality of block areas included in the image, and an image processor configured to calculate gain values included in each of the plurality of block areas using the reference gain values and to output a correction image in which the reference gain values and the gain values are applied to the plurality of pixel values, wherein the block areas include a first block area and a second block area having a shorter distance from a center of the image than the first block area and having a size greater than that of the first block area.

Claims (44)

1. An image sensing device, comprising:

an image sensor configured to acquire an image including a plurality of pixel values;

a memory configured to store reference gain values corresponding to vertices of each of a plurality of block areas included in the image; and

an image processor configured to:

calculate at least one gain value included in each of the plurality of block areas based on distances between the at least one gain value and the reference gain values, and

output a correction image comprising a correction pixel value obtained by correcting a selected pixel value among the plurality of pixel values based on a selected gain value corresponding to the selected pixel value among the reference gain values and the at least one gain value,

wherein the plurality of block areas include a first block area and a second block area having a shorter distance from a center of the image than the first block area and having a size greater than that of the first block area.

2. The image sensing device according to claim 1 , wherein a larger number of bits are assigned to each gain value included in the first block area than a number of bits assigned to each gain value included in the second block area.

3. The image sensing device according to claim 1 , wherein the image processor comprises an image calibrator configured to:

select pixel values, corresponding to the vertices of each of the plurality of block areas, from among a plurality of pixel values included in a calibration image acquired through the image sensor,

calculate an average pixel value of pixel values, having a color channel identical to a color channel of one of the selected pixel values, among pixel values included in a region of interest including each of the selected pixel values, and

calculate one reference gain value among the reference gain values using a pixel value of each of the selected pixel values and the average pixel value.

4. The image sensing device according to claim 3 , wherein the identical color channel is one of a first green channel, a second green channel, a red channel, and a blue channel.

5. The image sensing device according to claim 3 , wherein:

the identical color channel is one of a first green channel and a second green channel, and

the average pixel value includes an average of pixel values with the first green channel and pixel values with the second green channel, among the pixel values included in the region of interest.

6. The image sensing device according to claim 1 , wherein the image processor comprises an image calibrator configured to calculate the gain value corresponding to a point selected in one of the plurality of block areas based on distances from the selected point to vertices of the one block area and the reference gain values corresponding to the vertices of the one block area.

7. The image sensing device according to claim 6 , wherein:

the vertices of the one block area include a first vertex, a second vertex, a third vertex, and a fourth vertex of the one block area, and

the image calibrator calculates the gain value corresponding to the selected point based on a distance from the selected point to the first vertex, a distance from the selected point to the second vertex, a distance from the selected point to the third vertex, a distance from the selected point to the fourth vertex, the reference gain value corresponding to the first vertex, the reference gain value corresponding to the second vertex, the reference gain value corresponding to the third vertex, and the reference gain value corresponding to the fourth vertex.

8. The image sensing device according to claim 1 , wherein the image processor is further configured to store the reference gain values and the at least one gain value included in each of the plurality of block areas in the memory.

9. The image sensing device according to claim 8 , wherein the image processor comprises an image corrector configured to generate, when the image is acquired through the image sensor, the correction image in which the reference gain values and the at least one gain value that are stored in the memory are applied to the plurality of pixel values included in the image.

10. The image sensing device according to claim 1 , wherein each of the plurality of block areas is a rectangular or square area.

11. A method of operating an image sensing device, comprising:

calculating reference gain values corresponding to vertices of each of a plurality of block areas included in a calibration image acquired through the image sensing device;

calculating at least one gain value included in each of the plurality of block areas based on distances between the at least one gain value and the reference gain values;

storing the reference gain values and the at least one gain value included in each of the plurality of block areas in a memory; and

when an image is acquired through the image sensing device, outputting a correction image comprising a correction pixel value obtained by correcting a selected pixel value among the plurality of pixel values based on a selected gain value corresponding to the selected pixel value among the reference gain values and the at least one gain value,

wherein the plurality of block areas include a first block area and a second block area having a shorter distance from a center of the calibration image than the first block area and having a size greater than that of the first block area.

12. The method according to claim 11 , wherein a larger number of bits are assigned to each gain value included in the first block area than a number of bits assigned to each gain value included in the second block area.

13. The method according to claim 11 , wherein the calculating the reference gain values comprises:

selecting pixel values, corresponding to the vertices of each of the plurality of block areas, from among a plurality of pixel values included in the calibration image acquired through the image sensing device;

calculating an average pixel value of pixel values, having a color channel identical to a color channel of one of the selected pixel values, among pixel values included in a region of interest including each of the selected pixel values; and

calculating one reference gain value among the reference gain values using a pixel value of each of the selected pixel values and the average pixel value.

14. The method according to claim 13 , wherein the identical color channel is one of a first green channel, a second green channel, a red channel, and a blue channel.

15. The method according to claim 13 , wherein:

the identical color channel is one of a first green channel and a second green channel, and

the average pixel value includes an average of pixel values of pixel values with the first green channel and pixel values of pixel values with the second green channel, among the pixel values included in the region of interest.

16. The method according to claim 11 , wherein the calculating the at least one gain value gain comprises calculating a gain value corresponding to a point selected in one of the plurality of block areas based on distances from the selected point to vertices of the one block area and the reference gain values corresponding to the vertices of the one block area.

17. The method according to claim 16 , wherein:

the vertices of the one block area include a first vertex, a second vertex, a third vertex, and a fourth vertex of the one block area, and

the calculating the gain value corresponding to the selected point comprises:

calculating the gain value corresponding to the selected point based on a distance from the selected point to the first vertex, a distance from the selected point to the second vertex, a distance from the selected point to the third vertex, a distance from the selected point to the fourth vertex, the reference gain value corresponding to the first vertex, the reference gain value corresponding to the second vertex, the reference gain value corresponding to the third vertex, and the reference gain value corresponding to the fourth vertex.

18. The method according to claim 11 , wherein each of the plurality of block areas is a rectangular or square area.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2021
From: HAN, JI HEE; SONG, JEONG YONG; YOO, JAE YOON
To: SK HYNIX INC.
Reel/Frame 058050/0496 →
Priority Claims (1)
KR 10-2021-0059457 · May 7, 2021 · national
Continuity (1)
Related Publication 20220360722A1 · Nov 10, 2022