IP Library › Granted Patent US 11,900,570
Granted Patent B2
US 11,900,570 · App. 17/179,789 · Granted Feb 13, 2024

Image processing system for performing image quality tuning and method of performing image quality tuning

Inventors: Kyounghwan Moon (Suwon-si, KR); Jungyeob Chae (Yongin-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06T5/006G06T5/009G06T5/50H04N25/61H04N25/683
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,900,570
App. No.
17/179,789
Filed
Feb 19, 2021
Granted
Feb 13, 2024
Kind
B2
Art Unit
2667
USPC
382/275
Abstract

An image processing system includes a memory configured to store a plurality of reference images used for image quality tuning, an image signal processor configured to receive a plurality of captured images corresponding to the plurality of reference images and configured to generate a plurality of corrected images by being configured to perform a corresponding image processing operation among a plurality of image processing operations, and a tuning module configured to set parameters of the plurality of image processing operations based on the plurality of corrected images and the plurality of reference images.

Claims (48)

1. An image processing system comprising:

a memory configured to store a plurality of reference images used for image quality tuning; and

processing circuitry configured to receive a plurality of captured images corresponding to the plurality of reference images, configured to generate a plurality of corrected images by being configured to perform a corresponding image processing operation among a plurality of image processing operations, and configured to set parameters of the plurality of image processing operations based on the plurality of corrected images and the plurality of reference images,

wherein the processing circuitry is configured to

generate a first corrected image by performing a first image processing operation corresponding to a first reference image on a first captured image corresponding to the first reference image, and configured to set at least one first parameter of the first image processing operation based on a correlation between the first corrected image and the first reference image, the at least one first parameter corresponding to at least one of a defect pixel correction operation and an offset correction operation, and

generate a second corrected image by performing a second image processing operation on the first corrected image and set a second parameter of the second image processing operation based on the second corrected image and a reference image, from among the plurality of reference images, corresponding to the second image processing operation.

2. The image processing system of claim 1 , wherein the processing circuitry is configured to generate the first corrected image by performing the first image processing operation on the first captured image based on a first default parameter.

3. The image processing system of claim 1 , wherein the processing circuitry is configured to generate a plurality of first corrected images by performing the first image processing operation a plurality of times on the first captured image based on first default parameters having different values.

4. The image processing system of claim 3 , wherein the processing circuitry is configured to calculate correlations between the plurality of first corrected images and the first reference image, is configured to determine a specific first corrected image closest to the first reference image based on the calculated correlations, and is configured to set a first default parameter corresponding to the specific first corrected image as the first parameter.

5. The image processing system of claim 1 , wherein the processing circuitry is configured to generate the second corrected image by performing a second image processing operation corresponding to a second reference image on a second captured image corresponding to the second reference image when the first parameter is set and is configured to set at least one second parameter of the second image processing operation based on a correlation between the second corrected image and the second reference image.

6. The image processing system of claim 5 , wherein the processing circuitry is configured to generate the second corrected image by being configured to perform the second image processing operation after being configured to perform the first image processing operation on the second captured image based on the set first parameter.

7. The image processing system of claim 1 , wherein the plurality of image processing operations comprise at least one of a sensor correction operation, a lens distortion correction operation, a color correction operation, and an image quality improvement operation.

8. The image processing system of claim 7 , wherein the processing circuitry is configured to sequentially generate the plurality of corrected images by performing a corresponding image processing operation on each of the plurality of captured images in an order of the plurality of image processing operations is configured to sequentially set parameters of the plurality of image processing operations based on the plurality of corrected images and the plurality of reference images in the order.

9. The image processing system of claim 8 , wherein, in the order, the lens distortion correction operation precedes at least one of the color correction operation and the image quality improvement operation.

10. The image processing system of claim 7 , wherein the plurality of reference images are at least one of a white image, a black image, a grey image, a rectangular image, a color image, and a resolution image or a combination of at least two thereof.

11. The image processing system of claim 10 , wherein the white image corresponds to the defect pixel correction operation,

wherein the black image corresponds to at least one of the defect pixel correction operation and the offset correction operation,

wherein the grey image corresponds to a gamma correction operation,

wherein the rectangular image corresponds to the lens distortion correction operation,

wherein the color image corresponds to at least one of a demosaic operation, a color gain correction operation, and a color correction matrix operation, and

wherein the resolution image corresponds to a denoise operation.

12. An image processing system comprising:

a memory configured to store a plurality of reference images used for image quality tuning; and

processing circuitry configured to perform a plurality of image processing operations and configured to perform a tuning operation of setting a parameter of a target image processing operation among the plurality of image processing operations,

wherein the tuning operation comprises,

obtaining an image by capturing a reference image, from among the plurality of reference images, corresponding to the target image processing operation,

generating a corrected image by performing the target image processing operation on a captured image based on the parameter of the target image processing operation, and

updating the parameter of the target image processing operation based on the corrected image and the reference image, and

wherein a plurality of corrected images include a first corrected image and a second corrected image, and the plurality of image processing operations include a first image processing operation and a second image processing operation,

wherein the processing circuitry is configured to perform the tuning operation on each of the plurality of image processing operations such that the second corrected image is generated by performing the second image processing operation on the first corrected image and setting a parameter of the second image processing operation based on the second corrected image and a specific reference image, from among the plurality of reference images, corresponding to the second image processing operation, and

wherein the parameter of the target image processing operation corresponds to at least one of a defect pixel correction operation and an offset correction operation.

13. The image processing system of claim 12 , wherein the processing circuitry is configured to sequentially perform the tuning operation in an order of the plurality of image processing operations.

14. The image processing system of claim 13 , wherein the processing circuitry is configured to generate the corrected image by performing the target image processing operation after performing an image processing operation on the captured image prior to the target image processing operation in the order.

15. The image processing system of claim 12 , further comprising an image sensor,

wherein the processing circuitry is configured to control the image sensor to output the captured image by capturing a corresponding one of the plurality of reference images.

16. The image processing system of claim 12 , further comprising a communication device,

wherein the processing circuitry is configured to control the communication device to transmit a request signal requesting a corresponding one of the plurality of reference images to be displayed to an external device.

17. An image quality tuning method comprising:

obtaining a plurality of captured images by capturing a plurality of reference images;

generating a plurality of corrected images by performing at least one corresponding image processing operation among a plurality of image processing operations on the plurality of captured images; and

setting parameters of the plurality of image processing operations based on the plurality of corrected images and the plurality of reference images,

wherein at least one of the parameters corresponds to at least one of a defect pixel correction operation and an offset correction operation,

wherein the plurality of corrected images include a first corrected image and a second corrected image, and the plurality of image processing operations include a first image processing operation and a second image processing operation, and

wherein in the generating, the second corrected image is generated by performing the second image processing operation on the first corrected image and setting a parameter, from among the parameters, of the second image processing operation based on the second corrected image and a reference image, from among the plurality of reference images, corresponding to the second image processing operation.

18. The image quality tuning method of claim 17 , wherein the setting of the parameters of the plurality of image processing operations comprises:

calculating a correlation between each of the plurality of corrected images and a corresponding reference image; and

setting a parameter of an image processing operation corresponding to each of the plurality of corrected images based on the calculated correlation.

19. The image quality tuning method of claim 18 , wherein the plurality of reference images are at least one of a white image, a black image, a grey image, a rectangular image, a color image, and a resolution image or a combination thereof.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2021
From: MOON, KYOUNGHWAN; CHAE, JUNGYEOB
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 055336/0014 →
Priority Claims (1)
KR 10-2020-0073247 · Jun 16, 2020 · national
Continuity (1)
Related Publication 20210390670A1 · Dec 16, 2021