IP Library › Granted Patent US 11,917,300
Granted Patent B2
US 11,917,300 · App. 17/699,301 · Granted Feb 27, 2024

Image pickup apparatus and image pickup element, which are capable of performing appropriate correction processing that suppresses influence of high luminance light, control method for image pickup apparatus, and storage medium

Inventor: Hideki Ikedo (Kanagawa, JP)
Assignee: CANON KABUSHIKI KAISHA
H04N23/71H04N23/75
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,917,300
App. No.
17/699,301
Granted
Feb 27, 2024
Kind
B2
Abstract

An image pickup apparatus capable of performing an appropriate correction processing that suppresses an influence of high luminance light is provided. The image pickup apparatus comprising at least one processor and/or circuit configured to function as inferring a luminance of a high luminance subject having a pixel signal saturation level or higher based on image signals generated from a plurality of pixels, and determining an area for obtaining a correction value used when correcting the image signals based on the inferred luminance of the high luminance subject.

Claims (40)

1. An image pickup apparatus comprising:

at least one processor and/or circuit configured to function as:

inferring a luminance of a high luminance subject having a pixel signal saturation level or higher based on image signals generated from a plurality of pixels; and

determining an area for obtaining a correction value used when correcting the image signals and an area excluded from the area for obtaining the correction value among areas corresponding to optical black pixels included in the plurality of pixels, based on the inferred luminance of the high luminance subject.

2. The image pickup apparatus according to claim 1 ,

wherein the luminance of the high luminance subject is detected by a learning model that is machine-learned by using first image signals and second image signals, and

wherein the second image signals are an image of a same scene as the first image signals and are darker than the first image signals.

3. The image pickup apparatus according to claim 2 ,

wherein machine learning of the learning model is performed by including photographing condition information when photographing the first image signals and photographing condition information when photographing the second image signals.

4. The image pickup apparatus according to claim 3 ,

wherein the machine learning of the learning model is performed by using the luminance of the high luminance subject detected based on a comparison between the first image signals and the second image signals, and the photographing condition information when photographing the first image signals and the photographing condition information when photographing the second image signals as teacher data.

5. The image pickup apparatus according to claim 2 ,

wherein the first image signals are image signals obtained by photographing under a proper exposure condition, and the second image signals are image signals obtained by photographing the same scene as the first image signals under a dark exposure condition.

6. The image pickup apparatus according to claim 5 ,

wherein in a case that a composition of the first image signals and a composition of the second image signals are different, the first image signals and the second image signals are not used for a machine learning of the learning model.

7. The image pickup apparatus according to claim 5 , further comprising:

a display unit, and

wherein a message to prompt photographing under the proper exposure condition is displayed on the display unit, and

after the first image signals are obtained, a message to prompt photographing under an exposure condition darker than the proper exposure condition is displayed on the display unit.

8. The image pickup apparatus according to claim 1 ,

wherein the area excluded from the area for obtaining the correction value is determined, based on the inferred luminance of the high luminance subject and a position of the high luminance subject.

9. The image pickup apparatus according to claim 1 ,

wherein the area excluded from the area for obtaining the correction value is set so as to become wider as the luminance of the high luminance subject increases.

10. The image pickup apparatus according to claim 1 ,

wherein with respect to areas within a certain range predetermined based on the area corresponding to the optical black pixels included in the image signals, a processing that infers the luminance of the high luminance subject is performed.

11. The image pickup apparatus according to claim 1 ,

wherein the at least one processor and/or circuit further configured to function as:

correcting the image signals based on the correction value.

12. The image pickup apparatus according to claim 11 ,

wherein image signals of the next frame are corrected based on the correction value.

13. An image pickup element comprising:

at least one processor and/or circuit configured to function as:

inferring a luminance of a high luminance subject having a pixel signal saturation level or higher based on image signals generated from a plurality of pixels; and

determining an area for obtaining a correction value used when correcting the image signals and an area excluded from the area for obtaining the correction value among areas corresponding to optical black pixels included in the plurality of pixels, based on the inferred luminance of the high luminance subject.

14. A control method for an image pickup apparatus, comprising:

a step of inferring a luminance of a high luminance subject having a pixel signal saturation level or higher based on image signals generated from a plurality of pixels; and

a step of determining an area for obtaining a correction value used when correcting the image signals and an area excluded from the area for obtaining the correction value among areas corresponding to optical black pixels included in the plurality of pixels, based on the inferred luminance of the high luminance subject.

15. A non-transitory computer-readable storage medium storing a program for causing a computer to execute a control method for an image pickup apparatus, comprising:

a step of inferring a luminance of a high luminance subject having a pixel signal saturation level or higher based on image signals generated from a plurality of pixels; and

a step of determining an area for obtaining a correction value used when correcting the image signals and an area excluded from the area for obtaining the correction value among areas corresponding to optical black pixels included in the plurality of pixels, based on the inferred luminance of the high luminance subject.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2022
From: IKEDO, HIDEKI
To: CANON KABUSHIKI KAISHA
Reel/Frame 059703/0544 →
Priority Claims (1)
JP 2021-057793 · Mar 30, 2021 · national
Continuity (1)
Related Publication 20220321753A1 · Oct 6, 2022