IP Library Granted Patent US 12,256,157
Granted Patent B2
US 12,256,157 · App. 17/899,476 · Granted Mar 18, 2025

Image processing apparatus, image processing method, and storage medium

Inventors: Masashi Yamamoto (Kanagawa, JP); Taisuke Nishio (Kanagawa, JP)
Assignee: Canon Kabushiki Kaisha
H04N23/88H04N23/56
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,256,157
App. No.
17/899,476
Granted
Mar 18, 2025
Kind
B2
Abstract

An apparatus includes an acquisition unit configured to acquire a first control value related to white balance based on an input image, a determination unit configured to determine whether a first area including the acquired first control value is changeable, a control unit configured to change the first area to a second area based on a result of determination by the determination unit, and a calculation unit configured to calculate a second control value related to the white balance to be applied to the input image in the second area in a case where the first area is changed to the second area, wherein the control unit changes the first area to the second area by stages.

Claims (96)

1. An apparatus comprising:

at least one processor; and

a memory coupled to the at least one processor, the memory storing instructions that, when executed by the at least one processor, cause the at least one processor to function as:

an acquisition unit configured to acquire a first control value related to white balance based on an input image;

a determination unit configured to determine whether a first area including the acquired first control value is changeable;

a control unit configured to change the first area to a second area based on whether the first area including the acquired first control value is changeable; and

a calculation unit configured to calculate a second control value related to the white balance to be applied to the input image in the second area in a case where the first area is changed to the second area,

an estimation unit configured to estimate influence of an infrared light component in the input image,

wherein the determination unit determines whether the first area is changeable based on the estimated influence of an infrared light component, and

wherein the first area is changed to the second area by stages.

2. The apparatus according to claim 1 , wherein the control unit sets an area closest to the first area as the second area among a plurality of areas stored in a storage device.

3. The apparatus according to claim 2 , wherein the acquisition unit acquires information related to a control method of the white balance in a capturing apparatus connected to the apparatus.

4. The apparatus according to claim 3 , wherein the acquisition unit acquires a control value calculated in the first area based on a characteristic amount related to a color of the input image as the first control value.

5. The apparatus according to claim 4 , wherein the acquisition unit acquires a target value to be set to appropriately control the white balance of the input image.

6. The apparatus according to claim 5 , wherein the control unit controls an amount by which the first area is to be changed based on a difference between the control value and the target value.

7. The apparatus according to claim 2 , wherein the control unit changes the first area to the second area so that the first control value is included in the second area.

8. The apparatus according to claim 2 ,

wherein the at least one processor further functions as an estimation unit configured to estimate influence of a specific color component in the input image, and

wherein the determination unit determines whether the first area is changeable based on the estimated influence of a specific color component.

9. The apparatus according to claim 8 ,

wherein the estimation unit calculates a ratio of the specific color component in the input image, and

wherein the determination unit determines whether the first area is changeable based on the ratio of the specific color component.

10. The apparatus according to claim 8 , wherein the control unit changes the first area to the second area so as to cancel the influence of the specific color component.

11. The apparatus according to claim 1 , wherein the control unit sets an area that is changed from the first area by a predetermined amount as the second area.

12. The apparatus according to claim 1 ,

wherein the estimation unit calculates a ratio of the infrared light component in the input image, and

wherein the determination unit determines whether the first area is changeable based on the ratio of the infrared light component.

13. The apparatus according to claim 12 , wherein the control unit changes the first area to the second area so as to cancel the influence of the infrared light component.

14. A method comprising:

acquiring a first control value related to white balance based on an input image;

determining whether a first area including the acquired first control value is changeable;

changing the first area to a second area based on whether the first area including the acquired first control value is changeable; and

calculating a second control value related to the white balance to be applied to the input image in the second area in a case where the first area is changed to the second area,

estimating influence of an infrared light component in the input image,

determining whether the first area is changeable based on the estimated influence of an infrared light component, and

wherein the first area is changed to the second area by stages.

15. A non-transitory computer-readable storage medium storing a program for causing a computer to execute a method, the method comprising:

acquiring a first control value related to white balance based on an input image;

determining whether a first area including the acquired first control value is changeable;

changing the first area to a second area based on whether the first area including the acquired first control value is changeable; and

calculating a second control value related to the white balance to be applied to the input image in the second area in a case where the first area is changed to the second area,

estimating influence of an infrared light component in the input image,

determining whether the first area is changeable based on the estimated influence of an infrared light component, and

wherein the first area is changed to the second area by stages.

16. An apparatus comprising:

at least one processor; and

a memory coupled to the at least one processor, the memory storing instructions that, when executed by the at least one processor, cause the at least one processor to function as:

an acquisition unit configured to acquire a first control value related to white balance based on an input image;

a determination unit configured to determine whether a first area including the acquired first control value is changeable;

a control unit configured to change the first area to a second area based on whether the first area including the acquired first control value is changeable; and

a calculation unit configured to calculate a second control value related to the white balance to be applied to the input image in the second area in a case where the first area is changed to the second area,

wherein the control unit sets an area closest to the first area as the second area among a plurality of areas stored in a storage device,

wherein the determination unit determines whether the first area is changeable based on whether the first control value is located near a boundary line of the first area, and

wherein the first area is changed to the second area by stages.

17. A method comprising:

acquiring a first control value related to white balance based on an input image;

determining whether a first area including the acquired first control value is changeable;

changing the first area to a second area based on whether the first area including the acquired first control value is changeable; and

calculating a second control value related to the white balance to be applied to the input image in the second area in a case where the first area is changed to the second area,

wherein the control unit sets an area closest to the first area as the second area among a plurality of areas stored in a storage device,

wherein the determining determines whether the first area is changeable based on whether the first control value is located near a boundary line of the first area, and

wherein the first area is changed to the second area by stages.

18. A non-transitory computer-readable storage medium storing a program for causing a computer to execute a method, the method comprising:

acquiring a first control value related to white balance based on an input image;

determining whether a first area including the acquired first control value is changeable;

changing the first area to a second area based on whether the first area including the acquired first control value is changeable; and

calculating a second control value related to the white balance to be applied to the input image in the second area in a case where the first area is changed to the second area,

wherein the control unit sets an area closest to the first area as the second area among a plurality of areas stored in a storage device,

wherein the determining determines whether the first area is changeable based on whether the first control value is located near a boundary line of the first area, and

wherein the first area is changed to the second area by stages.

19. An apparatus comprising:

at least one processor; and

a memory coupled to the at least one processor, the memory storing instructions that, when executed by the at least one processor, cause the at least one processor to function as:

an acquisition unit configured to acquire a first control value related to white balance based on an input image;

a determination unit configured to determine whether a first area including the acquired first control value is changeable;

a control unit configured to change the first area to a second area based on whether the first area including the acquired first control value is changeable; and

a calculation unit configured to calculate a second control value related to the white balance to be applied to the input image in the second area in a case where the first area is changed to the second area,

wherein the first area is changed to the second area by stages,

wherein the calculation unit calculates a plurality of control values related to the white balance to be applied to the input image in each of a plurality of areas obtained by changing the first area by stages, and

wherein the at least one processor further functions as a display control unit configured to cause a display unit to display a plurality of images, in a selectable manner, to be generated by applying the plurality of control values to the input image.

20. A method comprising:

acquiring a first control value related to white balance based on an input image;

determining whether a first area including the acquired first control value is changeable;

changing the first area to a second area based on whether the first area including the acquired first control value is changeable; and

calculating a second control value related to the white balance to be applied to the input image in the second area, in a case where the first area is changed to the second area,

wherein the first area is changed to the second area by stages, and further comprising:

calculating a plurality of control values related to the white balance to be applied to the input image in each of a plurality of areas obtained by changing the first area by stages, and

displaying a plurality of images, in a selectable manner, to be generated by applying the plurality of control values to the input image.

21. A non-transitory computer-readable storage medium storing a program for causing a computer to execute a method, the method comprising:

acquiring a first control value related to white balance based on an input image;

determining whether a first area including the acquired first control value is changeable;

changing the first area to a second area based on whether the first area including the acquired first control value is changeable; and

calculating a second control value related to the white balance to be applied to the input image in the second area, in a case where the first area is changed to the second area,

wherein the first area is changed to the second area by stages, and further comprising:

a plurality of control values related to the white balance to be applied to the input image in each of a plurality of areas obtained by changing the first area by stages; and

displaying a plurality of images, in a selectable manner, to be generated by applying the plurality of control values to the input image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2022
From: YAMAMOTO, MASASHI; NISHIO, TAISUKE
To: CANON KABUSHIKI KAISHA
Reel/Frame 061369/0757 →
Priority Claims (2)
JP 2021-146785 · Sep 9, 2021 · national
JP 2022-106164 · Jun 30, 2022 · national
Continuity (1)
Related Publication 20230070353A1 · Mar 9, 2023
References Cited (8)
US 20020018129A1 · Ikeda · 2002 [cited by examiner]
US 20150350620A1 · Kuchiki · 2015 [cited by examiner]
US 20160295189A1 · Fujiwara · 2016 [cited by examiner]
US 20190158796A1 · Wang · 2019 [cited by examiner]
US 20220329769A1 · Hsu · 2022 [cited by examiner]
US 20230379591A1 · Kaise · 2023 [cited by examiner]
JP 2005130317A · 2005 [cited by applicant]
WO WO2021104352A1 · 2021 [cited by examiner]