IP Library › Granted Patent US 12,657,857
Granted Patent B2
US 12,657,857 · App. 18/561,629 · Granted Jun 16, 2026

Illumination adjusting device, illumination adjusting method, and product recognition system

Inventor: Kiyoshi Hashimoto (Tokyo, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
G06V10/141G06T7/0002G06T7/13G06V10/44G06V10/60G06V10/764G06V20/50G06T2207/10152G06T2207/20021G06T2207/20081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,657,857
App. No.
18/561,629
Granted
Jun 16, 2026
Kind
B2
Abstract

An illumination adjustment apparatus comprises: a recognizer that recognizes an abnormal region in a captured image; and an adjuster that adjusts an intensity of illuminating light in accordance with a shape and a type of the abnormal region.

Claims (34)

1 . An illumination adjustment apparatus, comprising:

a controller, including at least a processor and a memory, configured to:

recognize a product region of a product from a captured image, and a shadow region in the captured image by excluding the recognized product region from a difference between the captured image and a background image; and

adjust, in a state in which the shadow region is recognized, an intensity of illuminating light such that the intensity of the illuminating light is higher than an intensity of illuminating light emitted to acquire the captured image.

2 . The illumination adjustment apparatus according to claim 1 , wherein

the controller is further configured to recognize the product region of the product based on a product detection model for detecting the product and based on edge detection.

3 . The illumination adjustment apparatus according to claim 1 , wherein

in a state in which the shadow region is recognized, the controller is further configured to calculate a shadow intensiveness degree of the shadow region, and the intensity of the illuminating light based on the shadow intensiveness degree of the shadow region.

4 . The illumination adjustment apparatus according to claim 1 , wherein

the controller is further configured to:

recognize an abnormal region including at least one of the shadow region and a blown-out highlight region; and

adjust the intensity of illuminating light in accordance with a shape and a type of the abnormal region.

5 . The illumination adjustment apparatus according to claim 4 , wherein:

in a state in which the blown-out highlight region is recognized, the controller is further configured to adjust the intensity of the illuminating light such that the intensity of the illuminating light is lower than the intensity of the illuminating light emitted to acquire the captured image.

6 . The illumination adjustment apparatus according to claim 5 , wherein

in a state in which the shadow region and the blown-out highlight region are recognized, the controller is further configured to adjust the intensity of the illuminating light such that the intensity of the illuminating light is lower than the intensity of the illuminating light emitted to acquire the captured image, after adjusting the intensity of the illuminating light such that the intensity of the illuminating light is higher than the intensity of the illuminating light emitted to acquire the captured image.

7 . The illumination adjustment apparatus according to claim 4 , wherein

the controller is further configured to recognize the abnormal region in a state in which the abnormal region is equal to or larger than a predetermined area.

8 . The illumination adjustment apparatus according to claim 4 , wherein

based on a height of a product, the controller is further configured to correct an emission range of the illuminating light to be emitted at the intensity in accordance with the shape and type of the abnormal region.

9 . An illumination adjustment method, comprising:

recognizing a product region of a product from a captured image, and a shadow region in the captured image by excluding the recognized product region from a difference between the captured image and a background image; and

adjusting, in a state in which the shadow region is recognized, an intensity of illuminating light such that the intensity of the illuminating light is higher than an intensity of illuminating light emitted to acquire the captured image.

10 . A product recognition system, comprising:

an illuminator that emits illuminating light to a predetermined region on which a product is placed;

a camera that captures and acquires an image of the predetermined region to which the illuminating light is emitted; and

an illumination adjustment apparatus that:

recognizes a product region of a product from a captured image, and a shadow region in the captured and acquired image by excluding the recognized product region from a difference between the captured image and a background image, and

adjusts, in a state in which the shadow region is recognized, an intensity of the illuminating light such that the intensity of the illuminating light is higher than an intensity of illuminating light emitted to acquire the captured image, wherein

the camera re-captures and re-acquires the image of the predetermined region to which the illuminator emits or does not emit the illuminating light at the intensity adjusted, and

the illumination adjustment apparatus recognizes the product in the re-captured and re-acquired image.

11 . The product recognition system according to claim 10 , wherein

the illumination adjustment apparatus further recognizes an abnormal region including at least one of a shadow region and a blown-out highlight region, and adjusts the intensity of illuminating light in accordance with a shape and a type of the abnormal region, and

an emission range of the illuminating light to be emitted at the intensity in accordance with the shape and type of the abnormal region is corrected based on a height of a product.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2024
From: HASHIMOTO, KIYOSHI
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 067158/0395 →
Priority Claims (1)
JP 2021-086135 · May 21, 2021 · national
Continuity (1)
Related Publication 20240249490A1 · Jul 25, 2024
References Cited (11)
US 20160345400A1 · Shih · 2016 [cited by examiner]
US 20220092866A1 · Inoue · 2022 [cited by applicant]
JP 2001145018 · 2001 [cited by applicant]
JP 2005024971 · 2005 [cited by applicant]
JP 2011220755 · 2011 [cited by applicant]
JP 2014160013 · 2014 [cited by applicant]
JP 2018085068 · 2018 [cited by applicant]
WO 2020116170 · 2020 [cited by applicant]
Im, Jonghoon, et al. “Correction of Over and Under Exposure Images Using Multiple Lighting System.” Proceedings of the 2nd International Conference on Maintenance Science and Technology (ICMST2014). 2015. (Year: 2015). [cited by examiner]
Extended European Search Report Issued in Corresponding EP Patent Application No. 22804491.3, dated Aug. 20, 2024. [cited by applicant]
International Search Report issued in International Pat. Appl. No. PCT/JP2022/018180, dated Jun. 28, 2022, along with an English translation thereof. [cited by applicant]