IP Library › Granted Patent US 12,276,546
Granted Patent B2
US 12,276,546 · App. 17/779,393 · Granted Apr 15, 2025

Ambient light source classification

Inventors: Gunter Siess (Kraftsdorf, DE); Frank Krumbein (Windischholzhausen, DE); Julius Komma (Jena, DE); Thomas Nimz (Rothenstein, DE); Mahmoud Jazayerifar (Jena, DE)
Assignee: ams Sensors Germany GmbH
G01J3/027G01J3/36G01J3/463H04N9/73
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,276,546
App. No.
17/779,393
Granted
Apr 15, 2025
Kind
B2
Abstract

An image-sensing device is disclosed, the image-sensing device comprising a multispectral sensor and a processor communicably coupled to the multispectral sensor. The processor is configured to determine an ambient light source classification based on a comparison of predefined spectral data to data corresponding to an output of the multispectral sensor. Also disclosed is a method of classifying an ambient light source by sensing a spectrum of light with a multispectral sensor; and determining an ambient light source classification based on a comparison of predefined spectral data to data corresponding to an output of the multispectral sensor. An associated computer program, computer-readable medium and data processing apparatus are also disclosed.

Claims (34)

1. An image-sensing device comprising:

a multispectral sensor; and

a processor communicably coupled to the multispectral sensor,

wherein the processor is configured to determine an ambient light source corresponding to an output of the multispectral sensor,

further comprising an image sensor communicably coupled to the processor, wherein the processor is configured to adapt an image sensed by the image sensor based upon the ambient light source classification, and wherein a field of view of the multispectral sensor is greater than a field of view of the image sensor.

2. The image-sensing device of claim 1 , wherein the processor is configured to adapt the image by white-balancing the image based upon one or more parameters of the ambient light source classification.

3. The image-sensing device of claim 1 , wherein the predefined spectral data comprises a plurality of discrete spectra, each spectrum corresponding to a different ambient light source.

4. The image-sensing device of claim 3 , wherein the processor is configured to determine the ambient light source classification by identifying a closest match between one of the discrete spectra and a spectrum of the ambient light source.

5. The image-sensing device of claim 4 , wherein the processor is configured to reconstruct the spectrum of the ambient light source from the data corresponding to the output of the multispectral sensor.

6. The image-sensing device of claim 1 , wherein the ambient light source classification is a color temperature or a color coordinate.

7. The image-sensing device of claim 1 , wherein the processor is configured to provide an indication of an accuracy of the determination of the ambient light source classification.

8. The image sensing device of claim 1 , wherein the processor is configured to provide an indication of a likelihood of color saturation of an/the image sensed by the image-sensing device.

9. The image-sensing device of claim 1 , wherein at least one of:

a spectral range of the multispectral sensor comprises visible light;

a spectral range of the multispectral sensor comprises infra-red radiation; and/or

a spectral range of the multispectral sensor comprises ultra-violet radiation.

10. The image-sensing device of claim 1 , wherein at least one of:

the multispectral sensor comprises a diffuser;

the multispectral sensor comprises an optical filter, the optical filter configured to filter infra-red radiation and/or ultra-violet radiation.

11. The image sensing device of claim 1 , wherein at least one of:

the image sensor and the multispectral sensor are configurable to operate sequentially or in parallel; and

a field of view of the image sensor and/or the multispectral sensor is configurable.

12. The image-sensing device of claim 1 , wherein the device is at least one of: a cellular telephone, a camera, an image-recording device; and/or a video recording device.

13. A method for classifying an ambient light source, the method comprising the steps of:

sensing a spectrum of light with a multispectral sensor having a field of view greater than a field of view of an image sensor associated therewith;

determining an ambient light source classification based on a comparison of predefined spectral data to data corresponding to an output of the multispectral sensor; and

adapting an image sensed by said image sensor based upon the ambient light source classification.

14. The method of claim 13 , wherein the image is adapted by white-balancing the image based upon one or more parameters of the ambient light source classification.

15. The method of claim 13 , wherein the predefined spectral data comprises a plurality of discrete spectra, each spectrum corresponding to a different ambient light source, and wherein the method further comprises the steps of:

reconstructing the spectrum of the ambient light source from the data corresponding to the output of the multispectral sensor; and

determining the ambient light source classification by identifying a closest match between one of the discrete spectra and a spectrum of the ambient light source.

16. A computer program, the computer program comprising instructions, which, when the program is executed by a computer, cause the computer to carry out the method according to claim 13 .

17. A computer-readable medium having stored thereon the computer program of claim 16 .

18. A data processing apparatus comprising a memory and a processor adapted to carry out the method according to claim 13 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2022
From: SIESS, GUNTER; KRUMBEIN, FRANK; KOMMA, JULIUS; NIMZ, THOMAS; JAZAYERIFAR, MAHMOUD
To: AMS SENSORS GERMANY GMBH
Reel/Frame 060248/0983 →
Continuity (2)
Provisional Application 62941261 · Nov 27, 2019
Related Publication 20220412798A1 · Dec 29, 2022
References Cited (21)
US 10855912B2 · Pila · 2020 [cited by examiner]
US 20180082659A1 · Jia et al. · 2018 [cited by applicant]
US 20190045162A1 · Krestyannikov · 2019 [cited by applicant]
US 20190149791A1 · Lee · 2019 [cited by applicant]
US 20190301932A1 · Sarkar et al. · 2019 [cited by applicant]
CN 101296302A · 2008 [cited by applicant]
CN 107407600A · 2017 [cited by applicant]
EP 1985981A2 · 2008 [cited by examiner]
FR 2985856A1 · 2013 [cited by applicant]
JP 2011064637A · 2011 [cited by applicant]
KR 101010460B · 2011 [cited by applicant]
KR 20160067633A · 2016 [cited by examiner]
WO WO2015104870A1 · 2015 [cited by examiner]
Tom Builds Stuff, “How to Match Paint Colors Accurately”,https://www.youtube.com/watch?v=4W-RDBgWoeQ, Jul. 5, 2019 (Year: 2019). [cited by examiner]
Jay Tillu, “Mobile sensors: The Components that make our smartphones smarter”, https://medium.com/jay-tillu/mobile-sensors-the-components-that-make-our-smartphones-smarter-4174a7a2bfc3 Dec. 2, 2018 (Year: 2018). [cited by examiner]
International Search Report and Written Opnion for corresponding International Application No. PCT/EP2020/083694, dated Mar. 16, 2021. [cited by applicant]
Korean Intellectual Property Office Action for Application No. 1020227021243 dated May 16, 2024 (17 pages). [cited by applicant]
Chinese Patent Office Action for Application No. 202080082497 dated Oct. 1, 2024 (24 pages including English machine translation). [cited by applicant]
European Patent Office Action for Application No. 20816459.0 dated Dec. 16, 2024 (6 pages). [cited by applicant]
Chinese Patent Office Action for Application No. 202080082497 dated Dec. 21, 2024 (15 pages including English machine translation). [cited by applicant]
Korean Patent Office Action for Application No. 1020227021243 dated Jan. 9, 2025 (6 pages). [cited by applicant]