IP Library Granted Patent US 12,223,735
Granted Patent B2
US 12,223,735 · App. 18/226,121 · Granted Feb 11, 2025

Vehicle camera vision and control system and method

Inventors: Benno Spinger (Aachen, DE); Dirk Vanderhaeghen (Wilrijk, BE); Ronald Johannes Bonne (Plainfield, IL); Wouter Schrama (Nuenen, NL); Norbert Lesch (Vaals, NL); Patrick van den Akker (Valkenburg aan de Geul, NL)
Assignee: LUMILEDS, LLC
G06V20/56B60Q1/0023B60Q1/085B60Q1/1415B60Q1/249B60R1/24F21S41/663F21V23/0442G06T7/521H04N5/74H04N23/10H04N23/56H04N23/90B60Q2300/052B60Q2300/054B60Q2300/30B60Q2300/33B60R2300/303B60R2300/8093G06T7/55G06T2207/10048G06T2207/30252G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,223,735
App. No.
18/226,121
Granted
Feb 11, 2025
Kind
B2
Abstract

A camera is described that includes a first imager and a processor communicatively coupled to the first imager. The first imager captures images of a roadway on which a vehicle is located when operating. The processor, when operating, generates a signal to cause a first hybridized device in the vehicle to project a first patterned light on to an object on the roadway, generates a signal to cause the first imager to capture an image of the first patterned light projected on the object, receives the image from the first imager, and detects the object on the roadway based on the first patterned light captured in the image.

Claims (29)

1. A camera comprising:

a first imager that is configured to capture images of a roadway on which a vehicle is located when operating;

a processor communicatively coupled to the first imager that is configured to, when operating:

generate a signal to cause a first hybridized device in the vehicle to project a first patterned light in a non-visible spectrum on to an object on the roadway, wherein the first hybridized device comprises a silicon backplane and a monolithic array on the silicon backplane, the monolithic array comprising at least 20,000 light-emitting segments spaced 20 μm or less apart that are independently controllable in groups to project the first patterned light for a period of time that is less than a threshold of human perception,

generate a signal to cause a second hybridized device to project a non-patterned light in a visible spectrum on the roadway,

generate a signal to cause the first imager to capture an image of the first patterned light projected on the object,

receive the image from the first imager, and

detect the object on the roadway based on the first patterned light captured in the image.

2. The camera of claim 1 , wherein the processor is further configured to:

generate a signal to cause a second hybridized device to project a second patterned light on to the object on the roadway;

generate a signal to cause a second imager to capture a second image of the first patterned light projected on to the object on the roadway, wherein the second imager is adapted to exclude the second pattern light projected by the second hybridized device and the first imager is adapted to exclude the first pattern light projected by the first hybridized device; and

detect the object on the roadway based on the image from the first imager and the second image from the second imager.

3. The camera of claim 1 , wherein the processor is further configured to select a pattern for the first patterned light based on at least one of:

operating parameters of the vehicle, or

the image of the first patterned light projected on the object captured by the first imager.

4. The camera of claim 1 , wherein the processor is further configured to generate a signal to alert other systems in the vehicle when the object is detected.

5. A method of objection detection, the method comprising:

causing, by a processor in a camera, a first hybridized device to project a first patterned light in a non-visible spectrum on to an object on a roadway on which a vehicle is located when operating wherein the first hybridized device comprises a silicon backplane and a monolithic array on the silicon backplane, the monolithic array comprising at least 20,000 light-emitting segments spaced 20 μm or less apart that are independently controllable in groups to project the first patterned light for a period of time that is less than a threshold of human perception;

causing, by the processor in the camera, the first hybridized device to project a non-patterned light in a visible spectrum on the roadway

causing, by the processor in the camera, a first imager to capture an image of the first patterned light projected on the object;

receiving, by the processor in camera, the image from the first imager;

detecting, by the processor in the camera, the object on the roadway based on the first patterned light captured in the first imager.

6. The method of claim 5 , further comprising:

generating, by the processor, a signal to cause a second hybridized device to project a second patterned light on to the object on the roadway;

generating, by the processor, a signal to cause a second imager to capture a second image of the first patterned light projected on to the object on the roadway, wherein the second imager is adapted to exclude the second pattern light projected by the second hybridized device and the first imager is adapted to exclude the first pattern light projected by the first hybridized device; and

detecting, by the processor, the object on the roadway based on the first image from the first imager and the second image from the second imager.

7. The method of claim 6 , further comprising selecting a pattern for the first patterned light based on at least one of:

operating parameters of the vehicle, or

the image of the first patterned light projected on the object captured by the first imager.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2025
From: LUMILEDS LLC
To: LUMILEDS SINGAPORE PTE. LTD.
Reel/Frame 071888/0086 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 18, 2023
From: SPINGER, BENNO; VANDERHAEGHEN, DIRK; BONNE, RONALD JOHANNES; SCHRAMA, WOUTER; LESCH, NORBERT; VAN DEN AKKER, PATRICK
To: LUMILEDS LLC
Reel/Frame 065271/0496 →
Continuity (6)
Provisional Application 63424824 · Nov 11, 2022
Provisional Application 63424827 · Nov 11, 2022
Provisional Application 63424819 · Nov 11, 2022
Provisional Application 63424826 · Nov 11, 2022
Provisional Application 63391933 · Jul 25, 2022
Related Publication 20240029443A1 · Jan 25, 2024
References Cited (9)
US 20080029701A1 · Onozawa et al. · 2008 [cited by applicant]
US 20200348127A1 · Heinrich et al. · 2020 [cited by applicant]
US 20230236320A1 · Krause et al. · 2023 [cited by applicant]
EP 3067826A1 · 2016 [cited by applicant]
EP 3070641A1 · 2016 [cited by applicant]
WO 2013117923A1 · 2013 [cited by applicant]
International Search Report and Written Opinion mailed Nov. 10, 2023 for PCT International Application No. PCT/US2023/028589. [cited by applicant]
Bell et al., “Structured Light Techniques and Applications.” In Wiley Encyclopedia of Electrical and Electronics Engineering, J.G. Webster (Ed.). (2016). https://doi.org/10.1002/047134608X.W8298. [cited by applicant]
Geng, “Structured-light 3D surface imaging: a tutorial,” Adv. Opt. Photon. 3, 128-160 (2011). [cited by applicant]