IP Library › Granted Patent US 10,877,147
Granted Patent B2
US 10,877,147 · App. 15/929,969 · Granted Dec 29, 2020

Forward sensing system for vehicle

Inventor: Niall R. Lynam (Holland, MI)
Assignee: MAGNA ELECTRONICS INC.
G01S13/931B60T7/22G01S7/03G01S7/032G01S13/86G01S13/867G01S13/93G01S17/86G01S2013/0245G01S2013/9321G01S2013/9322G01S2013/93276
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,877,147
App. No.
15/929,969
Granted
Dec 29, 2020
Kind
B2
Abstract

A forward sensing system for a vehicle includes a radar sensor and a forward facing image sensor disposed within a windshield electronics module that is removably installed within the vehicle cabin at an upper region of the vehicle windshield and that is removable therefrom as a self-contained unit for service or replacement. A control is responsive to an output of the radar sensor and responsive to an output of the image sensor. Responsive to the image sensor viewing an object present in the path of forward travel of the vehicle and/or responsive to the radar sensor sensing the object present in the path of forward travel of the vehicle, the control enhances interrogation of an area in front of the vehicle at which the object is present to determine if the object is an object of interest causing a potentially hazardous condition.

Claims (49)

1. A forward facing sensing system for a vehicle, the vehicle having a windshield, said forward facing sensing system comprising:

a radar sensor, wherein, with said radar sensor disposed at the vehicle, said radar sensor has a sensing direction forward of the vehicle;

a forward facing image sensor, wherein, with said forward facing image sensor disposed at the vehicle, said forward facing image sensor has a viewing direction forward of the vehicle;

wherein both said radar sensor and said image sensor are disposed within a windshield electronics module that is removably installed within the vehicle cabin at an upper region of the vehicle windshield and that is removable from the upper region of the vehicle windshield as a self-contained unit for service or replacement;

said radar sensor and said image sensor cooperating in a way that enhances the sensing capabilities of said forward facing sensing system to determine whether objects present in a path of forward travel of the vehicle are objects of interest;

a control responsive to an output of said radar sensor and responsive to an output of said forward facing image sensor;

responsive to said forward facing image sensor viewing an object present in the path of forward travel of the vehicle and responsive to said radar sensor sensing the object present in the path of forward travel of the vehicle, said control enhances interrogation of an area in front of the vehicle at which the object is present to determine if the object is an object of interest causing a potentially hazardous condition;

wherein the object present in the path of forward travel of the vehicle comprises one selected from the group consisting of (i) another vehicle present in the path of forward travel of the vehicle, (ii) a person present in the path of forward travel of the vehicle and (iii) a deer present in the path of forward travel of the vehicle; and

wherein said control enhances interrogation of the area at which the object is present via enhanced processing by an image processor of said control of image data captured by said forward facing image sensor at the area at which the object is present, the enhanced processing by the image processor comprising enhanced processing of a portion of the image plane of said forward facing image sensor that is spatially related to the location of the object present in the path of forward travel of the vehicle.

2. The forward facing sensing system of claim 1 , wherein said radar sensor comprises a phased array antenna, and wherein said radar sensor transmits at a frequency of at least 60 GHz.

3. The forward facing sensing system of claim 1 , wherein said radar sensor transmits at a frequency of at least 60 GHz.

4. The forward facing sensing system of claim 1 , wherein, responsive to said radar sensor sensing the object, said control enhances interrogation by said forward facing image sensor by directing the viewing direction of said forward facing image sensor.

5. The forward facing sensing system of claim 1 , wherein the object present in the path of forward travel of the vehicle comprises a person present in the path of forward travel of the vehicle.

6. The forward facing sensing system of claim 1 , wherein the object present in the path of forward travel of the vehicle comprises a deer present in the path of forward travel of the vehicle.

7. The forward facing sensing system of claim 1 , wherein said control enhances interrogation of the area at which the object is present via steering a radar beam formed by a phased array antenna of said radar sensor.

8. The forward facing sensing system of claim 1 , wherein said radar sensor comprises a phased array antenna.

9. The forward facing sensing system of claim 1 , wherein said control at least in part controls an adaptive cruise control system of the vehicle.

10. The forward facing sensing system of claim 1 , wherein said forward facing image sensor captures image data for an automatic headlamp control system of the vehicle and for a lane departure warning system of the vehicle.

11. A forward facing sensing system for a vehicle, the vehicle having a windshield, said forward facing sensing system comprising:

a radar sensor, wherein, with said radar sensor disposed at the vehicle, said radar sensor has a sensing direction forward of the vehicle;

a forward facing image sensor, wherein, with said forward facing image sensor disposed at the vehicle, said forward facing image sensor has a viewing direction forward of the vehicle;

wherein both said radar sensor and said image sensor are disposed within a windshield electronics module that is removably installed within the vehicle cabin at an upper region of the vehicle windshield and that is removable from the upper region of the vehicle windshield as a self-contained unit for service or replacement;

said radar sensor and said image sensor cooperating in a way that enhances the sensing capabilities of said forward facing sensing system to determine whether objects present in a path of forward travel of the vehicle are objects of interest;

a control responsive to an output of said radar sensor and responsive to an output of said forward facing image sensor; and

at least one selected from the group consisting of (a) responsive to said forward facing image sensor viewing an object present in the path of forward travel of the vehicle, said control enhances interrogation by said radar sensor of the viewed object and wherein the enhanced interrogation by said radar sensor comprises a digital beam forming technique, and (b) responsive to said radar sensor sensing an object present in the path of forward travel of the vehicle, said control enhances interrogation by said forward facing image sensor of the sensed object.

12. The forward facing sensing system of claim 11 , wherein, responsive to said forward facing image sensor viewing the object, the enhanced interrogation by said radar sensor comprises a digital beam forming technique, and wherein said radar sensor transmits at a frequency of at least 60 GHz.

13. The forward facing sensing system of claim 11 , wherein, responsive to said radar sensor sensing the object, said control enhances interrogation by said forward facing image sensor by at least one selected from the group consisting of (a) directing the viewing direction of said forward facing image sensor and (b) image processing of captured image data.

14. The forward facing sensing system of claim 11 , wherein enhanced interrogation by said forward facing image sensor is by image processing of captured image data.

15. The forward facing sensing system of claim 11 , wherein said radar sensor comprises a phased array antenna.

16. The forward facing sensing system of claim 11 , wherein said control is configured to at least in part control an adaptive cruise control system of the vehicle.

17. The forward facing sensing system of claim 11 , wherein, responsive to said radar sensor sensing the object, said control enhances interrogation by said forward facing image sensor by utilizing enhanced processing of a portion of an image plane of said forward facing image sensor that is spatially related to the location of the object present in the path of forward travel of the vehicle.

18. A forward facing sensing system for a vehicle, the vehicle having a windshield, said forward facing sensing system comprising:

a radar sensor, wherein, with said radar sensor disposed at the vehicle, said radar sensor has a sensing direction forward of the vehicle;

a forward facing image sensor, wherein, with said forward facing image sensor disposed at the vehicle, said forward facing image sensor has a viewing direction forward of the vehicle;

wherein both said radar sensor and said image sensor are disposed within a windshield electronics module that is removably installed within the vehicle cabin at an upper region of the vehicle windshield and that is removable from the upper region of the vehicle windshield as a self-contained unit for service or replacement;

said radar sensor and said image sensor cooperating in a way that enhances the sensing capabilities of said forward facing sensing system to determine whether objects present in a path of forward travel of the vehicle are objects of interest;

a control responsive to an output of said radar sensor and responsive to an output of said forward facing image sensor;

responsive to said forward facing image sensor viewing an object present in the path of forward travel of the vehicle and responsive to said radar sensor sensing the object present in the path of forward travel of the vehicle, said control enhances interrogation of an area in front of the vehicle at which the object is present to determine if the object is an object of interest causing a potentially hazardous condition;

wherein the object present in the path of forward travel of the vehicle comprises one selected from the group consisting of (i) another vehicle present in the path of forward travel of the vehicle, (ii) a person present in the path of forward travel of the vehicle and (iii) a deer present in the path of forward travel of the vehicle;

wherein said control enhances interrogation of the area at which the object is present via enhanced processing by an image processor of said control of image data captured by said forward facing image sensor at the area at which the object is present, the enhanced processing by the image processor comprising enhanced processing of a portion of the image plane of said forward facing image sensor that is spatially related to the location of the object present in the path of forward travel of the vehicle;

wherein said control at least in part controls an adaptive cruise control system of the vehicle; and

wherein said forward facing image sensor captures image data for an automatic headlamp control system of the vehicle and for a lane departure warning system of the vehicle.

19. The forward facing sensing system of claim 18 , wherein said radar sensor comprises a phased array antenna, and wherein said radar sensor transmits at a frequency of at least 60 GHz.

20. The forward facing sensing system of claim 18 , wherein said radar sensor transmits at a frequency of at least 60 GHz.

21. The forward facing sensing system of claim 18 , wherein, responsive to said radar sensor sensing the object, said control enhances interrogation by said forward facing image sensor by directing the viewing direction of said forward facing image sensor.

22. The forward facing sensing system of claim 18 , wherein the object present in the path of forward travel of the vehicle comprises a person present in the path of forward travel of the vehicle.

23. The forward facing sensing system of claim 18 , wherein the object present in the path of forward travel of the vehicle comprises a deer present in the path of forward travel of the vehicle.

24. The forward facing sensing system of claim 18 , wherein said control enhances interrogation of the area at which the object is present via steering a radar beam formed by a phased array antenna of said radar sensor.

25. The forward facing sensing system of claim 18 , wherein said radar sensor comprises a phased array antenna.

Continuity (12)
Continuation 16166333 · Oct 22, 2018
Continuation 15361746 · Nov 28, 2016
Continuation 15149338 · May 9, 2016
Continuation 15005092 · Jan 25, 2016
Continuation 14859683 · Sep 21, 2015
Continuation 14107624 · Dec 16, 2013
Division 13656975 · Oct 22, 2012
Continuation 13540856 · Jul 3, 2012
Continuation 13192525 · Jul 28, 2011
Continuation 12524446
Provisional Application 60886568 · Jan 25, 2007
Related Publication 20200292696A1 · Sep 17, 2020
Cited By (1)
US 12,258,025