IP Library Granted Patent US 9,019,090
Granted Patent B2
US 9,019,090 · App. 12/405,558 · Granted Apr 28, 2015

Vision system for vehicle

Inventors: Andrew D. Weller (Holland, MI); Mark L. Larson (Grand Haven, MI); Ian A. McCabe (Holland, MI); Niall R. Lynam (Holland, MI); Rodney K. Blank (Zeeland, MI); Joseph P. McCaw (Lawrence, MI); John T. Uken (Jenison, MI)
Assignee: Magna Electronics Inc.
B60R1/12B60R2001/1215B60R2001/1223B60R2001/1253G02F1/133308G02F1/133385G02F1/157G02F2201/44G02F2203/09
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,019,090
App. No.
12/405,558
Granted
Apr 28, 2015
Kind
B2
Abstract

A vision system for a vehicle includes at least a first imager, an image processor, and at least a second imager. The first imager has a field of view through the windshield of the vehicle in the direction of forward travel of the vehicle. The second imager captures video images of a scene occurring exteriorly and rearwardly of the vehicle. When the vehicle is executing a reversing maneuver, the image processor processes image data captured by the second imager to detect objects in the exterior scene to assist the driver in reversing the vehicle, and when the vehicle is traveling forward, the image processor and the first imager are part of at least one of (i) a headlamp control system of the vehicle, (ii) a rain sensing system of the vehicle, (iii) a lane departure warning system of the vehicle and (iv) a traffic sign recognition system of the vehicle.

Claims (66)

1. A vision system for a vehicle, said vision system comprising:

at least a first imager located at or near a windshield of a vehicle, said first imager having a field of view through the windshield of the vehicle in the direction of forward travel of the vehicle, said first imager operable to capture first image data of a scene occurring exteriorly and forwardly of the windshield when the vehicle normally travels forwardly;

at least a second imager located at the rear of the vehicle, said second imager having a field of view rearward of the vehicle, said second imager operable to capture second image data of a scene occurring exteriorly and rearwardly of the vehicle when the vehicle normally travels rearwardly;

a common image processor operable for processing said first image data captured by said first imager and operable for processing said second image data captured by said second imager, wherein said common image processor utilizes object detection software to process said first and second image data;

a video display screen in the vehicle viewable by a driver of the vehicle when reversing the vehicle;

wherein, responsive to the vehicle being shifted into a reverse gear and while the driver of the vehicle is executing a reversing maneuver, (a) video images captured by said second imager are displayed on said video display screen that is viewable by the driver of the vehicle, (b) said common image processor utilizes said object detection software to process said second image data captured by said second imager to detect objects in the exterior scene to assist the driver in reversing the vehicle and wherein said assistance at least comprises alerting the driver of the vehicle to the presence of a detected object in the exterior rearward scene, and (c) said common image processor does not process said first image data captured by said first imager; and

wherein, responsive to the vehicle not being shifted into the reverse gear and traveling forward, (a) said video display screen does not display video images captured by said first imager, (b) said common image processor utilizes said object detection software to process said first image data captured by said first imager, said common image processor processing said first image data for at least one of (i) a headlamp control system of the vehicle, (ii) a rain sensing system of the vehicle, (iii) a lane departure warning system of the vehicle and (iv) a traffic sign recognition system of the vehicle, and (c) said common image processor does not process said second image data captured by said second imager.

2. The vision system of claim 1 , wherein said first imager is located at or near an interior rearview mirror assembly of the vehicle.

3. The vision system of claim 2 , wherein said first imager is located in said interior rearview mirror assembly and is accommodated at or by a mounting portion of said interior rearview mirror assembly.

4. The vision system of claim 3 , wherein said common image processor is located in said interior rearview mirror assembly.

5. The vision system of claim 1 , wherein said first imager is accommodated by an accessory module disposed at the windshield of the vehicle.

6. The vision system of claim 5 , wherein said common image processor is accommodated by said accessory module.

7. The vision system of claim 1 , wherein said common image processor is located at or near the windshield of the vehicle.

8. The vision system of claim 1 , wherein, responsive to the vehicle not being shifted into the reverse gear and traveling forward, said common image processor processes said first image data for at least two of (i) the headlamp control system of the vehicle, (ii) the rain sensing system of the vehicle, (iii) the lane departure warning system of the vehicle and (iv) the traffic sign recognition system of the vehicle.

9. The vision system of claim 8 , wherein display by said video display screen of video images captured by said second imager ceases when the reversing maneuver of the vehicle is completed in order to cease display to the driver of video images captured by said second imager.

10. The vision system of claim 8 , wherein said video display screen is disposed in an interior rearview mirror assembly of the vehicle and wherein video images displayed by said video display screen are viewable through a mirror reflector of a reflective element of said interior rearview mirror assembly by the driver of the vehicle when the driver is operating the vehicle.

11. The vision system of claim 10 , wherein said video display screen is part of a video display unit and wherein said vision system further comprises a thermally conductive element in thermal contact with an element of said video display unit, wherein said thermally conductive element at least partially draws heat generated by said video display unit during operation of said video display unit to draw heat away from said video display unit.

12. The vision system of claim 11 , wherein said thermally conductive element comprises a thermally conductive polymeric material.

13. The vision system of claim 11 , wherein said thermally conductive element is disposed at a rear casing portion of said interior rearview mirror assembly and is formed so as to be at least partially hidden from view at said rear casing portion, said thermally conductive element being at least one of molded, contoured, painted and coated to reduce the discernibility of said thermally conductive element at said rear casing portion.

14. The vision system of claim 10 , wherein said reflective element of said interior rearview mirror assembly comprises an electro-optic reflective element having a front substrate and a rear substrate and an electro-optic medium disposed between said front and rear substrates, and wherein said mirror reflector comprises a transflective mirror reflector disposed at a front surface of said rear substrate that opposes said electro-optic medium.

15. The vision system of claim 14 further comprising a transflective polarizing element disposed at a rear of said electro-optic reflective element and between said video display screen and said electro-optic reflective element, wherein said transflective polarizing element is disposed only at a display area in front of said video display screen, and wherein a surrounding non-display area of said rear of said electro-optic reflective element has a reflective layer disposed thereat.

16. The vision system of claim 1 , wherein said video display screen is operated as part of a voice interaction system of the vehicle, said voice interaction system including an artificially generated human voice for providing information to the driver of the vehicle, said artificially generated human voice being selectively generated with a regional accent that is determined by the actual geographic location of the vehicle as determined by a vehicle-based navigational system.

17. The vision system of claim 1 , wherein said video display screen comprises a backlit pixelated video display screen.

18. The vision system of claim 17 further comprising a reflective polarizer disposed in front of said video display screen.

19. The vision system of claim 1 , wherein, responsive to the vehicle not being shifted into the reverse gear and traveling forward, said common image processor processes said first image data for the headlamp control system of the vehicle.

20. The vision system of claim 1 , wherein, responsive to the vehicle not being shifted into the reverse gear and traveling forward, said common image processor processes said first image data for (i) the headlamp control system of the vehicle and (ii) the lane departure warning system of the vehicle.

21. The vision system of claim 1 , wherein, responsive to the vehicle not being shifted into the reverse gear and traveling forward, said common image processor processes said first image data for (i) the headlamp control system of the vehicle, (ii) the lane departure warning system of the vehicle and (iii) the traffic sign recognition system of the vehicle.

22. A vision system for a vehicle, said vision system comprising:

an accessory module disposed at or near a windshield of the vehicle;

at least a first imager accommodated by said accessory module, said first imager having a field of view through the windshield of the vehicle in the direction of forward travel of the vehicle, said first imager operable to capture first image data of a scene occurring exteriorly and forwardly of the windshield when the vehicle normally travels forwardly;

at least a second imager located at the rear of the vehicle, said second imager having a field of view rearward of the vehicle, said second imager operable to capture second image data of a scene occurring exteriorly and rearwardly of the vehicle when the vehicle normally travels rearwardly;

a common image processor operable for processing said first image data captured by said first imager and operable for processing said second image data captured by said second imager, wherein said common image processor utilizes object detection software to process said first and second image data;

a video display screen in the vehicle viewable by a driver of the vehicle when reversing the vehicle;

wherein, responsive to the vehicle being shifted into a reverse gear and while the driver of the vehicle is executing a reversing maneuver, (a) video images captured by said second imager are displayed on said video display screen that is viewable by the driver of the vehicle, (b) said common image processor utilizes said object detection software to process said second image data captured by said second imager to detect objects in the exterior scene to assist the driver in reversing the vehicle and wherein said assistance at least comprises alerting the driver of the vehicle to the presence of a detected object in the exterior rearward scene, and (c) said common image processor does not process said first image data captured by said first imager; and

wherein, responsive to the vehicle not being shifted into the reverse gear and traveling forward, (a) said video display screen does not display video images captured by said first imager, (b) said common image processor utilizes said object detection software to process said first image data captured by said first imager, said common image processor processing said first image data for at least one of (i) a headlamp control system of the vehicle, (ii) a rain sensing system of the vehicle, (iii) a lane departure warning system of the vehicle and (iv) a traffic sign recognition system of the vehicle, and (c) said common image processor does not process said second image data captured by said second imager.

23. The vision system of claim 22 , wherein said common image processor is accommodated by said accessory module.

24. The vision system of claim 23 , wherein display by said video display screen of video images captured by said second imager ceases when the reversing maneuver of the vehicle is completed in order to cease display to the driver of video images captured by said second imager.

25. The vision system of claim 23 , wherein, responsive to the vehicle not being shifted into the reverse gear and traveling forward, said common image processor processes said first image data for the headlamp control system of the vehicle.

26. The vision system of claim 23 , wherein, responsive to the vehicle not being shifted into the reverse gear and traveling forward, said common image processor processes said first image data for (i) the headlamp control system of the vehicle and (ii) the lane departure warning system of the vehicle.

27. The vision system of claim 23 , wherein, responsive to the vehicle not being shifted into the reverse gear and traveling forward, said common image processor processes said first image data for (i) the headlamp control system of the vehicle, (ii) the lane departure warning system of the vehicle and (iii) the traffic sign recognition system of the vehicle.

28. A vision system for a vehicle, said vision system comprising:

an interior rearview mirror assembly disposed at or near a windshield of the vehicle, wherein said interior rearview mirror assembly comprises an electro-optic reflective element having a front substrate and a rear substrate and an electro-optic medium disposed between said front and rear substrates, and wherein said rear substrate has a mirror reflector disposed at a surface thereof;

at least a first imager accommodated at or by said interior rearview mirror assembly, said first imager having a field of view through the windshield of the vehicle in the direction of forward travel of the vehicle, said first imager operable to capture first image data of a scene occurring exteriorly and forwardly of the windshield when the vehicle normally travels forwardly;

at least a second imager located at the rear of the vehicle, said second imager having a field of view rearward of the vehicle, said second imager operable to capture second image data of a scene occurring exteriorly and rearwardly of the vehicle when the vehicle normally travels rearwardly;

a common image processor operable for processing said first image data captured by said first imager and operable for processing said second image data captured by said second imager, wherein said common image processor utilizes object detection software to process said first and second image data;

a video display screen in the vehicle viewable by a driver of the vehicle when reversing the vehicle, said video display screen operable for displaying video images captured by said second imager;

wherein, responsive to the vehicle being shifted into a reverse gear and while the driver of the vehicle is executing a reversing maneuver, (a) said common image processor utilizes said object detection software to process said second image data captured by said second imager to detect objects in the exterior scene to assist the driver in reversing the vehicle, (b) said video display screen displays video images captured by said second imager to provide reverse aid information to the driver of the vehicle when the driver is executing the reversing maneuver to assist the driver in reversing the vehicle and wherein said assistance at least comprises alerting the driver of the vehicle to the presence of a detected object in the exterior rearward scene, and (c) said common image processor does not process said first image data captured by said first imager; and

wherein, responsive to the vehicle not being shifted into the reverse gear and traveling forward, (a) said video display screen does not display video images captured by said first imager, (b) said common image processor utilizes said object detection software to process said first image data captured by said first imager, said common image processor processing said first image data for at least one of (i) a headlamp control system of the vehicle, (ii) a rain sensing system of the vehicle, (iii) a lane departure warning system of the vehicle and (iv) a traffic sign recognition system of the vehicle, and (c) said common image processor does not process said second image data captured by said second imager.

29. The vision system of claim 28 , wherein said video display screen is disposed in said interior rearview mirror assembly and wherein said mirror reflector comprises a transflective mirror reflector, and wherein video images displayed by said video display screen are viewable through said transflective mirror reflector of said electro-optic reflective element of said interior rearview mirror assembly by the driver of the vehicle when the driver is operating the vehicle.

30. The vision system of claim 29 , wherein display by said video display screen of video images captured by said second imager ceases when the reversing maneuver of the vehicle is completed in order to cease display to the driver of video images captured by said second imager.

31. The vision system of claim 28 , wherein, responsive to the vehicle not being shifted into the reverse gear and traveling forward, said common image processor processes said first image data for the headlamp control system of the vehicle.

32. The vision system of claim 28 , wherein, responsive to the vehicle not being shifted into the reverse gear and traveling forward, said common image processor processes said first image data for (i) the headlamp control system of the vehicle and (ii) the lane departure warning system of the vehicle.

33. The vision system of claim 28 , wherein, responsive to the vehicle not being shifted into the reverse gear and traveling forward, said common image processor processes said first image data for (i) the headlamp control system of the vehicle, (ii) the lane departure warning system of the vehicle and (iii) the traffic sign recognition system of the vehicle.

34. A vision system for a vehicle, said vision system comprising:

at least a first imager having a field of view through a windshield of the vehicle in the direction of forward travel of the vehicle, said first imager operable to capture first image data of a scene occurring exteriorly and forwardly of the windshield when the vehicle normally travels forwardly;

at least a second imager located at the rear of the vehicle, said second imager having a field of view rearward of the vehicle, said second imager operable to capture second image data of a scene occurring exteriorly and rearwardly of the vehicle when the vehicle normally travels rearwardly;

a common image processor operable for processing said first image data captured by said first imager and operable for processing said second image data captured by said second imager, wherein said common image processor utilizes object detection software to process said first and second image data;

a video display screen in the vehicle viewable by a driver of the vehicle when the driver is executing a reversing maneuver, wherein said video display screen is operable for displaying video images captured by said second imager to provide reverse aid information to the driver of the vehicle when the driver is executing a reversing maneuver;

wherein said first imager and said common image processor are located at or near the windshield of the vehicle;

wherein, responsive to the vehicle being shifted into a reverse gear and while the driver of the vehicle is executing a reversing maneuver, (a) video images captured by said second imager are displayed on said video display screen, (b) said common image processor utilizes said object detection software to process said second image data captured by said second imager to detect objects in the exterior scene to assist the driver in reversing the vehicle and wherein said assistance at least comprises alerting the driver of the vehicle to the presence of a detected object in the exterior rearward scene, and (c) said common image processor does not process said first image data captured by said first imager;

wherein display by said video display screen of video images captured by said second imager ceases when the reversing maneuver of the vehicle is completed in order to cease display to the driver of video images captured by said second imager; and

wherein, responsive to the vehicle not being shifted into the reverse gear and traveling forward, (a) said video display screen does not display video images captured by said first imager, (b) said common image processor utilizes said object detection software to process said first image data captured by said first imager, said common image processor processing said first image data for at least one of (i) a headlamp control system of the vehicle, (ii) a rain sensing system of the vehicle, (iii) a lane departure warning system of the vehicle and (iv) a traffic sign recognition system of the vehicle, and (c) said common image processor does not process said second image data captured by second first imager.

35. The vision system of claim 34 , wherein said first imager and said common image processor are accommodated by one of (a) an accessory module disposed at or near the windshield of the vehicle and (b) an interior rearview mirror assembly disposed at or near the windshield of the vehicle.

36. The vision system of claim 34 , wherein said first imager and said common image processor are accommodated by an interior rearview mirror assembly of the vehicle and wherein said first imager is accommodated at or by a mounting portion of said interior rearview mirror assembly.

37. The vision system of claim 36 , wherein said video display screen is disposed in said interior rearview mirror assembly and wherein video images displayed by said video display screen are viewable through a transflective mirror reflector of a reflective element of said interior rearview mirror assembly by the driver of the vehicle when the driver is operating the vehicle.

38. The vision system of claim 34 , wherein said first imager and said common image processor are accommodated by an accessory module disposed at or near the windshield of the vehicle.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2015
From: WELLER, ANDREW D.; LARSON, MARK L.; MCCABE, IAN A.; LYNAM, NIALL R.; BLANK, RODNEY K.; MCCAW, JOSEPH P.; UKEN, JOHN T.
To: DONNELLY CORPORATION
Reel/Frame 035190/0603 →
CHANGE OF NAME Recorded Mar 18, 2015
From: DONNELLY CORPORATION
To: MAGNA DONNELLY CORPORATION
Reel/Frame 035190/0613 →
CHANGE OF NAME Recorded Mar 18, 2015
From: MAGNA DONNELLY CORPORATION
To: MAGNA MIRRORS OF AMERICA, INC.
Reel/Frame 035190/0641 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2015
From: MAGNA MIRRORS OF AMERICA, INC.
To: MAGNA ELECTRONICS INC.
Reel/Frame 035190/0656 →
Continuity (30)
Continuation 12091525
Continuation In Part 11935800 · Nov 6, 2007
Continuation 11624381 · Jan 18, 2007
Continuation 10645762 · Aug 20, 2003
Continuation In Part 10456599 · Jun 6, 2003
Continuation In Part 10287178 · Nov 4, 2002
Continuation 09799414 · Mar 5, 2001
Continuation In Part 10755915 · Jan 13, 2004
Continuation 09793002 · Feb 26, 2001
Continuation In Part 10054633 · Jan 22, 2002
Continuation In Part 09793002 · Feb 26, 2001
Provisional Application 60732245 · Nov 1, 2005
Provisional Application 60759992 · Jan 18, 2006
Provisional Application 60836219 · Aug 8, 2006
Provisional Application 60406166 · Aug 27, 2002
Provisional Application 60405392 · Aug 23, 2002
Provisional Application 60404906 · Aug 21, 2002
Provisional Application 60187960 · Mar 9, 2000
Provisional Application 60263680 · Jan 23, 2001
Provisional Application 60243986 · Oct 27, 2000
Provisional Application 60238483 · Oct 6, 2000
Provisional Application 60237077 · Sep 30, 2000
Provisional Application 60234412 · Sep 21, 2000
Provisional Application 60218336 · Jul 14, 2000
Provisional Application 60186520 · Mar 2, 2000
Provisional Application 60346733 · Jan 7, 2002
Provisional Application 60263680 · Jan 23, 2001
Provisional Application 60271466 · Feb 26, 2001
Provisional Application 60315384 · Aug 28, 2001
Related Publication 20090201137A1 · Aug 13, 2009