IP Library Granted Patent US 10,462,426
Granted Patent B2
US 10,462,426 · App. 16/413,688 · Granted Oct 29, 2019

Vehicular control system

Inventors: Kenneth Schofield (Holland, MI); Niall R. Lynam (Holland, MI)
Assignee: MAGNA ELECTRONICS INC.
H04N7/183B60Q1/08B60Q9/008B60R1/00B60R1/001B60R1/12B60R11/04B60W30/143B60W30/18B60W50/14G06K9/00798G06K9/00805G06K9/00818G06K9/00825G06K9/209G06T7/20G08G1/166G08G1/167H04N5/2253H04N7/18B60K2370/148B60K2370/152B60K2370/21B60K2370/27B60K2370/331B60K2370/334B60K2370/52B60K2370/589B60K2370/777B60Q2300/42B60R1/04B60R2001/1215B60R2001/1253B60R2011/0026B60R2300/205B60R2300/207B60R2300/30B60R2300/301B60R2300/302B60R2300/804B60R2300/8093B60W50/16B60W2050/143B60W2050/146
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,462,426
App. No.
16/413,688
Granted
Oct 29, 2019
Kind
B2
Abstract

A vehicular control system includes a forward viewing camera disposed at an in-cabin side of a windshield of a vehicle and viewing forward of the vehicle. Road curvature of a road along which the vehicle is traveling is determined responsive at least in part to processing by an image processor of image data captured by the camera. Responsive at least in part to processing of captured image data, a traffic lane of the road along which the vehicle is traveling is determined. Responsive at least in part to processing of captured image data, another vehicle present on the road and forward of the vehicle may be detected. Responsive at least in part to processing of captured image data, the system may determine that the detected other vehicle is travelling in a traffic lane to the left of the traffic lane along which the vehicle is traveling.

Claims (97)

1. A vehicular control system, said vehicular control system comprising:

a forward viewing camera having a field of view forward of a vehicle equipped with said vehicular control system and in a direction of forward travel of the equipped vehicle, wherein said forward viewing camera is operable to capture image data;

wherein said forward viewing camera is disposed at an in-cabin side of a windshield of the equipped vehicle, said forward viewing camera viewing forward of the equipped vehicle through the windshield of the equipped vehicle;

an image processor operable to process image data captured by said forward viewing camera;

wherein road curvature of a road along which the equipped vehicle is traveling is determined responsive at least in part to processing by said image processor of image data captured by said forward viewing camera;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a traffic lane of the road along which the equipped vehicle is traveling is determined;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, another vehicle present on the road along which the equipped vehicle is traveling and forward of the equipped vehicle is detected;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, said vehicular control system determines that the detected other vehicle is travelling in a traffic lane to the left of the determined traffic lane along which the equipped vehicle is traveling;

wherein, during nighttime driving, a light beam emanating from a headlamp disposed at a left side front portion of the equipped vehicle is adjusted in a manner that limits directing beam light towards the detected other vehicle;

wherein adjustment of the light beam emanating from the headlamp disposed at the left side front portion of the equipped vehicle to limit directing beam light towards the detected other vehicle is independent of adjustment of a light beam emanating from a headlamp disposed at a right side front portion of the equipped vehicle; and

a display that displays information to a driver of the equipped vehicle responsive to processing of image data captured by said forward viewing camera.

2. The vehicular control system of claim 1 , wherein said forward viewing camera comprises a CMOS imaging array sensor and a lens.

3. The vehicular control system of claim 2 , wherein said forward viewing camera is housed in a windshield electronics module disposed at the windshield of the equipped vehicle.

4. The vehicular control system of claim 1 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a spectral characteristic of an object present in the forward field of view of said forward viewing camera is determined.

5. The vehicular control system of claim 1 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, location of an object present in the forward field of view of said forward viewing camera is determined.

6. The vehicular control system of claim 1 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a geometric shape of an object present in the forward field of view of said forward viewing camera is determined.

7. The vehicular control system of claim 1 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a road shoulder of the road along which the equipped vehicle is traveling is detected.

8. The vehicular control system of claim 1 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a curb of the road along which the equipped vehicle is traveling is detected.

9. The vehicular control system of claim 1 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, lane markers on the road along which the equipped vehicle is traveling are detected.

10. The vehicular control system of claim 1 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, speed of the equipped vehicle is controlled by a speed control system of the equipped vehicle for an adaptive cruise control system of the equipped vehicle.

11. The vehicular control system of claim 1 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a traffic sign is detected ahead of the equipped vehicle on the road being travelled by the equipped vehicle.

12. The vehicular control system of claim 11 , wherein the traffic sign comprises a speed control sign for a portion of the road being travelled by the equipped vehicle.

13. The vehicular control system of claim 12 , wherein a speed control system of the equipped vehicle controls speed of the equipped vehicle to be at or below a speed level indicated on the speed control sign.

14. The vehicular control system of claim 11 , wherein the traffic sign comprises a stop sign ahead of the equipped vehicle on the road the equipped vehicle is travelling along.

15. The vehicular control system of claim 1 , wherein the light beam emanating from the headlamp disposed at the left side front portion of the equipped vehicle comprises a high beam.

16. The vehicular control system of claim 1 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a character present in the forward field of view of said forward viewing camera is determined.

17. The vehicular control system of claim 16 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a road shoulder of the road along which the equipped vehicle is traveling is detected.

18. The vehicular control system of claim 16 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a curb of the road along which the equipped vehicle is traveling is detected.

19. The vehicular control system of claim 1 , wherein said forward viewing camera comprises a CMOS imaging array sensor and a lens, and wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, speed of the equipped vehicle is controlled by a speed control system of the equipped vehicle.

20. The vehicular control system of claim 19 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, lane markers on the road along which the equipped vehicle is traveling are detected and a curb of the road along which the equipped vehicle is traveling is detected and a road shoulder of the road along which the equipped vehicle is traveling is detected.

21. The vehicular control system of claim 19 , wherein said forward viewing camera is housed in a windshield electronics module disposed at the windshield of the equipped vehicle, said windshield electronics module housing said image processor.

22. The vehicular control system of claim 21 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, lane markers on the road along which the equipped vehicle is traveling are detected.

23. The vehicular control system of claim 1 , wherein the detected other vehicle travelling in a traffic lane to the left of the determined traffic lane along which the equipped vehicle is traveling is determined during nighttime to be an oncoming other vehicle at least in part via processing by said image processor of image data captured by said forward viewing camera detecting illuminated headlights of the other vehicle.

24. The vehicular control system of claim 1 , wherein the detected other vehicle travelling in a traffic lane to the left of the determined traffic lane along which the equipped vehicle is traveling is determined during nighttime to not be an oncoming other vehicle at least in part via processing by said image processor of image data captured by said forward viewing camera detecting illuminated taillights of the other vehicle.

25. A vehicular control system, said vehicular control system comprising:

a forward viewing camera having a field of view forward of a vehicle equipped with said vehicular control system and in a direction of forward travel of the equipped vehicle, wherein said forward viewing camera is operable to capture image data;

wherein said forward viewing camera is disposed at an in-cabin side of a windshield of the equipped vehicle, said forward viewing camera viewing forward of the equipped vehicle through the windshield of the equipped vehicle;

wherein said forward viewing camera is housed in a windshield electronics module;

wherein said forward viewing camera comprises a CMOS imaging array sensor and a lens;

an image processor operable to process image data captured by said forward viewing camera;

wherein road curvature of a road along which the equipped vehicle is traveling is determined responsive at least in part to processing by said image processor of image data captured by said forward viewing camera;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a traffic lane of the road along which the equipped vehicle is traveling is determined;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, another vehicle present on the road along which the equipped vehicle is traveling and forward of the equipped vehicle is detected;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, said vehicular control system determines that the detected other vehicle is travelling in a traffic lane to the left of the determined traffic lane along which the equipped vehicle is traveling;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, speed of the equipped vehicle is controlled by a speed control system of the equipped vehicle when the equipped vehicle is driving around a curve of the road along which the equipped vehicle is traveling; and

a display that displays information to a driver of the equipped vehicle responsive to processing of image data captured by said forward viewing camera.

26. The vehicular control system of claim 25 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a road shoulder of the road along which the equipped vehicle is traveling is detected.

27. The vehicular control system of claim 25 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a curb of the road along which the equipped vehicle is traveling is detected.

28. The vehicular control system of claim 25 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, lane markers on the road along which the equipped vehicle is traveling are detected.

29. The vehicular control system of claim 25 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, speed of the equipped vehicle is controlled by the speed control system of the equipped vehicle for an adaptive cruise control system of the equipped vehicle.

30. The vehicular control system of claim 25 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a traffic sign is detected ahead of the equipped vehicle on the road being travelled by the equipped vehicle.

31. The vehicular control system of claim 30 , wherein the traffic sign comprises a speed control sign for a portion of the road being travelled by the equipped vehicle.

32. The vehicular control system of claim 31 , wherein the speed control system of the equipped vehicle controls speed of the equipped vehicle to be at or below a speed level indicated on the speed control sign.

33. The vehicular control system of claim 30 , wherein the traffic sign comprises a stop sign ahead of the equipped vehicle on the road the equipped vehicle is travelling along.

34. The vehicular control system of claim 25 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a character present in the forward field of view of said forward viewing camera is determined.

35. The vehicular control system of claim 25 , wherein said windshield electronics module houses said image processor.

36. The vehicular control system of claim 35 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, lane markers on the road along which the equipped vehicle is traveling are detected and a curb of the road along which the equipped vehicle is traveling is detected and a road shoulder of the road along which the equipped vehicle is traveling is detected.

37. The vehicular control system of claim 25 , wherein, during nighttime driving, a light beam emanating from a headlamp disposed at a left side front portion of the equipped vehicle is adjusted in a manner that limits directing beam light towards the detected other vehicle.

38. The vehicular control system of claim 37 , wherein the detected other vehicle travelling in a traffic lane to the left of the determined traffic lane along which the equipped vehicle is traveling is determined during nighttime to be an oncoming other vehicle at least in part via processing by said image processor of image data captured by said forward viewing camera detecting illuminated headlights of the other vehicle.

39. The vehicular control system of claim 38 , wherein adjustment of the light beam emanating from the headlamp disposed at the left side front portion of the equipped vehicle to limit directing beam light towards the detected other vehicle is independent of adjustment of a light beam emanating from a headlamp disposed at a right side front portion of the equipped vehicle.

40. The vehicular control system of claim 38 , wherein the light beam emanating from the headlamp disposed at the left side front portion of the equipped vehicle comprises a high beam.

41. The vehicular control system of claim 37 , wherein the detected other vehicle travelling in a traffic lane to the left of the determined traffic lane along which the equipped vehicle is traveling is determined during nighttime to not be an oncoming other vehicle at least in part via processing by said image processor of image data captured by said forward viewing camera detecting illuminated taillights of the other vehicle.

42. The vehicular control system of claim 41 , wherein adjustment of the light beam emanating from the headlamp disposed at the left side front portion of the equipped vehicle to limit directing beam light towards the detected other vehicle is independent of adjustment of a light beam emanating from a headlamp disposed at a right side front portion of the equipped vehicle.

43. The vehicular control system of claim 41 , wherein the light beam emanating from the headlamp disposed at the left side front portion of the equipped vehicle comprises a high beam.

44. The vehicular control system of claim 25 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a spectral characteristic of an object present in the forward field of view of said forward viewing camera is determined.

45. The vehicular control system of claim 25 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, location of an object present in the forward field of view of said forward viewing camera is determined.

46. The vehicular control system of claim 25 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a geometric shape of an object present in the forward field of view of said forward viewing camera is determined.

47. A vehicular control system, said vehicular control system comprising:

a forward viewing camera having a field of view forward of a vehicle equipped with said vehicular control system and in a direction of forward travel of the equipped vehicle, wherein said forward viewing camera is operable to capture image data;

wherein said forward viewing camera is disposed at an in-cabin side of a windshield of the equipped vehicle, said forward viewing camera viewing forward of the equipped vehicle through the windshield of the equipped vehicle;

wherein said forward viewing camera is housed in a windshield electronics module;

wherein said forward viewing camera comprises a CMOS imaging array sensor and a lens;

an image processor operable to process image data captured by said forward viewing camera;

wherein said windshield electronics module houses said image processor;

wherein road curvature of a road along which the equipped vehicle is traveling is determined responsive at least in part to processing by said image processor of image data captured by said forward viewing camera;

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a traffic lane of the road along which the equipped vehicle is traveling is determined; and

wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a traffic sign is detected ahead of the equipped vehicle on the road being travelled by the equipped vehicle;

wherein the traffic sign comprises a speed control sign for a portion of the road being travelled by the equipped vehicle; and

a display that displays information to a driver of the equipped vehicle responsive to processing of image data captured by said forward viewing camera.

48. The vehicular control system of claim 47 , wherein a speed control system of the equipped vehicle controls speed of the equipped vehicle to be at or below a speed level indicated on the speed control sign.

49. The vehicular control system of claim 47 , wherein the traffic sign comprises a stop sign ahead of the equipped vehicle on the road the equipped vehicle is travelling along.

50. The vehicular control system of claim 47 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, another vehicle present on the road along which the equipped vehicle is traveling and forward of the equipped vehicle is detected.

51. The vehicular control system of claim 50 , wherein, during nighttime driving, a light beam emanating from a headlamp disposed at a left side front portion of the equipped vehicle is adjusted in a manner that limits directing beam light towards the detected other vehicle.

52. The vehicular control system of claim 51 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, said vehicular control system determines that the detected other vehicle is travelling in a traffic lane to the left of the determined traffic lane along which the equipped vehicle is traveling.

53. The vehicular control system of claim 52 , wherein the detected other vehicle travelling in the traffic lane to the left of the determined traffic lane along which the equipped vehicle is traveling is determined during nighttime to be an oncoming other vehicle at least in part via processing by said image processor of image data captured by said forward viewing camera detecting illuminated headlights of the other vehicle.

54. The vehicular control system of claim 53 , wherein adjustment of the light beam emanating from the headlamp disposed at the left side front portion of the equipped vehicle to limit directing beam light towards the detected other vehicle is independent of adjustment of a light beam emanating from a headlamp disposed at a right side front portion of the equipped vehicle.

55. The vehicular control system of claim 53 , wherein the light beam emanating from the headlamp disposed at the left side front portion of the equipped vehicle comprises a high beam.

56. The vehicular control system of claim 51 , wherein the detected other vehicle travelling in the traffic lane to the left of the determined traffic lane along which the equipped vehicle is traveling is determined during nighttime to not be an oncoming other vehicle at least in part via processing by said image processor of image data captured by said forward viewing camera detecting illuminated taillights of the other vehicle.

57. The vehicular control system of claim 56 , wherein adjustment of the light beam emanating from the headlamp disposed at the left side front portion of the equipped vehicle to limit directing beam light towards the detected other vehicle is independent of adjustment of a light beam emanating from a headlamp disposed at a right side front portion of the equipped vehicle.

58. The vehicular control system of claim 56 , wherein the light beam emanating from the headlamp disposed at the left side front portion of the equipped vehicle comprises a high beam.

59. The vehicular control system of claim 47 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a spectral characteristic of an object present in the forward field of view of said forward viewing camera is determined.

60. The vehicular control system of claim 47 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, location of an object present in the forward field of view of said forward viewing camera is determined.

61. The vehicular control system of claim 47 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a road shoulder of the road along which the equipped vehicle is traveling is detected.

62. The vehicular control system of claim 47 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, a curb of the road along which the equipped vehicle is traveling is detected.

63. The vehicular control system of claim 47 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, lane markers on the road along which the equipped vehicle is traveling are detected.

64. The vehicular control system of claim 47 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, lane markers on the road along which the equipped vehicle is traveling are detected and a curb of the road along which the equipped vehicle is traveling is detected and a road shoulder of the road along which the equipped vehicle is traveling is detected.

65. The vehicular control system of claim 47 , wherein, responsive at least in part to processing by said image processor of image data captured by said forward viewing camera, speed of the equipped vehicle is controlled by a speed control system of the equipped vehicle for an adaptive cruise control system of the equipped vehicle.

Continuity (24)
Continuation 16252870 · Jan 21, 2019
Continuation 16166338 · Oct 22, 2018
Continuation 16025023 · Jul 2, 2018
Continuation 15953648 · Apr 16, 2018
Continuation 15675921 · Aug 14, 2017
Continuation 15463296 · Mar 20, 2017
Continuation 15249557 · Aug 29, 2016
Continuation 14942089 · Nov 16, 2015
Continuation 14678146 · Apr 3, 2015
Continuation 14467296 · Aug 25, 2014
Continuation 14082577 · Nov 18, 2013
Continuation 13689796 · Nov 30, 2012
Continuation 13335125 · Dec 22, 2011
Continuation 13107318 · May 13, 2011
Continuation 12979499 · Dec 28, 2010
Continuation 12856737 · Aug 16, 2010
Continuation 12606476 · Oct 27, 2009
Continuation 12429605 · Apr 24, 2009
Continuation 11105757 · Apr 14, 2005
Provisional Application 60644903 · Jan 19, 2005
Provisional Application 60642227 · Jan 7, 2005
Provisional Application 60607963 · Sep 8, 2004
Provisional Application 60562480 · Apr 15, 2004
Related Publication 20190273896A1 · Sep 5, 2019
Cited By (6)
US 12,190,728 US 12,423,755 US 12,444,095 US 12,614,235 US 12,643,404 US 12,700,308