IP Library Granted Patent US 11,847,836
Granted Patent B2
US 11,847,836 · App. 18/054,968 · Granted Dec 19, 2023

Vehicular control system with road curvature determination

Inventors: Kenneth Schofield (Holland, MI); Niall R. Lynam (Holland, MI)
Assignee: MAGNA ELECTRONICS INC.
G06V20/582B60Q1/08B60Q9/008B60R1/00B60R1/001B60R1/12B60R11/04B60W30/143B60W30/18B60W50/14G06T7/20G06V10/147G06V20/58G06V20/584G06V20/588G08G1/166G08G1/167H04N7/18H04N7/183H04N23/54B60K2370/143B60K2370/148B60K2370/152B60K2370/21B60K2370/27B60K2370/331B60K2370/334B60K2370/34B60K2370/52B60K2370/589B60K2370/777B60Q2300/42B60R1/04B60R2001/1215B60R2001/1253B60R2011/0026B60R2300/205B60R2300/207B60R2300/30B60R2300/301B60R2300/302B60R2300/804B60R2300/8093B60W50/16B60W2050/143B60W2050/146
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,847,836
App. No.
18/054,968
Granted
Dec 19, 2023
Kind
B2
Abstract

A vehicular control system includes a forward viewing camera disposed at an in-cabin side of a windshield of a vehicle and viewing forward of the vehicle. Road curvature of a road along which the vehicle is traveling is determined responsive at least in part to processing of image data captured by the camera. Responsive at least in part to processing of captured image data, speed of the vehicle is controlled by an adaptive cruise control system of the vehicle. Upon approach of the vehicle to a curve in the road along which the vehicle is traveling, speed of the vehicle is reduced by the adaptive cruise control system to a reduced speed for traveling around the curve in the road. Speed of the vehicle is increased by the adaptive cruise control system when the vehicle is traveling along a straighter section of road after the curve in the road.

Claims (95)

1. A vehicular control system, the vehicular control system comprising:

a forward viewing camera disposed at an in-cabin side of a windshield of a vehicle equipped with the vehicular control system, the forward viewing camera viewing forward of the equipped vehicle through the windshield of the equipped vehicle and in a direction of forward travel of the equipped vehicle, wherein the forward viewing camera is operable to capture image data;

wherein the forward viewing camera comprises a complementary metal-oxide semiconductor (CMOS) imaging array sensor;

an image processor operable to process image data captured by the forward viewing camera;

wherein road curvature of a road along which the equipped vehicle is traveling is determined responsive at least in part to processing by the image processor of image data captured by the forward viewing camera;

wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, lane markers on the road along which the equipped vehicle is traveling are detected;

wherein, responsive at least in part to detection of lane markers on the road, a traffic lane along which the equipped vehicle is traveling is determined;

wherein speed of the equipped vehicle is controlled by an adaptive cruise control system of the equipped vehicle;

wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, another vehicle that is present on the road along which the equipped vehicle is traveling and forward of the equipped vehicle is detected;

wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, speed of the equipped vehicle is controlled by the adaptive cruise control system of the equipped vehicle;

wherein, upon approach of the equipped vehicle to a curve in the road along which the equipped vehicle is traveling, speed of the equipped vehicle is reduced by the adaptive cruise control system to a reduced speed for traveling around the curve in the road at least in part responsive to at least one selected from the group consisting of (a) processing by the image processor of image data captured by the forward viewing camera and (b) data relevant to a current geographical location of the equipped vehicle;

wherein speed of the equipped vehicle is increased by the adaptive cruise control system of the equipped vehicle when the equipped vehicle is traveling along a straighter section of road after the curve in the road;

wherein the forward viewing camera captures image data for a plurality of driving assist systems of the equipped vehicle, and wherein the plurality of driving assist systems includes a lane departure warning system of the equipped vehicle, and wherein the plurality of driving assist systems further includes at least one selected from the group consisting of (i) a traffic sign recognition system of the equipped vehicle and (ii) an intelligent headlamp control system of the equipped vehicle;

wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, the vehicular control system determines whether the detected other vehicle is in a traffic lane to the right of the determined traffic lane along which the equipped vehicle is traveling or is in a traffic lane to the left of the determined traffic lane along which the equipped vehicle is traveling; and

wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, the vehicular control system determines that the detected other vehicle is traveling in a traffic lane to the left of the determined traffic lane along which the equipped vehicle is traveling and is an oncoming vehicle.

2. The vehicular control system of claim 1 , wherein the forward viewing camera is housed in a windshield electronics module disposed at the windshield of the equipped vehicle.

3. The vehicular control system of claim 2 , wherein the windshield electronics module houses the image processor.

4. The vehicular control system of claim 1 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a spectral characteristic of an object that is present forward of the vehicle is determined.

5. The vehicular control system of claim 1 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a curb of the road along which the equipped vehicle is traveling is detected.

6. The vehicular control system of claim 1 , wherein the plurality of driving assist systems includes the traffic sign recognition system of the equipped vehicle, and wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a traffic sign ahead of the equipped vehicle is recognized.

7. The vehicular control system of claim 6 , wherein the traffic sign comprises a speed control sign for a portion of the road being travelled by the equipped vehicle.

8. The vehicular control system of claim 7 , wherein the adaptive cruise control system of the equipped vehicle controls speed of the equipped vehicle to be at or below a speed level indicated on the speed control sign.

9. The vehicular control system of claim 6 , wherein the traffic sign comprises a stop sign ahead of the equipped vehicle.

10. The vehicular control system of claim 6 , wherein the traffic sign comprises a road construction zone sign.

11. The vehicular control system of claim 10 , wherein a driver of the equipped vehicle is alerted that the road construction zone sign is recognized.

12. The vehicular control system of claim 6 , wherein the traffic sign comprises a warning sign present exterior of the equipped vehicle.

13. The vehicular control system of claim 6 , wherein the traffic sign comprises at least one selected from the group consisting of (i) a speed limit sign present exterior of the equipped vehicle, (ii) a freeway exit sign present exterior of the equipped vehicle, (iii) a warning sign present exterior of the equipped vehicle, (iv) a stop sign present exterior of the equipped vehicle and (v) a yield sign present exterior of the equipped vehicle.

14. The vehicular control system of claim 1 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a character of a traffic sign present forward of the vehicle is determined.

15. The vehicular control system of claim 1 , wherein, upon approach of the equipped vehicle to the curve in the road along which the equipped vehicle is traveling, speed of the equipped vehicle is reduced by the adaptive cruise control system to the reduced speed for traveling around the curve in the road at least in part responsive to data relevant to a current geographical location of the equipped vehicle, and wherein the current geographical location of the equipped vehicle is determined by a global positioning system.

16. The vehicular control system of claim 1 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a road shoulder of the road along which the equipped vehicle is traveling is detected.

17. The vehicular control system of claim 1 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, at least one selected from the group consisting of (a) a spectral characteristic of an object present forward of the vehicle is determined, (b) a spatial characteristic of an object present forward of the vehicle is determined, (c) size of an object present forward of the vehicle and (d) location of an object present forward of the vehicle relative to the road along which the equipped vehicle is traveling is determined.

18. The vehicular control system of claim 1 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, location of an object that is present forward of the vehicle is determined.

19. A vehicular control system, the vehicular control system comprising:

a forward viewing camera disposed at an in-cabin side of a windshield of a vehicle equipped with the vehicular control system, the forward viewing camera viewing forward of the equipped vehicle through the windshield of the equipped vehicle and in a direction of forward travel of the equipped vehicle, wherein the forward viewing camera is operable to capture image data;

wherein the forward viewing camera comprises a complementary metal-oxide semiconductor (CMOS) imaging array sensor;

an image processor operable to process image data captured by the forward viewing camera;

wherein road curvature of a road along which the equipped vehicle is traveling is determined responsive at least in part to processing by the image processor of image data captured by the forward viewing camera;

wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, lane markers on the road along which the equipped vehicle is traveling are detected;

wherein, responsive at least in part to detection of lane markers on the road, a traffic lane along which the equipped vehicle is traveling is determined;

wherein speed of the equipped vehicle is controlled by an adaptive cruise control system of the equipped vehicle;

wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a pedestrian that is present on the road along which the equipped vehicle is traveling and forward of the equipped vehicle is detected;

wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, speed of the equipped vehicle is controlled by the adaptive cruise control system of the equipped vehicle;

wherein, upon approach of the equipped vehicle to a curve in the road along which the equipped vehicle is traveling, speed of the equipped vehicle is reduced by the adaptive cruise control system to a reduced speed for traveling around the curve in the road at least in part responsive to processing by the image processor of image data captured by the forward viewing camera;

wherein speed of the equipped vehicle is increased by the adaptive cruise control system of the equipped vehicle when the equipped vehicle is traveling along a straighter section of road after the curve in the road;

wherein the forward viewing camera captures image data for a plurality of driving assist systems of the equipped vehicle, and wherein the plurality of driving assist systems includes an intelligent headlamp control system of the equipped vehicle, and wherein the plurality of driving assist systems further includes at least one selected from the group consisting of (i) a traffic sign recognition system of the equipped vehicle and (ii) a lane departure warning system of the equipped vehicle;

wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, the vehicular control system (i) detects another vehicle that is present on the road along which the equipped vehicle is traveling and forward of the equipped vehicle, and (ii) determines whether the detected other vehicle is in a traffic lane to the right of the determined traffic lane along which the equipped vehicle is traveling or is in a traffic lane to the left of the determined traffic lane along which the equipped vehicle is traveling; and

wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, the vehicular control system determines that the detected other vehicle is traveling in a traffic lane to the left of the determined traffic lane along which the equipped vehicle is traveling and is an oncoming vehicle.

20. The vehicular control system of claim 19 , wherein the forward viewing camera is housed in a windshield electronics module disposed at the windshield of the equipped vehicle.

21. The vehicular control system of claim 20 , wherein the windshield electronics module houses the image processor.

22. The vehicular control system of claim 19 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a spectral characteristic of an object that is present forward of the vehicle is determined.

23. The vehicular control system of claim 19 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a curb of the road along which the equipped vehicle is traveling is detected.

24. The vehicular control system of claim 19 , wherein the plurality of driving assist systems includes the traffic sign recognition system of the equipped vehicle, and wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a traffic sign ahead of the equipped vehicle is recognized.

25. The vehicular control system of claim 24 , wherein the traffic sign comprises a speed control sign for a portion of the road being travelled by the equipped vehicle.

26. The vehicular control system of claim 25 , wherein the adaptive cruise control system of the equipped vehicle controls speed of the equipped vehicle to be at or below a speed level indicated on the speed control sign.

27. The vehicular control system of claim 24 , wherein the traffic sign comprises a stop sign ahead of the equipped vehicle.

28. The vehicular control system of claim 24 , wherein the traffic sign comprises a road construction zone sign.

29. The vehicular control system of claim 28 , wherein a driver of the equipped vehicle is alerted that the road construction zone sign is recognized.

30. The vehicular control system of claim 24 , wherein the traffic sign comprises a warning sign present exterior of the equipped vehicle.

31. The vehicular control system of claim 24 , wherein the traffic sign comprises at least one selected from the group consisting of (i) a speed limit sign present exterior of the equipped vehicle, (ii) a freeway exit sign present exterior of the equipped vehicle, (iii) a warning sign present exterior of the equipped vehicle, (iv) a stop sign present exterior of the equipped vehicle and (v) a yield sign present exterior of the equipped vehicle.

32. The vehicular control system of claim 19 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a character of a traffic sign present forward of the vehicle is determined.

33. The vehicular control system of claim 19 , wherein, upon approach of the equipped vehicle to the curve in the road along which the equipped vehicle is traveling, speed of the equipped vehicle is reduced by the adaptive cruise control system to the reduced speed for traveling around the curve in the road in part responsive to data relevant to a current geographical location of the equipped vehicle, and wherein the current geographical location of the equipped vehicle is determined by a global positioning system.

34. The vehicular control system of claim 19 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a road shoulder of the road along which the equipped vehicle is traveling is detected.

35. The vehicular control system of claim 19 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, at least one selected from the group consisting of (a) a spectral characteristic of an object present forward of the vehicle is determined, (b) a spatial characteristic of an object present forward of the vehicle is determined, (c) size of an object present forward of the vehicle and (d) location of an object present forward of the vehicle relative to the road along which the equipped vehicle is traveling is determined.

36. The vehicular control system of claim 19 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, location of an object that is present forward of the vehicle is determined.

37. A vehicular control system, the vehicular control system comprising:

a forward viewing camera disposed at an in-cabin side of a windshield of a vehicle equipped with the vehicular control system, the forward viewing camera viewing forward of the equipped vehicle through the windshield of the equipped vehicle and in a direction of forward travel of the equipped vehicle, wherein the forward viewing camera is operable to capture image data;

wherein the forward viewing camera comprises a complementary metal-oxide semiconductor (CMOS) imaging array sensor;

an image processor operable to process image data captured by the forward viewing camera;

wherein road curvature of a road along which the equipped vehicle is traveling is determined responsive at least in part to processing by the image processor of image data captured by the forward viewing camera;

wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, lane markers on the road along which the equipped vehicle is traveling are detected;

wherein, responsive at least in part to detection of lane markers on the road, a traffic lane along which the equipped vehicle is traveling is determined;

wherein speed of the equipped vehicle is controlled by an adaptive cruise control system of the equipped vehicle;

wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a pedestrian that is present on the road along which the equipped vehicle is traveling and forward of the equipped vehicle is detected;

wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, speed of the equipped vehicle is controlled by the adaptive cruise control system of the equipped vehicle;

wherein, upon approach of the equipped vehicle to a curve in the road along which the equipped vehicle is traveling, speed of the equipped vehicle is reduced by the adaptive cruise control system to a reduced speed for traveling around the curve in the road at least in part responsive to data relevant to a current geographical location of the equipped vehicle, and wherein the current geographical location of the equipped vehicle is determined by a global positioning system;

wherein speed of the equipped vehicle is increased by the adaptive cruise control system of the equipped vehicle when the equipped vehicle is traveling along a straighter section of road after the curve in the road;

wherein the forward viewing camera captures image data for a plurality of driving assist systems of the equipped vehicle, and wherein the plurality of driving assist systems includes (i) a lane departure warning system of the equipped vehicle, (ii) a traffic sign recognition system of the equipped vehicle and (iii) an intelligent headlamp control system of the equipped vehicle;

wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, the vehicular control system (i) detects another vehicle that is present on the road along which the equipped vehicle is traveling and forward of the equipped vehicle, and (ii) determines whether the detected other vehicle is in a traffic lane to the right of the determined traffic lane along which the equipped vehicle is traveling or is in a traffic lane to the left of the determined traffic lane along which the equipped vehicle is traveling; and

wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, the vehicular control system determines that the detected other vehicle is traveling in a traffic lane to the left of the determined traffic lane along which the equipped vehicle is traveling and is an oncoming vehicle.

38. The vehicular control system of claim 37 , wherein the forward viewing camera is housed in a windshield electronics module disposed at the windshield of the equipped vehicle.

39. The vehicular control system of claim 38 , wherein the windshield electronics module houses the image processor.

40. The vehicular control system of claim 37 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a spectral characteristic of an object that is present forward of the vehicle is determined.

41. The vehicular control system of claim 37 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a curb of the road along which the equipped vehicle is traveling is detected.

42. The vehicular control system of claim 37 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a traffic sign ahead of the equipped vehicle is recognized.

43. The vehicular control system of claim 42 , wherein the traffic sign comprises a speed control sign for a portion of the road being travelled by the equipped vehicle.

44. The vehicular control system of claim 43 , wherein the adaptive cruise control system of the equipped vehicle controls speed of the equipped vehicle to be at or below a speed level indicated on the speed control sign.

45. The vehicular control system of claim 42 , wherein the traffic sign comprises a stop sign ahead of the equipped vehicle.

46. The vehicular control system of claim 42 , wherein the traffic sign comprises a road construction zone sign.

47. The vehicular control system of claim 46 , wherein a driver of the equipped vehicle is alerted that the road construction zone sign is recognized.

48. The vehicular control system of claim 42 , wherein the traffic sign comprises a warning sign present exterior of the equipped vehicle.

49. The vehicular control system of claim 42 , wherein the traffic sign comprises at least one selected from the group consisting of (i) a speed limit sign present exterior of the equipped vehicle, (ii) a freeway exit sign present exterior of the equipped vehicle, (iii) a warning sign present exterior of the equipped vehicle, (iv) a stop sign present exterior of the equipped vehicle and (v) a yield sign present exterior of the equipped vehicle.

50. The vehicular control system of claim 37 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a character of a traffic sign present forward of the vehicle is determined.

51. The vehicular control system of claim 37 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, a road shoulder of the road along which the equipped vehicle is traveling is detected.

52. The vehicular control system of claim 37 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, at least one selected from the group consisting of (a) a spectral characteristic of an object present forward of the vehicle is determined, (b) a spatial characteristic of an object present forward of the vehicle is determined, (c) size of an object present forward of the vehicle and (d) location of an object present forward of the vehicle relative to the road along which the equipped vehicle is traveling is determined.

53. The vehicular control system of claim 37 , wherein, responsive at least in part to processing by the image processor of image data captured by the forward viewing camera, location of an object that is present forward of the vehicle is determined.

Continuity (27)
Continuation 16947459 · Aug 3, 2020
Continuation 16665068 · Oct 28, 2019
Continuation 16413688 · May 16, 2019
Continuation 16252870 · Jan 21, 2019
Continuation 16166338 · Oct 22, 2018
Continuation 16025023 · Jul 2, 2018
Continuation 15953648 · Apr 16, 2018
Continuation 15675921 · Aug 14, 2017
Continuation 15463296 · Mar 20, 2017
Continuation 15249557 · Aug 29, 2016
Continuation 14942089 · Nov 16, 2015
Continuation 14678146 · Apr 3, 2015
Continuation 14467296 · Aug 25, 2014
Continuation 14082577 · Nov 18, 2013
Continuation 13689796 · Nov 30, 2012
Continuation 13335125 · Dec 22, 2011
Continuation 13107318 · May 13, 2011
Continuation 12979499 · Dec 28, 2010
Continuation 12856737 · Aug 16, 2010
Continuation 12606476 · Oct 27, 2009
Continuation 12429605 · Apr 24, 2009
Continuation 11105757 · Apr 14, 2005
Provisional Application 60644903 · Jan 19, 2005
Provisional Application 60642227 · Jan 7, 2005
Provisional Application 60607963 · Sep 8, 2004
Provisional Application 60562480 · Apr 15, 2004
Related Publication 20230072196A1 · Mar 9, 2023
Cited By (2)
US 12,384,390 US 12,485,918