IP Library › Granted Patent US 12,205,381
Granted Patent B2
US 12,205,381 · App. 18/648,567 · Granted Jan 21, 2025

Vehicular control system

Inventors: Rohan J. Divekar (Auburn Hills, MI); Paul A. VanOphem (Washington, MI)
Assignee: MAGNA ELECTRONICS INC.
G06V20/58B60T7/18B60T7/22G08G1/161B60R2300/302B60R2300/8093B60T2201/022
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,205,381
App. No.
18/648,567
Granted
Jan 21, 2025
Kind
B2
Abstract

A vehicular control system includes a camera, a radar sensor and a processor operable to process image data captured by the camera and radar data captured by the radar sensor. The system determines that it is not safe to proceed with an intended turn at an intersection responsive to determination that the intended turn at the intersection will not be completed before an estimated time to arrival of an approaching vehicle at the intersection elapses and/or determination that a pedestrian is present at the intersection where the equipped vehicle will turn. The system determines that it is safe to proceed with the intended turn at the intersection responsive at least in part to determination that the intended turn at the intersection will be completed before the estimated time to arrival elapses and determination that no pedestrian is present at the intersection where the equipped vehicle will turn.

Claims (64)

1. A vehicular control system, the vehicular control system comprising:

a camera module disposed behind a windshield of a vehicle equipped with the vehicular control system;

wherein the camera module accommodates a camera, the camera viewing through the windshield forward of the equipped vehicle and operable to capture image data;

wherein the camera comprises an imaging sensor comprising at least one million photosensor elements arranged in a two dimensional array of columns and rows;

a radar sensor disposed at the equipped vehicle, the radar sensor sensing forward of the vehicle and operable to capture radar data;

at least one processor operable (i) to process image data captured by the camera and (ii) to process radar data captured by the radar sensor;

wherein the vehicular control system, at least in part via at least one selected from the group consisting of (i) processing at the at least one processor of captured image data and (ii) processing at the at least one processor of captured radar data, detects an approaching vehicle present forward of the equipped vehicle that (i) is travelling on a road that the equipped vehicle is travelling along and (ii) is approaching an intersection where another road intersects the road along which the equipped vehicle is travelling;

wherein the vehicular control system, at least in part via at least one selected from the group consisting of (i) processing at the at least one processor of captured image data and (ii) processing at the at least one processor of captured radar data, determines an intended turn by the equipped vehicle at the intersection across a traffic lane of the road along which both the approaching vehicle and the equipped vehicle are traveling along;

wherein the vehicular control system estimates time to arrival of the approaching vehicle at the intersection;

wherein the vehicular control system determines that it is not safe for the equipped vehicle to proceed with the intended turn at the intersection responsive at least in part to at least one selected from the group consisting of (i) determination that the equipped vehicle will not complete the intended turn at the intersection before the estimated time to arrival of the approaching vehicle at the intersection elapses and (ii) determination, via at least one selected from the group consisting of (a) processing at the at least one processor of captured image data and (b) processing at the at least one processor of captured radar data, that a pedestrian is present at the intersection where the equipped vehicle will turn; and

wherein the vehicular control system determines that it is safe for the equipped vehicle to proceed with the intended turn at the intersection responsive at least in part to (i) determination that the equipped vehicle will complete the intended turn at the intersection before the estimated time to arrival of the approaching vehicle at the intersection elapses and (ii) determination, via at least one selected from the group consisting of (a) processing at the at least one processor of captured image data and (b) processing at the at least one processor of captured radar data, that no pedestrian is present at the intersection where the equipped vehicle will turn.

2. The vehicular control system of claim 1 , wherein the at least one processor comprises an image processing chip, and wherein the intended turn of the equipped vehicle at the intersection is determined at least in part by processing of captured image data by the image processing chip of the at least one processor.

3. The vehicular control system of claim 2 , wherein the camera module comprises at least one electrical connector.

4. The vehicular control system of claim 3 , wherein the camera module houses the image processing chip.

5. The vehicular control system of claim 1 , wherein estimation of the time to arrival of the approaching vehicle at the intersection is based at least in part on processing at the at least one processor of captured image data.

6. The vehicular control system of claim 1 , wherein the vehicular control system controls braking of the equipped vehicle responsive to determination that a collision may occur at the intersection.

7. The vehicular control system of claim 6 , wherein the determination that a collision may occur at the intersection comprises determination of a collision with the approaching vehicle.

8. The vehicular control system of claim 1 , wherein the vehicular control system determines a state of a traffic signal light at the intersection.

9. The vehicular control system of claim 8 , wherein the vehicular control system determines the state of the traffic signal light at the intersection via a wireless communication.

10. The vehicular control system of claim 1 , wherein the vehicular control system determines the intended turn of the equipped vehicle at the intersection in part responsive to activation of a turn signal of the equipped vehicle.

11. The vehicular control system of claim 1 , wherein the vehicular control system generates an alert to a driver of the equipped vehicle responsive to determination that it is not safe for the equipped vehicle to proceed with the intended turn at the intersection.

12. The vehicular control system of claim 1 , wherein determination of location of equipped vehicle relative to the approaching vehicle utilizes GPS data.

13. The vehicular control system of claim 1 , wherein determination of distance of equipped vehicle to the approaching vehicle utilizes GPS data.

14. The vehicular control system of claim 1 , wherein determination of a heading angle of the approaching vehicle utilizes GPS data.

15. A vehicular control system, the vehicular control system comprising:

a camera module disposed behind a windshield of a vehicle equipped with the vehicular control system;

wherein the camera module accommodates a camera, the camera viewing through the windshield forward of the equipped vehicle and operable to capture image data;

wherein the camera comprises an imaging sensor comprising at least one million photosensor elements arranged in a two dimensional array of columns and rows;

a radar sensor disposed at the equipped vehicle, the radar sensor sensing forward of the vehicle and operable to capture radar data;

at least one processor operable (i) to process image data captured by the camera and (ii) to process radar data captured by the radar sensor;

wherein the vehicular control system, at least in part via at least one selected from the group consisting of (i) processing at the at least one processor of captured image data and (ii) processing at the at least one processor of captured radar data, detects an approaching vehicle present forward of the equipped vehicle that (i) is travelling on a road that the equipped vehicle is travelling along and (ii) is approaching an intersection where another road intersects the road along which the equipped vehicle is travelling;

wherein the vehicular control system, at least in part via at least one selected from the group consisting of (i) processing at the at least one processor of captured image data and (ii) processing at the at least one processor of captured radar data, determines an intended turn by the equipped vehicle at the intersection across a traffic lane of the road along which both the approaching vehicle and the equipped vehicle are traveling along;

wherein the vehicular control system estimates, at least in part via at least one selected from the group consisting of (a) processing at the at least one processor of captured image data and (b) processing at the at least one processor of captured radar data, time to arrival of the approaching vehicle at the intersection;

wherein the vehicular control system determines that it is not safe for the equipped vehicle to proceed with the intended turn at the intersection responsive at least in part to at least one selected from the group consisting of (i) determination, via at least one selected from the group consisting of (a) processing at the at least one processor of captured image data and (b) processing at the at least one processor of captured radar data, that the equipped vehicle will not complete the intended turn at the intersection before the estimated time to arrival of the approaching vehicle at the intersection elapses and (ii) determination, via at least one selected from the group consisting of (a) processing at the at least one processor of captured image data and (b) processing at the at least one processor of captured radar data, that a pedestrian is present at the intersection where the equipped vehicle will turn;

wherein the vehicular control system determines that it is safe for the equipped vehicle to proceed with the intended turn at the intersection responsive at least in part to (i) determination, via at least one selected from the group consisting of (a) processing at the at least one processor of captured image data and (b) processing at the at least one processor of captured radar data, that the equipped vehicle will complete the intended turn at the intersection before the estimated time to arrival of the approaching vehicle at the intersection elapses and (ii) determination, via at least one selected from the group consisting of (a) processing at the at least one processor of captured image data and (b) processing at the at least one processor of captured radar data, that no pedestrian is present at the intersection where the equipped vehicle will turn; and

wherein at least one selected from the group consisting of (i) the vehicular control system controls braking of the equipped vehicle responsive to determination that it is not safe for the equipped vehicle to proceed with the intended turn at the intersection and (ii) the vehicular control system generates an alert to a driver of the equipped vehicle responsive to determination that it is not safe for the equipped vehicle to proceed with the intended turn at the intersection.

16. The vehicular control system of claim 15 , wherein the at least one processor comprises an image processing chip, and wherein the intended turn of the equipped vehicle at the intersection is determined at least in part by processing of captured image data by the image processing chip of the at least one processor.

17. The vehicular control system of claim 16 , wherein the camera module comprises at least one electrical connector.

18. The vehicular control system of claim 17 , wherein the camera module houses the image processing chip.

19. The vehicular control system of claim 15 , wherein the vehicular control system determines a state of a traffic signal light at the intersection.

20. The vehicular control system of claim 15 , wherein the vehicular control system determines the intended turn of the equipped vehicle at the intersection in part responsive to activation of a turn signal of the equipped vehicle.

21. The vehicular control system of claim 15 , wherein determination of location of equipped vehicle relative to the approaching vehicle utilizes GPS data.

22. The vehicular control system of claim 15 , wherein determination of distance of equipped vehicle to the approaching vehicle utilizes GPS data.

23. The vehicular control system of claim 15 , wherein determination of a heading angle of the approaching vehicle utilizes GPS data.

24. A vehicular control system, the vehicular control system comprising:

a camera module disposed behind a windshield of a vehicle equipped with the vehicular control system;

wherein the camera module accommodates a camera, the camera viewing through the windshield forward of the equipped vehicle and operable to capture image data;

wherein the camera comprises an imaging sensor comprising at least one million photosensor elements arranged in a two dimensional array of columns and rows;

a radar sensor disposed at the equipped vehicle, the radar sensor sensing forward of the vehicle and operable to capture radar data;

at least one processor operable (i) to process image data captured by the camera and (ii) to process radar data captured by the radar sensor;

wherein the vehicular control system, at least in part via at least one selected from the group consisting of (i) processing at the at least one processor of captured image data and (ii) processing at the at least one processor of captured radar data, detects an approaching vehicle present forward of the equipped vehicle that (i) is travelling on a road that the equipped vehicle is travelling along and (ii) is approaching an intersection where another road intersects the road along which the equipped vehicle is travelling;

wherein the vehicular control system, at least in part via at least one selected from the group consisting of (i) processing at the at least one processor of captured image data and (ii) processing at the at least one processor of captured radar data, determines an intended turn by the equipped vehicle at the intersection across a traffic lane of the road along which both the approaching vehicle and the equipped vehicle are traveling along;

wherein the vehicular control system estimates time to arrival of the approaching vehicle at the intersection;

wherein the vehicular control system determines that it is not safe for the equipped vehicle to proceed with the intended turn at the intersection responsive at least in part to at least one selected from the group consisting of (i) determination that the equipped vehicle will not complete the intended turn at the intersection before the estimated time to arrival of the approaching vehicle at the intersection elapses and (ii) determination that a pedestrian is present at the intersection where the equipped vehicle will turn;

wherein the vehicular control system determines that it is safe for the equipped vehicle to proceed with the intended turn at the intersection responsive at least in part to (i) determination that the equipped vehicle will complete the intended turn at the intersection before the estimated time to arrival of the approaching vehicle at the intersection elapses and (ii) determination that no pedestrian is present at the intersection where the equipped vehicle will turn; and

wherein at least one selected from the group consisting of (i) the vehicular control system controls braking of the equipped vehicle responsive to determination that it is not safe for the equipped vehicle to proceed with the intended turn at the intersection and (ii) the vehicular control system generates an alert to a driver of the equipped vehicle responsive to determination that it is not safe for the equipped vehicle to proceed with the intended turn at the intersection.

25. The vehicular control system of claim 24 , wherein the at least one processor comprises an image processing chip, and wherein the intended turn of the equipped vehicle at the intersection is determined at least in part by processing of captured image data by the image processing chip of the at least one processor.

26. The vehicular control system of claim 25 , wherein the camera module comprises at least one electrical connector.

27. The vehicular control system of claim 25 , wherein the camera module houses the image processing chip.

28. The vehicular control system of claim 24 , wherein the vehicular control system determines a state of a traffic signal light at the intersection.

29. The vehicular control system of claim 24 , wherein the vehicular control system determines the intended turn of the equipped vehicle at the intersection in part responsive to activation of a turn signal of the equipped vehicle.

30. The vehicular control system of claim 24 , wherein determination of location of equipped vehicle relative to the approaching vehicle utilizes GPS data.

31. The vehicular control system of claim 24 , wherein determination of distance of equipped vehicle to the approaching vehicle utilizes GPS data.

32. The vehicular control system of claim 24 , wherein determination of a heading angle of the approaching vehicle utilizes GPS data.

Continuity (10)
Continuation 18332806 · Jun 12, 2023
Continuation 17929406 · Sep 2, 2022
Continuation 16949051 · Oct 12, 2020
Continuation 16600657 · Oct 14, 2019
Continuation 16221690 · Dec 17, 2018
Continuation 16059536 · Aug 9, 2018
Continuation 15681699 · Aug 21, 2017
Continuation 14994595 · Jan 13, 2016
Provisional Application 62103220 · Jan 14, 2015
Related Publication 20240273917A1 · Aug 15, 2024
References Cited (56)
US 5760962A · Schofield et al. · 1998 [cited by applicant]
US 5796094A · Schofield et al. · 1998 [cited by applicant]
US 5877897A · Schofield et al. · 1999 [cited by applicant]
US 6201642B1 · Bos · 2001 [cited by applicant]
US 6396397B1 · Bos et al. · 2002 [cited by applicant]
US 6405132B1 · Breed et al. · 2002 [cited by applicant]
US 6636258B2 · Strumolo · 2003 [cited by applicant]
US 6690268B2 · Schofield et al. · 2004 [cited by applicant]
US 6693517B2 · McCarthy et al. · 2004 [cited by applicant]
US 6802617B2 · Schofield et al. · 2004 [cited by applicant]
US 6806452B2 · Bos et al. · 2004 [cited by applicant]
US 6822563B2 · Bos et al. · 2004 [cited by applicant]
US 6975246B1 · Trudeau · 2005 [cited by applicant]
US 7005974B2 · McMahon et al. · 2006 [cited by applicant]
US 7038577B2 · Pawlicki et al. · 2006 [cited by applicant]
US 7145519B2 · Takahashi et al. · 2006 [cited by applicant]
US 7161616B1 · Okamoto et al. · 2007 [cited by applicant]
US 7230640B2 · Regensburger et al. · 2007 [cited by applicant]
US 7248283B2 · Takagi et al. · 2007 [cited by applicant]
US 7295229B2 · Kumata et al. · 2007 [cited by applicant]
US 7301466B2 · Asai · 2007 [cited by applicant]
US 7580795B2 · McCarthy et al. · 2009 [cited by applicant]
US 7592928B2 · Chinomi et al. · 2009 [cited by applicant]
US 7720580B2 · Higgins-Luthman · 2010 [cited by applicant]
US 7855755B2 · Weller et al. · 2010 [cited by applicant]
US 7881496B2 · Camilleri et al. · 2011 [cited by applicant]
US 7991522B2 · Higgins-Luthman · 2011 [cited by examiner]
US 9740945B2 · Divekar et al. · 2017 [cited by applicant]
US 10049285B2 · Divekar et al. · 2018 [cited by applicant]
US 10157322B1 · Divekar et al. · 2018 [cited by applicant]
US 10445600B2 · Divekar et al. · 2019 [cited by applicant]
US 10803329B2 · Divekar et al. · 2020 [cited by applicant]
US 11436840B2 · Divekar et al. · 2022 [cited by applicant]
US 11676400B2 · Divekar et al. · 2023 [cited by applicant]
US 11972615B2 · Divekar et al. · 2024 [cited by applicant]
US 20030095039A1 · Shimomura et al. · 2003 [cited by applicant]
US 20060254142A1 · Das et al. · 2006 [cited by applicant]
US 20090033474A1 · Chen · 2009 [cited by applicant]
US 20100085171A1 · Do · 2010 [cited by applicant]
US 20100328644A1 · Lu · 2010 [cited by examiner]
US 20110032119A1 · Pfeiffer et al. · 2011 [cited by applicant]
US 20110313665A1 · Lueke · 2011 [cited by examiner]
US 20120062743A1 · Lynam · 2012 [cited by examiner]
US 20120065858A1 · Nickolaou et al. · 2012 [cited by applicant]
US 20120218412A1 · Dellantoni et al. · 2012 [cited by applicant]
US 20130116859A1 · Ihlenburg et al. · 2013 [cited by applicant]
US 20130181860A1 · Le · 2013 [cited by examiner]
US 20130342333A1 · Hutchings · 2013 [cited by applicant]
US 20140218529A1 · Mahmoud et al. · 2014 [cited by applicant]
US 20140222323A1 · Purushothaman et al. · 2014 [cited by applicant]
US 20140375476A1 · Johnson et al. · 2014 [cited by applicant]
US 20150124096A1 · Koravadi · 2015 [cited by applicant]
US 20150158499A1 · Koravadi · 2015 [cited by applicant]
US 20150251599A1 · Koravadi · 2015 [cited by applicant]
US 20150352953A1 · Koravadi · 2015 [cited by applicant]
US 20160071417A1 · Lewis · 2016 [cited by examiner]