IP Library Granted Patent US 12,286,102
Granted Patent B2
US 12,286,102 · App. 18/307,032 · Granted Apr 29, 2025

Vehicular driving assist system with collision avoidance

Inventor: Wilhelm Johann Wolfgang Wöhlte (Sailauf, DE)
Assignee: Magna Electronics Inc.
B60W30/09B60W10/18B60W10/20B60W10/30B60W30/0956B60W50/16G08G1/166B60W2420/403B60W2420/408B60W2554/408
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,286,102
App. No.
18/307,032
Granted
Apr 29, 2025
Kind
B2
Abstract

A vehicular vision system includes a front camera disposed at a windshield of a vehicle equipped with the system and a side camera disposed at a side mirror of the vehicle. An electronic control unit (ECU) includes an image processor for processing image data captured by the cameras. The vehicular vision system, responsive to processing by the image processor of image data captured by the front camera, detects a leading vehicle traveling in front of the equipped vehicle in a traffic lane the equipped vehicle is also traveling along. The vehicular vision system, responsive to determination of an intent of the equipped vehicle to change lanes and to processing by the image processor of image data captured by the side camera, detects an oncoming vehicle traveling in a traffic lane adjacent to the traffic lane the equipped vehicle is traveling along.

Claims (51)

1. A vehicular vision system, the vehicular vision system comprising:

a front camera disposed at a windshield of a vehicle equipped with the vehicular vision system and viewing at least forward of the equipped vehicle through the windshield, the front camera capturing image data;

a side camera disposed at a side mirror of the equipped vehicle and viewing at least forward and sideward of the equipped vehicle, the side camera capturing image data;

wherein the front camera comprises a CMOS imaging array, and wherein the CMOS imaging array of the front camera comprises at least one million photosensors arranged in rows and columns;

wherein the side camera comprises a CMOS imaging array, and wherein the CMOS imaging array of the side camera comprises at least one million photosensors arranged in rows and columns;

an electronic control unit (ECU) comprising electronic circuitry and associated software;

wherein the electronic circuitry of the ECU comprises an image processor for processing image data captured by the front camera and image data captured by the side camera;

wherein the vehicular vision system, via processing at the ECU of image data captured by the front camera, determines a traffic lane along which the equipped vehicle is traveling;

wherein the vehicular vision system detects a leading vehicle traveling in front of the equipped vehicle in the traffic lane along which the equipped vehicle is traveling; and

wherein, responsive to determination of an intent of the equipped vehicle to change from the traffic lane along which the equipped vehicle is traveling to an adjacent traffic lane that is adjacent to the traffic lane along which the equipped vehicle is traveling, the vehicular vision system, via processing at the ECU of image data captured by the side camera, detects an oncoming vehicle traveling in the adjacent traffic lane.

2. The vehicular vision system of claim 1 , wherein the vehicular vision system, responsive to determining the intent to change from the traffic lane and detecting the oncoming vehicle, generates an alert to an operator of the equipped vehicle.

3. The vehicular vision system of claim 2 , wherein the alert comprises at least one selected from the group consisting of (i) a visual alert, (ii) an audible alert, and (iii) a haptic alert.

4. The vehicular vision system of claim 1 , wherein the vehicular vision system, responsive to detecting the leading vehicle and the oncoming vehicle, enables an active crash avoidance function.

5. The vehicular vision system of claim 4 , wherein the active crash avoidance function comprises at least one selected from the group consisting of (i) restricting steering of the equipped vehicle, (ii) restricting a speed of the equipped vehicle, (iii) restricting an acceleration of the equipped vehicle, (iv) prefilling a brake of the equipped vehicle, and (v) tensioning a seat belt of the equipped vehicle.

6. The vehicular vision system of claim 4 , wherein the vehicular vision system, responsive to determining that the oncoming vehicle has passed the equipped vehicle, disables the active crash avoidance function.

7. The vehicular vision system of claim 4 , wherein the vehicular vision system enables the active crash avoidance function responsive to determining that a likelihood of a collision between the equipped vehicle and the oncoming vehicle is greater than a threshold.

8. The vehicular vision system of claim 1 , comprising a radar sensor disposed at a bumper of the equipped vehicle.

9. The vehicular vision system of claim 8 , wherein the vehicular vision system detects the oncoming vehicle via processing of sensor data captured by the radar sensor.

10. The vehicular vision system of claim 1 , wherein the vehicular vision system determines the intent to change from the traffic lane based on at least one selected from the group consisting of (i) an acceleration of the equipped vehicle, (ii) a turn signal of the equipped vehicle, and (iii) a lateral movement of the equipped vehicle.

11. The vehicular vision system of claim 1 , wherein the vehicular vision system detects the oncoming vehicle at least in part via processing of lidar data captured by at least one lidar sensor of the equipped vehicle.

12. The vehicular vision system of claim 1 , wherein the vehicular vision system detects the leading vehicle at least in part via processing of radar data captured by at least one radar sensor of the equipped vehicle.

13. A vehicular vision system, the vehicular vision system comprising:

a front camera disposed at a windshield of a vehicle equipped with the vehicular vision system and viewing at least forward of the equipped vehicle through the windshield, the front camera capturing image data;

a side camera disposed at a side mirror of the equipped vehicle and viewing at least forward and sideward of the equipped vehicle, the side camera capturing image data;

wherein the front camera comprises a CMOS imaging array, and wherein the CMOS imaging array of the front camera comprises at least one million photosensors arranged in rows and columns;

wherein the side camera comprises a CMOS imaging array, and wherein the CMOS imaging array of the side camera comprises at least one million photosensors arranged in rows and columns;

an electronic control unit (ECU) comprising electronic circuitry and associated software;

wherein the electronic circuitry of the ECU comprises an image processor for processing image data captured by the front camera and image data captured by the side camera;

wherein the vehicular vision system, via processing at the ECU of image data captured by the front camera, determines a traffic lane along which the equipped vehicle is traveling;

wherein the vehicular vision system detects a leading vehicle traveling in front of the equipped vehicle in the traffic lane along which the equipped vehicle is traveling;

wherein, responsive to determination of an intent of the equipped vehicle to change from the traffic lane along which the equipped vehicle is traveling to an adjacent traffic lane that is adjacent to the traffic lane along which the equipped vehicle is traveling, the vehicular vision system, via processing at the ECU of image data captured by the side camera, detects an oncoming vehicle traveling in the adjacent traffic lane;

wherein the vehicular vision system determines the intent to change from the traffic lane based on at least one selected from the group consisting of (i) an acceleration of the equipped vehicle, (ii) a turn signal of the equipped vehicle, and (iii) a lateral movement of the equipped vehicle; and

wherein the vehicular vision system, responsive to determining the intent to change from the traffic lane and detecting the oncoming vehicle, generates an alert to an operator of the equipped vehicle.

14. The vehicular vision system of claim 13 , wherein the alert comprises at least one selected from the group consisting of (i) a visual alert, (ii) an audible alert, and (iii) a haptic alert.

15. The vehicular vision system of claim 13 , comprising a radar sensor disposed at a bumper of the equipped vehicle.

16. The vehicular vision system of claim 15 , wherein the vehicular vision system detects the oncoming vehicle via processing of sensor data captured by the radar sensor.

17. A vehicular vision system, the vehicular vision system comprising:

a front camera disposed at a windshield of a vehicle equipped with the vehicular vision system and viewing at least forward of the equipped vehicle through the windshield, the front camera capturing image data;

a side camera disposed at a side mirror of the equipped vehicle and viewing at least forward and sideward of the equipped vehicle, the side camera capturing image data;

wherein the front camera comprises a CMOS imaging array, and wherein the CMOS imaging array of the front camera comprises at least one million photosensors arranged in rows and columns;

wherein the side camera comprises a CMOS imaging array, and wherein the CMOS imaging array of the side camera comprises at least one million photosensors arranged in rows and columns;

an electronic control unit (ECU) comprising electronic circuitry and associated software;

wherein the electronic circuitry of the ECU comprises an image processor for processing image data captured by the front camera and image data captured by the side camera;

wherein the vehicular vision system, via processing at the ECU of image data captured by the front camera, determines a traffic lane along which the equipped vehicle is traveling;

wherein the vehicular vision system detects a leading vehicle traveling in front of the equipped vehicle in the traffic lane along which the equipped vehicle is traveling;

wherein, responsive to determination of an intent of the equipped vehicle to change from the traffic lane along which the equipped vehicle is traveling to an adjacent traffic lane that is adjacent to the traffic lane along which the equipped vehicle is traveling, the vehicular vision system, via processing at the ECU of image data captured by the side camera, detects an oncoming vehicle traveling in the adjacent traffic lane; and

wherein the vehicular vision system, responsive to determining the intent to change from the traffic lane and detecting the oncoming vehicle, controls at least one of (i) steering of the equipped vehicle to avoid the leading vehicle and the oncoming vehicle and (ii) braking of the equipped vehicle to avoid the leading vehicle and the oncoming vehicle.

18. The vehicular vision system of claim 17 , wherein the vehicular vision system, responsive to determining the intent to change from the traffic lane and detecting the oncoming vehicle, restricts acceleration of the equipped vehicle.

19. The vehicular vision system of claim 17 , wherein the vehicular vision system, responsive to determining that the oncoming vehicle has passed the equipped vehicle, ceases controlling the at least one of (i) steering of the equipped vehicle and (ii) braking of the equipped vehicle.

20. The vehicular vision system of claim 17 , wherein the vehicular vision system, responsive to determining the intent to change from the traffic lane and detecting the oncoming vehicle, generates an alert to an operator of the equipped vehicle.

21. The vehicular vision system of claim 17 , wherein the vehicular vision system determines the intent to change from the traffic lane based on at least one selected from the group consisting of (i) an acceleration of the equipped vehicle, (ii) a turn signal of the equipped vehicle, and (iii) a lateral movement of the equipped vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2023
From: WÖHLTE, WILHELM JOHANN WOLFGANG
To: MAGNA ELECTRONICS INC.
Reel/Frame 063441/0544 →
Continuity (2)
Provisional Application 63363651 · Apr 27, 2022
Related Publication 20230347878A1 · Nov 2, 2023
References Cited (191)
US 5550677A · Schofield et al. · 1996 [cited by applicant]
US 5670935A · Schofield et al. · 1997 [cited by applicant]
US 5760962A · Schofield et al. · 1998 [cited by applicant]
US 5786772A · Schofield et al. · 1998 [cited by applicant]
US 5796094A · Schofield et al. · 1998 [cited by applicant]
US 5877897A · Schofield et al. · 1999 [cited by applicant]
US 5929786A · Schofield et al. · 1999 [cited by applicant]
US 5949331A · Schofield et al. · 1999 [cited by applicant]
US 6201642B1 · Bos · 2001 [cited by applicant]
US 6222447B1 · Schofield et al. · 2001 [cited by applicant]
US 6302545B1 · Schofield et al. · 2001 [cited by applicant]
US 6396397B1 · Bos et al. · 2002 [cited by applicant]
US 6498620B2 · Schofield et al. · 2002 [cited by applicant]
US 6523964B2 · Schofield et al. · 2003 [cited by applicant]
US 6587186B2 · Bamji et al. · 2003 [cited by applicant]
US 6611202B2 · Schofield et al. · 2003 [cited by applicant]
US 6636258B2 · Strumolo · 2003 [cited by applicant]
US 6674895B2 · Rafii et al. · 2004 [cited by applicant]
US 6678039B2 · Charbon · 2004 [cited by applicant]
US 6690268B2 · Schofield et al. · 2004 [cited by applicant]
US 6690354B2 · Sze · 2004 [cited by applicant]
US 6693517B2 · McCarthy et al. · 2004 [cited by applicant]
US 6710770B2 · Tomasi et al. · 2004 [cited by applicant]
US 6717610B1 · Bos et al. · 2004 [cited by applicant]
US 6757109B2 · Bos · 2004 [cited by applicant]
US 6802617B2 · Schofield et al. · 2004 [cited by applicant]
US 6806452B2 · Bos et al. · 2004 [cited by applicant]
US 6822563B2 · Bos et al. · 2004 [cited by applicant]
US 6842687B2 · Winner et al. · 2005 [cited by applicant]
US 6876775B2 · Torunoglu · 2005 [cited by applicant]
US 6882287B2 · Schofield · 2005 [cited by applicant]
US 6891563B2 · Schofield et al. · 2005 [cited by applicant]
US 6906793B2 · Bamji et al. · 2005 [cited by applicant]
US 6919549B2 · Bamji et al. · 2005 [cited by applicant]
US 6946978B2 · Schofield · 2005 [cited by applicant]
US 7005974B2 · McMahon et al. · 2006 [cited by applicant]
US 7038577B2 · Pawlicki et al. · 2006 [cited by applicant]
US 7053357B2 · Schwarte · 2006 [cited by applicant]
US 7145519B2 · Takahashi et al. · 2006 [cited by applicant]
US 7157685B2 · Bamji et al. · 2007 [cited by applicant]
US 7161616B1 · Okamoto et al. · 2007 [cited by applicant]
US 7176438B2 · Bamji et al. · 2007 [cited by applicant]
US 7203356B2 · Gokturk et al. · 2007 [cited by applicant]
US 7205904B2 · Schofield · 2007 [cited by applicant]
US 7212663B2 · Tomasi · 2007 [cited by applicant]
US 7230640B2 · Regensburger et al. · 2007 [cited by applicant]
US 7248283B2 · Takagi et al. · 2007 [cited by applicant]
US 7283213B2 · O'Connor et al. · 2007 [cited by applicant]
US 7295229B2 · Kumata et al. · 2007 [cited by applicant]
US 7301466B2 · Asai · 2007 [cited by applicant]
US 7310431B2 · Gokturk et al. · 2007 [cited by applicant]
US 7321111B2 · Bamji et al. · 2008 [cited by applicant]
US 7340077B2 · Gokturk et al. · 2008 [cited by applicant]
US 7352454B2 · Bamji et al. · 2008 [cited by applicant]
US 7375803B1 · Bamji · 2008 [cited by applicant]
US 7379100B2 · Gokturk et al. · 2008 [cited by applicant]
US 7379163B2 · Rafii et al. · 2008 [cited by applicant]
US 7405812B1 · Bamji · 2008 [cited by applicant]
US 7408627B2 · Bamji et al. · 2008 [cited by applicant]
US 7580795B2 · McCarthy et al. · 2009 [cited by applicant]
US 7592928B2 · Chinomi et al. · 2009 [cited by applicant]
US 7720580B2 · Higgins-Luthman · 2010 [cited by applicant]
US 7855755B2 · Weller et al. · 2010 [cited by applicant]
US 7859565B2 · Schofield et al. · 2010 [cited by applicant]
US 7881496B2 · Camilleri et al. · 2011 [cited by applicant]
US 8013780B2 · Lynam · 2011 [cited by applicant]
US 8027029B2 · Lu et al. · 2011 [cited by applicant]
US 8694224B2 · Chundrlik, Jr. et al. · 2014 [cited by applicant]
US 8818042B2 · Schofield et al. · 2014 [cited by applicant]
US 8886401B2 · Schofield et al. · 2014 [cited by applicant]
US 8917169B2 · Schofield et al. · 2014 [cited by applicant]
US 9036026B2 · Dellantoni et al. · 2015 [cited by applicant]
US 9068390B2 · Ihlenburg et al. · 2015 [cited by applicant]
US 9077098B2 · Latunski · 2015 [cited by applicant]
US 9077962B2 · Shi et al. · 2015 [cited by applicant]
US 9090234B2 · Johnson et al. · 2015 [cited by applicant]
US 9092986B2 · Salomonsson et al. · 2015 [cited by applicant]
US 9126525B2 · Lynam et al. · 2015 [cited by applicant]
US 9140789B2 · Lynam · 2015 [cited by applicant]
US 9146898B2 · Ihlenburg et al. · 2015 [cited by applicant]
US 9174574B2 · Salomonsson · 2015 [cited by applicant]
US 9205776B2 · Turk · 2015 [cited by applicant]
US 9233641B2 · Sesti et al. · 2016 [cited by applicant]
US 9575160B1 · Davis et al. · 2017 [cited by applicant]
US 9599702B1 · Bordes et al. · 2017 [cited by applicant]
US 9682712B2 · Kubo · 2017 [cited by applicant]
US 9689967B1 · Stark et al. · 2017 [cited by applicant]
US 9753121B1 · Davis et al. · 2017 [cited by applicant]
US 9869762B1 · Alland et al. · 2018 [cited by applicant]
US 9900490B2 · Ihlenburg et al. · 2018 [cited by applicant]
US 9954955B2 · Davis et al. · 2018 [cited by applicant]
US 10071687B2 · Ihlenburg et al. · 2018 [cited by applicant]
US 10099614B2 · Diessner · 2018 [cited by applicant]
US 10115314B2 · Boegel · 2018 [cited by applicant]
US 10214157B2 · Achenbach et al. · 2019 [cited by applicant]
US 10222224B2 · Johnson et al. · 2019 [cited by applicant]
US 10406981B2 · Chundrlik, Jr. et al. · 2019 [cited by applicant]
US 10457209B2 · Byrne et al. · 2019 [cited by applicant]
US 10787125B2 · Achenbach et al. · 2020 [cited by applicant]
US 10812992B1 · Tran et al. · 2020 [cited by applicant]
US 10866306B2 · Maher et al. · 2020 [cited by applicant]
US 11017665B1 · Roy · 2021 [cited by applicant]
US 11454719B2 · Hess et al. · 2022 [cited by applicant]
US 11763410B1 · Roy · 2023 [cited by applicant]
US 12030501B2 · Solar et al. · 2024 [cited by applicant]
US 12100225B2 · Nix et al. · 2024 [cited by applicant]
US 20050179527A1 · Schofield · 2005 [cited by applicant]
US 20080192984A1 · Higuchi et al. · 2008 [cited by applicant]
US 20100245066A1 · Sarioglu et al. · 2010 [cited by applicant]
US 20120062743A1 · Lynam et al. · 2012 [cited by applicant]
US 20120218412A1 · Dellantoni et al. · 2012 [cited by applicant]
US 20130002873A1 · Hess · 2013 [cited by applicant]
US 20130141578A1 · Chundrlik, Jr. et al. · 2013 [cited by applicant]
US 20130215271A1 · Lu · 2013 [cited by applicant]
US 20130222592A1 · Gieseke · 2013 [cited by applicant]
US 20130222593A1 · Byrne et al. · 2013 [cited by applicant]
US 20130242099A1 · Sauer et al. · 2013 [cited by applicant]
US 20130258077A1 · Bally et al. · 2013 [cited by applicant]
US 20130278769A1 · Nix et al. · 2013 [cited by applicant]
US 20130297387A1 · Michael · 2013 [cited by applicant]
US 20130298866A1 · Vogelbacher · 2013 [cited by applicant]
US 20130300869A1 · Lu et al. · 2013 [cited by applicant]
US 20130314503A1 · Nix et al. · 2013 [cited by applicant]
US 20140005907A1 · Bajpai · 2014 [cited by applicant]
US 20140025240A1 · Steigerwald et al. · 2014 [cited by applicant]
US 20140028852A1 · Rathi · 2014 [cited by applicant]
US 20140049646A1 · Nix · 2014 [cited by applicant]
US 20140052340A1 · Bajpai · 2014 [cited by applicant]
US 20140067206A1 · Pflug · 2014 [cited by applicant]
US 20140085472A1 · Lu et al. · 2014 [cited by applicant]
US 20140098229A1 · Lu et al. · 2014 [cited by applicant]
US 20140104426A1 · Boegel et al. · 2014 [cited by applicant]
US 20140138140A1 · Sigle · 2014 [cited by applicant]
US 20140139676A1 · Wierich · 2014 [cited by applicant]
US 20140152825A1 · Schaffner · 2014 [cited by applicant]
US 20140160276A1 · Pliefke et al. · 2014 [cited by applicant]
US 20140160291A1 · Schaffner · 2014 [cited by applicant]
US 20140168415A1 · Ihlenburg et al. · 2014 [cited by applicant]
US 20140168437A1 · Rother et al. · 2014 [cited by applicant]
US 20140211009A1 · Fursich · 2014 [cited by applicant]
US 20140218529A1 · Mahmoud et al. · 2014 [cited by applicant]
US 20140218535A1 · Ihlenburg et al. · 2014 [cited by applicant]
US 20140226012A1 · Achenbach · 2014 [cited by applicant]
US 20140232869A1 · May et al. · 2014 [cited by applicant]
US 20140247352A1 · Rathi et al. · 2014 [cited by applicant]
US 20140247354A1 · Knudsen · 2014 [cited by applicant]
US 20140247355A1 · Ihlenburg · 2014 [cited by applicant]
US 20140293042A1 · Lynam · 2014 [cited by applicant]
US 20140293057A1 · Wierich · 2014 [cited by applicant]
US 20140307095A1 · Wierich · 2014 [cited by applicant]
US 20140309884A1 · Wolf · 2014 [cited by applicant]
US 20140313339A1 · Diessner · 2014 [cited by applicant]
US 20140320636A1 · Bally et al. · 2014 [cited by applicant]
US 20140320658A1 · Pliefke · 2014 [cited by applicant]
US 20140327772A1 · Sahba · 2014 [cited by applicant]
US 20140327774A1 · Lu et al. · 2014 [cited by applicant]
US 20140336876A1 · Gieseke et al. · 2014 [cited by applicant]
US 20140340510A1 · Ihlenburg et al. · 2014 [cited by applicant]
US 20140347486A1 · Okouneva · 2014 [cited by applicant]
US 20140375476A1 · Johnson et al. · 2014 [cited by applicant]
US 20150124096A1 · Koravadi · 2015 [cited by applicant]
US 20150158499A1 · Koravadi · 2015 [cited by applicant]
US 20150251599A1 · Koravadi · 2015 [cited by applicant]
US 20150352953A1 · Koravadi · 2015 [cited by applicant]
US 20160036917A1 · Koravadi et al. · 2016 [cited by applicant]
US 20160159394A1 · Ryu et al. · 2016 [cited by applicant]
US 20160210853A1 · Koravadi · 2016 [cited by applicant]
US 20170222311A1 · Hess et al. · 2017 [cited by applicant]
US 20170254873A1 · Koravadi · 2017 [cited by applicant]
US 20170276788A1 · Wodrich · 2017 [cited by applicant]
US 20170315231A1 · Wodrich · 2017 [cited by applicant]
US 20170356994A1 · Wodrich et al. · 2017 [cited by applicant]
US 20180015875A1 · May et al. · 2018 [cited by applicant]
US 20180045812A1 · Hess · 2018 [cited by applicant]
US 20180173239A1 · Yoon et al. · 2018 [cited by applicant]
US 20180231635A1 · Woehlte · 2018 [cited by applicant]
US 20190329627A1 · Chundrlik, Jr. · 2019 [cited by examiner]
US 20190339382A1 · Hess et al. · 2019 [cited by applicant]
US 20200327343A1 · Lund et al. · 2020 [cited by applicant]
US 20210061276A1 · Zhang · 2021 [cited by applicant]
US 20210221390A1 · Slobodyanyuk et al. · 2021 [cited by applicant]
US 20210385865A1 · Mueck et al. · 2021 [cited by applicant]
US 20210392454A1 · Choi et al. · 2021 [cited by applicant]
US 20220024485A1 · Theverapperuma et al. · 2022 [cited by applicant]
US 20220097625A1 · Russell et al. · 2022 [cited by applicant]
US 20220255223A1 · Tran et al. · 2022 [cited by applicant]
US 20230286439A1 · Gali · 2023 [cited by examiner]
US 20240278736A1 · Lynam et al. · 2024 [cited by applicant]
US 20240359691A1 · Solar et al. · 2024 [cited by applicant]
US 20250014356A1 · Nix et al. · 2025 [cited by applicant]
IN 201741056955 · 2019 [cited by applicant]