IP Library Granted Patent US 12,606,166
Granted Patent B2
US 12,606,166 · App. 18/772,325 · Granted Apr 21, 2026

Vehicular vision system with determination of right-of-way at intersection

Inventors: Harold E. Joseph (Brampton, CA); Muhammad Mohteshim Khan (Brampton, CA); Alexander Velichko (Toronto, CA)
Assignee: Magna Electronics Inc.
B60W30/181B60R1/12B60R11/04B60W30/18154B60W50/14G06V10/255G06V10/56G06V20/582B60R2001/1253B60W2050/146B60W2420/403B60W2554/408B60W2555/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,606,166
App. No.
18/772,325
Granted
Apr 21, 2026
Kind
B2
Abstract

A vehicular vision system includes a camera module mounted at an in-cabin side of a windshield of a vehicle and an electronic control unit (ECU) comprising electronic circuitry and associated software. The ECU, responsive to processing of location data captured by a global positioning system, determines a current geographical location of the vehicle. The ECU, with the vehicle approaching an intersection of another road, and at least in part via processing at the ECU of image data captured by the camera, determines a right-of-way order of other vehicles at the intersection based on (i) the current geographical location of the vehicle and (ii) an order of arrival of the other vehicles at the intersection relative to arrival of the equipped vehicle at the intersection. Based on the determined right-of-way order of the other vehicles at the intersection, the ECU determines when the vehicle has the right-of-way at the intersection.

Claims (58)

1 . A vehicular vision system, the vehicular vision system comprising:

a camera module mounted at an in-cabin side of a windshield of a vehicle equipped with the vehicular vision system, the camera module comprising a camera viewing through the windshield forward of the equipped vehicle, the camera capturing image data;

wherein the camera comprises an imaging array having at least one million photosensing elements arranged in rows and columns;

an electronic control unit (ECU) comprising electronic circuitry and associated software;

wherein the ECU, responsive to processing at the ECU of location data captured by a global positioning system, determines a current geographical location of the vehicle;

wherein the electronic circuitry of the ECU comprises an image processor for processing image data captured by the camera;

wherein the ECU, with the equipped vehicle approaching an intersection of another road with a road being travelled on by the equipped vehicle, classifies the intersection based at least in part on the determined current geographical location of the vehicle to determine a set of right-of-way rules applicable to the intersection;

wherein the ECU, at least in part via processing of image data captured by the camera, determines a right-of-way order of other vehicles at the intersection by applying the set of right-of-way rules to a determined order of arrival of the other vehicles at the intersection relative to arrival of the equipped vehicle at the intersection; and

wherein, based on the determined right-of-way order of the other vehicles at the intersection, the ECU determines when the equipped vehicle has the right-of-way at the intersection.

2 . The vehicular vision system of claim 1 , wherein the intersection comprises at least one stop indicator, and wherein the ECU, via processing at the ECU of image data captured by the camera, determines presence of a particular stop indicator designated for a traffic lane of the road along which the equipped vehicle is traveling.

3 . The vehicular vision system of claim 2 , wherein the ECU determines, via processing at the ECU of image data captured by the camera, presence of a stop line associated with the particular stop indicator designated for the traffic lane of the road along which the equipped vehicle is traveling.

4 . The vehicular vision system of claim 3 , wherein the ECU, responsive to determining presence of the stop line, controls the equipped vehicle to stop the equipped vehicle at the stop line.

5 . The vehicular vision system of claim 3 , wherein the classification of the intersection comprises one selected from the group consisting of (i) an all-stop intersection, (ii) a four-way intersection, (iii) a three-way intersection, (iv) a one-way intersection and (v) a cross traffic does not stop intersection.

6 . The vehicular vision system of claim 2 , wherein the intersection comprises a four-way intersection, and wherein the at least one stop indicator comprises four stop signs.

7 . The vehicular vision system of claim 2 , wherein the at least one stop indicator comprises at least one stop sign.

8 . The vehicular vision system of claim 2 , wherein the at least one stop indicator comprises at least one stop light.

9 . The vehicular vision system of claim 2 , wherein the ECU determines the presence of the particular stop indicator based on at least one selected from the group consisting of (i) a color of a sign at the intersection and (ii) a shape of a sign at the intersection.

10 . The vehicular vision system of claim 1 , wherein the intersection comprises a four-way intersection, and wherein the intersection comprises four stop signs.

11 . The vehicular vision system of claim 1 , wherein the ECU, responsive to determining the right-of-way order of vehicles at the intersection, audibly indicates the determined right-of-way order to a driver of the equipped vehicle.

12 . The vehicular vision system of claim 1 , comprising a display disposed within the equipped vehicle for displaying images, and wherein the ECU, responsive to determining the right-of-way order of vehicles at the intersection, visually indicates the determined right-of-way order to a driver of the equipped vehicle using the display.

13 . The vehicular vision system of claim 1 , wherein the ECU at least in part controls the equipped vehicle responsive to determining that the equipped vehicle has the right-of-way at the intersection.

14 . The vehicular vision system of claim 13 , wherein the ECU at least in part controls the equipped vehicle by controlling at least one selected from the group consisting of (i) steering of the equipped vehicle, (ii) acceleration of the equipped vehicle and (iii) braking of the equipped vehicle.

15 . The vehicular vision system of claim 1 , wherein the intersection comprises at least one traffic lane that does not stop for the remaining traffic lanes.

16 . A vehicular vision system, the vehicular vision system comprising:

a camera module mounted at an in-cabin side of a windshield of a vehicle equipped with the vehicular vision system, the camera module comprising a camera viewing through the windshield forward of the equipped vehicle, the camera capturing image data;

wherein the camera comprises an imaging array having at least one million photosensing elements arranged in rows and columns;

an electronic control unit (ECU) comprising electronic circuitry and associated software;

wherein the ECU, responsive to processing at the ECU of location data captured by a global positioning system, determines a current geographical location of the vehicle;

wherein the electronic circuitry of the ECU comprises an image processor for processing image data captured by the camera;

wherein, with the equipped vehicle approaching an intersection of another road with a road being travelled on by the equipped vehicle, and at least in part via processing at the ECU of image data captured by the camera, the ECU determines presence of a stop sign designated for the road along which the equipped vehicle is traveling;

wherein the ECU classifies the intersection based at least in part on the determined current geographical location of the vehicle and the determined presence of the stop sign to determine a set of right-of-way rules applicable to the intersection;

wherein the ECU, as the equipped vehicle approaches the intersection, and at least in part via processing at the ECU of image data captured by the camera, determines a right-of-way order of other vehicles at the intersection by applying the set of right-of-way rules to a determined order of arrival of the other vehicles at the intersection relative to arrival of the equipped vehicle at the intersection; and

wherein, based on the determined right-of-way order of the other vehicles at the intersection, the ECU determines when the equipped vehicle has the right-of-way at the intersection.

17 . The vehicular vision system of claim 16 , wherein the ECU determines, via processing at the ECU of image data captured by the camera, presence of a stop line associated with the stop sign designated for the road along which the equipped vehicle is traveling.

18 . The vehicular vision system of claim 17 , wherein the ECU, responsive to determining presence of the stop line, controls the equipped vehicle to stop the equipped vehicle at the stop line.

19 . The vehicular vision system of claim 16 , wherein the classification of the intersection comprises one selected from the group consisting of (i) an all-stop intersection, (ii) a four-way intersection, (iii) a three-way intersection, (iv) a one-way intersection and (v) a cross traffic does not stop intersection.

20 . The vehicular vision system of claim 16 , wherein the intersection comprises a four-way intersection having four stop signs.

21 . The vehicular vision system of claim 16 , wherein the ECU, responsive to determining the right-of-way order of vehicles at the intersection, audibly indicates the determined right-of-way order to a driver of the equipped vehicle.

22 . The vehicular vision system of claim 16 , comprising a display disposed within the equipped vehicle for displaying images, and wherein the ECU, responsive to determining the right-of-way order of vehicles at the intersection, visually indicates the determined right-of-way order to a driver of the equipped vehicle using the display.

23 . The vehicular vision system of claim 16 , wherein the ECU at least in part controls the equipped vehicle responsive to determining that the equipped vehicle has the right-of-way at the intersection, and wherein the ECU at least in part controls the equipped vehicle by controlling at least one selected from the group consisting of (i) steering of the equipped vehicle, (ii) acceleration of the equipped vehicle and (iii) braking of the equipped vehicle.

24 . The vehicular vision system of claim 16 , wherein the intersection comprises at least one traffic lane that does not stop for the remaining traffic lanes.

25 . A vehicular vision system, the vehicular vision system comprising:

a camera module mounted at an in-cabin side of a windshield of a vehicle equipped with the vehicular vision system, the camera module comprising a camera viewing through the windshield forward of the equipped vehicle, the camera capturing image data;

wherein the camera comprises an imaging array having at least one million photosensing elements arranged in rows and columns;

an electronic control unit (ECU) comprising electronic circuitry and associated software;

wherein the ECU, responsive to processing at the ECU of location data captured by a global positioning system, determines a current geographical location of the vehicle;

wherein the electronic circuitry of the ECU comprises an image processor for processing image data captured by the camera;

wherein, with the equipped vehicle approaching an intersection of another road with a road being travelled on by the equipped vehicle, and at least in part via processing at the ECU of image data captured by the camera, the ECU determines presence of a stop light designated for a traffic lane of the road along which the equipped vehicle is traveling;

wherein the ECU classifies the intersection based at least in part on the determined current geographical location of the vehicle and the determined presence of the stop light to determine a set of right-of-way rules applicable to the intersection;

wherein the ECU, as the equipped vehicle approaches the intersection, and at least in part via processing at the ECU of image data captured by the camera, determines a right-of-way order of other vehicles at the intersection by applying the set of right-of-way rules to a determined order of arrival of the other vehicles at the intersection relative to arrival of the equipped vehicle at the intersection; and

wherein, based on the determined right-of-way order of the other vehicles at the intersection, the ECU determines when the equipped vehicle has the right-of-way at the intersection.

26 . The vehicular vision system of claim 25 , wherein the ECU determines, via processing at the ECU of image data captured by the camera, presence of a stop line associated with the stop light designated for the traffic lane of the road along which the equipped vehicle is traveling.

27 . The vehicular vision system of claim 26 , wherein the ECU, responsive to determining presence of the stop line, controls the equipped vehicle to stop the equipped vehicle at the stop line.

28 . The vehicular vision system of claim 25 , wherein the ECU, as the equipped vehicle approaches the intersection, classifies the intersection as one selected from the group consisting of (i) an all-stop intersection, (ii) a four-way intersection, (iii) a three-way intersection, (iv) a one-way intersection and (v) a cross traffic does not stop intersection.

29 . The vehicular vision system of claim 25 , wherein the ECU, responsive to determining the right-of-way order of vehicles at the intersection, audibly indicates the determined right-of-way order to a driver of the equipped vehicle.

30 . The vehicular vision system of claim 25 , comprising a display disposed within the equipped vehicle for displaying images, and wherein the ECU responsive to determining the right-of-way order of vehicles at the intersection, visually indicates the determined right-of-way order to a driver of the equipped vehicle using the display.

31 . The vehicular vision system of claim 25 , wherein the ECU at least in part controls the equipped vehicle responsive to determining that the equipped vehicle has the right-of-way at the intersection, and wherein the ECU at least in part controls the equipped vehicle by controlling at least one selected from the group consisting of (i) steering of the equipped vehicle, (ii) acceleration of the equipped vehicle and (iii) braking of the equipped vehicle.

32 . The vehicular vision system of claim 25 , wherein the intersection comprises at least one traffic lane that does not stop for the remaining traffic lanes.

Continuity (3)
Continuation 16949920 · Nov 20, 2020
Provisional Application 62939243 · Nov 22, 2019
Related Publication 20240367652A1 · Nov 7, 2024
References Cited (84)
US 5550677A · Schofield et al. · 1996 [cited by applicant]
US 5670935A · Schofield et al. · 1997 [cited by applicant]
US 5949331A · Schofield et al. · 1999 [cited by applicant]
US 6587186B2 · Bamji et al. · 2003 [cited by applicant]
US 6674895B2 · Rafii et al. · 2004 [cited by applicant]
US 6678039B2 · Charbon · 2004 [cited by applicant]
US 6690268B2 · Schofield et al. · 2004 [cited by applicant]
US 6690354B2 · Sze · 2004 [cited by applicant]
US 6693517B2 · McCarthy et al. · 2004 [cited by applicant]
US 6710770B2 · Tomasi et al. · 2004 [cited by applicant]
US 6824281B2 · Schofield et al. · 2004 [cited by applicant]
US 6876775B2 · Torunoglu · 2005 [cited by applicant]
US 6906793B2 · Bamji et al. · 2005 [cited by applicant]
US 6919549B2 · Bamji et al. · 2005 [cited by applicant]
US 7038577B2 · Pawlicki et al. · 2006 [cited by applicant]
US 7053357B2 · Schwarte · 2006 [cited by applicant]
US 7157685B2 · Bamji et al. · 2007 [cited by applicant]
US 7176438B2 · Bamji et al. · 2007 [cited by applicant]
US 7203356B2 · Gokturk et al. · 2007 [cited by applicant]
US 7212663B2 · Tomasi · 2007 [cited by applicant]
US 7283213B2 · O'Connor et al. · 2007 [cited by applicant]
US 7310431B2 · Gokturk et al. · 2007 [cited by applicant]
US 7321111B2 · Bamji et al. · 2008 [cited by applicant]
US 7340077B2 · Gokturk et al. · 2008 [cited by applicant]
US 7352454B2 · Bamji et al. · 2008 [cited by applicant]
US 7375803B1 · Bamji · 2008 [cited by applicant]
US 7379100B2 · Gokturk et al. · 2008 [cited by applicant]
US 7379163B2 · Rafii et al. · 2008 [cited by applicant]
US 7405812B1 · Bamji · 2008 [cited by applicant]
US 7408627B2 · Bamji et al. · 2008 [cited by applicant]
US 7480149B2 · DeWard et al. · 2009 [cited by applicant]
US 7580795B2 · McCarthy et al. · 2009 [cited by applicant]
US 7720580B2 · Higgins-Luthman · 2010 [cited by applicant]
US 7855755B2 · Weller et al. · 2010 [cited by applicant]
US 8013780B2 · Lynam · 2011 [cited by applicant]
US 8027029B2 · Lu et al. · 2011 [cited by applicant]
US 8256821B2 · Lawlor et al. · 2012 [cited by applicant]
US 9036026B2 · Dellantoni et al. · 2015 [cited by applicant]
US 9146898B2 · Ihlenburg et al. · 2015 [cited by applicant]
US 9487159B2 · Achenbach · 2016 [cited by applicant]
US 9575160B1 · Davis et al. · 2017 [cited by applicant]
US 9596387B2 · Achenbach et al. · 2017 [cited by applicant]
US 9599702B1 · Bordes et al. · 2017 [cited by applicant]
US 9689967B1 · Stark et al. · 2017 [cited by applicant]
US 9753121B1 · Davis et al. · 2017 [cited by applicant]
US 9871971B2 · Wang et al. · 2018 [cited by applicant]
US 9896039B2 · Achenbach et al. · 2018 [cited by applicant]
US 10671076B1 · Kobilarov et al. · 2020 [cited by applicant]
US 10684626B1 · Martin · 2020 [cited by examiner]
US 12036990B2 · Joseph et al. · 2024 [cited by applicant]
US 20090295181A1 · Lawlor et al. · 2009 [cited by applicant]
US 20090303077A1 · Onome et al. · 2009 [cited by applicant]
US 20100245066A1 · Sarioglu et al. · 2010 [cited by applicant]
US 20120062743A1 · Lynam · 2012 [cited by examiner]
US 20120218412A1 · Dellantoni et al. · 2012 [cited by applicant]
US 20130222592A1 · Gieseke · 2013 [cited by applicant]
US 20140160284A1 · Achenbach et al. · 2014 [cited by applicant]
US 20140218529A1 · Mahmoud et al. · 2014 [cited by applicant]
US 20140226012A1 · Achenbach · 2014 [cited by applicant]
US 20140375476A1 · Johnson et al. · 2014 [cited by applicant]
US 20150015713A1 · Wang et al. · 2015 [cited by applicant]
US 20150124096A1 · Koravadi · 2015 [cited by applicant]
US 20150158499A1 · Koravadi · 2015 [cited by applicant]
US 20150251599A1 · Koravadi · 2015 [cited by applicant]
US 20150327398A1 · Achenbach et al. · 2015 [cited by applicant]
US 20150352953A1 · Koravadi · 2015 [cited by applicant]
US 20160036917A1 · Koravadi et al. · 2016 [cited by applicant]
US 20160210853A1 · Koravadi · 2016 [cited by applicant]
US 20170222311A1 · Hess et al. · 2017 [cited by applicant]
US 20170254873A1 · Koravadi · 2017 [cited by applicant]
US 20170276788A1 · Wodrich · 2017 [cited by applicant]
US 20170315231A1 · Wodrich · 2017 [cited by applicant]
US 20170356994A1 · Wodrich et al. · 2017 [cited by applicant]
US 20180015875A1 · May et al. · 2018 [cited by applicant]
US 20180045812A1 · Hess · 2018 [cited by applicant]
US 20180231635A1 · Woehlte · 2018 [cited by applicant]
US 20180268695A1 · Agnew et al. · 2018 [cited by applicant]
US 20190049964A1 · Jang et al. · 2019 [cited by applicant]
US 20190339382A1 · Hess et al. · 2019 [cited by applicant]
US 20200001779A1 · Alexander · 2020 [cited by examiner]
US 20200278684A1 · Naserian et al. · 2020 [cited by applicant]
US 20200317224A1 · Yano · 2020 [cited by examiner]
US 20200394911A1 · Harmel et al. · 2020 [cited by applicant]
US 20210046924A1 · Caldwell et al. · 2021 [cited by applicant]