IP Library Granted Patent US 12,468,269
Granted Patent B2
US 12,468,269 · App. 17/728,053 · Granted Nov 11, 2025

Detection of driving actions that mitigate risk

Inventors: Michael Campos (La Jolla, CA); Anubhav (Bangalore, IN); Venkata Sreekanta Reddy Annapureddy (San Diego, CA); Vikram Gupta (Bangalore, IN); Hisham Rahman (Bangalore, IN); Sneha Aenugu (Bangalore, IN); Priyam Bakliwal (Bangalore, IN); Alexander Thomas (Bangalore, IN); Adam David Kahn (San Diego, CA); David Jonathan Julian (San Diego, CA); Sandeep Pandya (Irvine, CA); Avneesh Agrawal (Bangaluru, IN)
Assignee: NETRADYNE, INC.
G05B13/027B60R11/04G06V20/58G06V20/588
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,468,269
App. No.
17/728,053
Granted
Nov 11, 2025
Kind
B2
Abstract

Systems and methods are provided for detecting a driving action that mitigates risk.

Claims (57)

1 . A computer-implemented method comprising:

determining, using a camera coupled to a first vehicle, a position of a second vehicle;

determining that the second vehicle is about to enter a lane in which the first vehicle is traveling and that the first vehicle is driving faster than the second vehicle, causing a predicted risk based on a following distance that is shorter than a threshold distance;

determining that a driver of the first vehicle performs a defensive driving action that is:

responsive to the predicted risk;

initiated prior to the driver being presented with any form of message regarding the predicted risk; and

at least as safe as a typical driver in a same defensive driving scenario; and

generating an alert notification based on the determination that the driver performed the defensive driving action, wherein the alert notification comprises an identification of the predicted risk based on the following distance that is shorter than the threshold distance and an identification of the defensive driving action that mitigated the predicted risk.

2 . The computer implemented method of claim 1 , further comprising:

assessing an updated risk after the driver of the first vehicle performed the defensive driving action; and

comparing the updated risk after the driver of the first vehicle performed the defensive driving action with the predicted risk had the driver not performed the defensive driving action.

3 . The computer-implemented method of claim 1 , wherein the defensive driving action includes slowing down the first vehicle or moving the first vehicle to a different lane.

4 . The computer-implemented method of claim 1 , wherein the defensive driving action includes slowing down the first vehicle within a time period leading up to or just after the second vehicle moved into the lane in which the first vehicle is traveling.

5 . The computer-implemented method of claim 4 , further comprising:

determining that the distance between the first vehicle and the second vehicle has increased in the time period.

6 . The computer-implemented method of claim 1 , further comprising:

determining that a following distance between the first vehicle and the second vehicle will be below a predetermined threshold if the second vehicle enters the lane in which the first vehicle is traveling.

7 . The computer-implemented method of claim 1 , further comprising:

transmitting data to a remote device, wherein the data includes an inference that the driver performed the defensive driving action that mitigated risk.

8 . The computer-implemented method of claim 7 , wherein the data includes video data from the camera.

9 . The computer-implemented method of claim 8 , further comprising:

training an autonomous vehicle driving system with the video data.

10 . The computer-implemented method of claim 1 , wherein the second vehicle is about to enter the lane in which the first vehicle is traveling from a merging lane of a highway.

11 . A system comprising:

at least one memory unit; and

at least one processor coupled to the at least one memory unit, in which the at least one processor is configured to:

determine, using a camera coupled to a first vehicle, a position of a second vehicle;

determine that the second vehicle is about to enter a lane in which the first vehicle is traveling and that the first vehicle is driving faster than the second vehicle, causing a predicted risk based on a following distance that is shorter than a threshold distance;

determine whether a driver of the first vehicle performs a defensive driving action that is:

responsive to the predicted risk;

initiated prior to the driver being presented with any form of message regarding the predicted risk; and

at least as safe as a typical driver in a same defensive driving scenario; and

generate an alert notification based on the determination that the driver performed the defensive driving action, wherein the alert notification comprises an identification of the predicted risk based on the following distance that is shorter than the threshold distance and an identification of the defensive driving action that mitigated the predicted risk.

12 . The system of claim 11 , wherein the at least one processor is further configured to:

assess an updated risk after the driver of the first vehicle performed the defensive driving action; and

compare the updated risk after the driver of the first vehicle performed the defensive driving action with the predicted risk had the driver not performed the defensive driving action.

13 . The system of claim 11 , wherein the defensive driving action includes slowing down the first vehicle or moving the first vehicle to a different lane.

14 . The system of claim 11 , wherein the at least one processor is further configured to:

transmitting data to a remote device, wherein the data includes an inference that the driver performed the defensive driving action that mitigated risk.

15 . The system of claim 14 , wherein the data includes video data from the camera, and wherein the at least one processor is further configured to:

train an autonomous vehicle driving system with the video data.

16 . A machine-readable storage medium having computer-executable instructions stored thereon that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

determining, using a camera coupled to a first vehicle, a position of a second vehicle;

determining that the second vehicle is about to enter a lane in which the first vehicle is traveling and that the first vehicle is driving faster than the second vehicle, causing a predicted risk based on a following distance that is shorter than a threshold distance;

determining whether a driver of the first vehicle performs a defensive driving action that is:

responsive to the predicted risk;

initiated prior to the driver being presented with any form of message regarding the predicted risk; and

at least as safe as a typical driver in a same defensive driving scenario; and

generating an alert notification based on the determination that the driver performed the defensive driving action, wherein the alert notification comprises an identification of the predicted risk based on the following distance that is shorter than the threshold distance and an identification of the defensive driving action that mitigated the predicted risk.

17 . The machine-readable storage medium of claim 16 , wherein the operations further comprise:

assessing an updated risk after the driver of the first vehicle performed the defensive driving action; and

comparing the updated risk after the driver of the first vehicle performed the defensive driving action with the predicted risk had the driver not performed the defensive driving action.

18 . The machine-readable storage medium of claim 16 , wherein the defensive driving action includes slowing down the first vehicle or moving the first vehicle to a different lane.

19 . The machine-readable storage medium of claim 16 , wherein the operations further comprise:

transmitting data to a remote device, wherein the data includes an inference that the driver performed the defensive driving action that mitigated risk.

20 . The machine-readable storage medium of claim 19 , wherein the data includes video data from the camera, and wherein the operations further comprise:

training an autonomous vehicle driving system with the video data.

Assignments (3)
SECURITY INTEREST Recorded Apr 6, 2026
From: NETRADYNE, INC.
To: FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 075435/0670 →
SECURITY INTEREST Recorded Apr 6, 2026
From: NETRADYNE, INC.
To: FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 075359/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 25, 2022
From: CAMPOS, MICHAEL; GUPTA, ANUBHAV; ANNAPUREDDY, VENKATA SREEKANTA REDDY; GUPTA, VIKRAM; RAHMAN, HISHAM; AENUGU, SNEHA; BAKLIWAL, PRIYAM; THOMAS, ALEXANDER; KAHN, ADAM DAVID; JULIAN, DAVID JONATHAN; PANDYA, SANDEEP; AGRAWAL, AVNEESH
To: NETRADYNE, INC.
Reel/Frame 059696/0257 →
Continuity (6)
Continuation 16948458 · Sep 18, 2020
Continuation 16702118 · Dec 3, 2019
Continuation PCTUS2018055631 · Oct 12, 2018
Provisional Application 62573120 · Oct 16, 2017
Provisional Application 62571617 · Oct 12, 2017
Related Publication 20220253021A1 · Aug 11, 2022
References Cited (171)
US 5808728A · Uehara · 1998 [cited by applicant]
US 6188329B1 · Glier et al. · 2001 [cited by applicant]
US 6281808B1 · Glier et al. · 2001 [cited by applicant]
US 6768944B2 · Breed et al. · 2004 [cited by applicant]
US 6985827B2 · Williams et al. · 2006 [cited by applicant]
US 7254482B2 · Kawasaki et al. · 2007 [cited by applicant]
US 7825825B2 · Park · 2010 [cited by applicant]
US 7957559B2 · Shima et al. · 2011 [cited by applicant]
US 8031062B2 · Smith · 2011 [cited by applicant]
US 8144030B1 · Lipke · 2012 [cited by applicant]
US 8258982B2 · Miura · 2012 [cited by applicant]
US 8446781B1 · Rajan et al. · 2013 [cited by applicant]
US 8531520B2 · Stricklin et al. · 2013 [cited by applicant]
US 8560164B2 · Nielsen et al. · 2013 [cited by applicant]
US 8645535B1 · Martini · 2014 [cited by applicant]
US 8676492B2 · Litkouhi et al. · 2014 [cited by applicant]
US 8773281B2 · Ghazarian · 2014 [cited by applicant]
US 8855904B1 · Templeton et al. · 2014 [cited by applicant]
US 8912016B2 · Godo et al. · 2014 [cited by applicant]
US 8972076B2 · Ogawa · 2015 [cited by applicant]
US 9047773B2 · Chen et al. · 2015 [cited by applicant]
US 9081650B1 · Brinkmann et al. · 2015 [cited by applicant]
US 9104535B1 · Brinkmann et al. · 2015 [cited by applicant]
US 9147353B1 · Slusar · 2015 [cited by examiner]
US 9158980B1 · Ferguson et al. · 2015 [cited by applicant]
US 9524269B1 · Brinkmann et al. · 2016 [cited by applicant]
US 9535878B1 · Brinkmann et al. · 2017 [cited by applicant]
US 9558656B1 · Brinkmann et al. · 2017 [cited by applicant]
US 9672734B1 · Ratnasingam · 2017 [cited by applicant]
US 9834139B1 · Park · 2017 [cited by examiner]
US 10004000B2 · Li et al. · 2018 [cited by applicant]
US 10029696B1 · Ferguson · 2018 [cited by applicant]
US 10053010B2 · Thompson et al. · 2018 [cited by applicant]
US 10151840B2 · Itoh et al. · 2018 [cited by applicant]
US 10157423B1 · Fields et al. · 2018 [cited by applicant]
US 10176524B1 · Brandmaier et al. · 2019 [cited by applicant]
US 10192446B2 · Mueller · 2019 [cited by examiner]
US 10229461B2 · Akiva et al. · 2019 [cited by applicant]
US 10347127B2 · Droz et al. · 2019 [cited by applicant]
US 10407078B2 · Ratnasingam · 2019 [cited by applicant]
US 10449967B1 · Ferguson · 2019 [cited by applicant]
US 10475338B1 · Noel · 2019 [cited by applicant]
US 10782654B2 · Campos et al. · 2020 [cited by applicant]
US 10796369B1 · Augustine et al. · 2020 [cited by applicant]
US 10803525B1 · Augustine et al. · 2020 [cited by applicant]
US 11004000B1 · Gutmann · 2021 [cited by examiner]
US 11314209B2 · Campos · 2022 [cited by examiner]
US 20020054210A1 · Glier et al. · 2002 [cited by applicant]
US 20040054513A1 · Laird et al. · 2004 [cited by applicant]
US 20040101166A1 · Williams et al. · 2004 [cited by applicant]
US 20070027583A1 · Tamir et al. · 2007 [cited by applicant]
US 20070142995A1 · Wotlermann · 2007 [cited by applicant]
US 20070193811A1 · Breed et al. · 2007 [cited by applicant]
US 20080130302A1 · Watanabe · 2008 [cited by applicant]
US 20080162027A1 · Murphy et al. · 2008 [cited by applicant]
US 20090115632A1 · Park · 2009 [cited by applicant]
US 20090265069A1 · Desbrunes · 2009 [cited by applicant]
US 20090284361A1 · Boddie et al. · 2009 [cited by applicant]
US 20100023296A1 · Huang et al. · 2010 [cited by applicant]
US 20100033571A1 · Fujita et al. · 2010 [cited by applicant]
US 20100045799A1 · Lei et al. · 2010 [cited by applicant]
US 20100052883A1 · Person · 2010 [cited by applicant]
US 20100073194A1 · Ghazarian · 2010 [cited by applicant]
US 20100145600A1 · Son et al. · 2010 [cited by applicant]
US 20100157061A1 · Katsman et al. · 2010 [cited by applicant]
US 20100198491A1 · Mays · 2010 [cited by applicant]
US 20100238262A1 · Kurtz et al. · 2010 [cited by applicant]
US 20110071746A1 · O'Connor et al. · 2011 [cited by applicant]
US 20110077028A1 · Wilkes, III · 2011 [cited by examiner]
US 20110182475A1 · Fairfield et al. · 2011 [cited by applicant]
US 20120033896A1 · Barrows · 2012 [cited by applicant]
US 20120056756A1 · Yester · 2012 [cited by applicant]
US 20120095646A1 · Ghazarian · 2012 [cited by applicant]
US 20120179358A1 · Chang et al. · 2012 [cited by applicant]
US 20120194357A1 · Ciolli · 2012 [cited by applicant]
US 20120288138A1 · Zeng · 2012 [cited by applicant]
US 20130096731A1 · Tamari · 2013 [cited by examiner]
US 20130154854A1 · Chen et al. · 2013 [cited by applicant]
US 20130158800A1 · Trageser · 2013 [cited by applicant]
US 20130243261A1 · Matsuda et al. · 2013 [cited by applicant]
US 20130338914A1 · Weiss · 2013 [cited by applicant]
US 20130344859A1 · Abramson et al. · 2013 [cited by applicant]
US 20140016826A1 · Fairfield et al. · 2014 [cited by applicant]
US 20140032089A1 · Aoude et al. · 2014 [cited by applicant]
US 20140114526A1 · Erb · 2014 [cited by applicant]
US 20140122392A1 · Nicholson et al. · 2014 [cited by applicant]
US 20140236414A1 · Droz et al. · 2014 [cited by applicant]
US 20150025784A1 · Kastner et al. · 2015 [cited by applicant]
US 20150039175A1 · Martin et al. · 2015 [cited by applicant]
US 20150039350A1 · Martin et al. · 2015 [cited by applicant]
US 20150105989A1 · Lueke et al. · 2015 [cited by applicant]
US 20150112504A1 · Binion et al. · 2015 [cited by applicant]
US 20150170002A1 · Szegedy et al. · 2015 [cited by applicant]
US 20150175168A1 · Hoye et al. · 2015 [cited by applicant]
US 20150178578A1 · Hampiholi et al. · 2015 [cited by applicant]
US 20150178998A1 · Attard et al. · 2015 [cited by applicant]
US 20150193885A1 · Akiva et al. · 2015 [cited by applicant]
US 20150194035A1 · Akiva et al. · 2015 [cited by applicant]
US 20150210274A1 · Clarke et al. · 2015 [cited by applicant]
US 20150222859A1 · Schweid et al. · 2015 [cited by applicant]
US 20150235093A1 · Shima et al. · 2015 [cited by applicant]
US 20150248836A1 · Alselimi · 2015 [cited by applicant]
US 20150281305A1 · Sievert et al. · 2015 [cited by applicant]
US 20150293534A1 · Takamatsu et al. · 2015 [cited by applicant]
US 20150329045A1 · Harris · 2015 [cited by applicant]
US 20150332590A1 · Salomonsson et al. · 2015 [cited by applicant]
US 20150336547A1 · Dagan et al. · 2015 [cited by applicant]
US 20150379869A1 · Ferguson et al. · 2015 [cited by applicant]
US 20160027292A1 · Kerning et al. · 2016 [cited by applicant]
US 20160035223A1 · Gutmann et al. · 2016 [cited by applicant]
US 20160101732A1 · Danz · 2016 [cited by applicant]
US 20160140438A1 · Yang et al. · 2016 [cited by applicant]
US 20160150070A1 · Goren et al. · 2016 [cited by applicant]
US 20160176358A1 · Raghu et al. · 2016 [cited by applicant]
US 20160176397A1 · Prokhorov et al. · 2016 [cited by applicant]
US 20160180707A1 · Macneille et al. · 2016 [cited by applicant]
US 20160187487A1 · Itoh et al. · 2016 [cited by applicant]
US 20160203719A1 · Divekar et al. · 2016 [cited by applicant]
US 20160343254A1 · Rovik et al. · 2016 [cited by applicant]
US 20160358477A1 · Ansari et al. · 2016 [cited by applicant]
US 20170015318A1 · Scofield et al. · 2017 [cited by applicant]
US 20170021863A1 · Thompson et al. · 2017 [cited by applicant]
US 20170036673A1 · Lee et al. · 2017 [cited by applicant]
US 20170080853A1 · Raghu et al. · 2017 [cited by applicant]
US 20170086050A1 · Kerning et al. · 2017 [cited by applicant]
US 20170097243A1 · Ricci · 2017 [cited by applicant]
US 20170113665A1 · Mudalige et al. · 2017 [cited by applicant]
US 20170116485A1 · Mullen · 2017 [cited by applicant]
US 20170174261A1 · Micks et al. · 2017 [cited by applicant]
US 20170200061A1 · Julian et al. · 2017 [cited by applicant]
US 20170200063A1 · Nariyambut et al. · 2017 [cited by applicant]
US 20170206434A1 · Nariyambut et al. · 2017 [cited by applicant]
US 20170217430A1 · Sherony et al. · 2017 [cited by applicant]
US 20170230563A1 · Satou et al. · 2017 [cited by applicant]
US 20170243073A1 · Raghu et al. · 2017 [cited by applicant]
US 20170261991A1 · Raghu et al. · 2017 [cited by applicant]
US 20170279957A1 · Abramson et al. · 2017 [cited by applicant]
US 20170305434A1 · Ratnasingam et al. · 2017 [cited by applicant]
US 20180003965A1 · O'toole et al. · 2018 [cited by applicant]
US 20180017799A1 · Ahmad et al. · 2018 [cited by applicant]
US 20180018869A1 · Ahmad et al. · 2018 [cited by applicant]
US 20180120859A1 · Eagelberg et al. · 2018 [cited by applicant]
US 20180253963A1 · Azevedo · 2018 [cited by applicant]
US 20180300567A1 · Qin et al. · 2018 [cited by applicant]
US 20180321686A1 · Kanzawa et al. · 2018 [cited by applicant]
US 20190005812A1 · Matus et al. · 2019 [cited by applicant]
US 20190031088A1 · Hiramatsu et al. · 2019 [cited by applicant]
US 20190122559A1 · Zhang · 2019 [cited by examiner]
US 20190369637A1 · Shalev-Shwartz et al. · 2019 [cited by applicant]
US 20190377354A1 · Shalev-Shwartz et al. · 2019 [cited by applicant]
JP 2015055921A · 2015 [cited by applicant]
JP 2017151694A · 2017 [cited by examiner]
KR 1020140080105 · 2012 [cited by examiner]
KR 20140080105A · 2014 [cited by applicant]
KR 1020140080105A · 2014 [cited by applicant]
WO 2017123665A1 · 2017 [cited by applicant]
WO 2017165627A1 · 2017 [cited by applicant]
Extended European Search Report in EP Patent Application No. 178737484.9 dated Jul. 1, 2019 (10 pages). [cited by applicant]
Extended European Search Report in EP Patent Application No. 18863528.8 dated Oct. 30, 2020 (9 pages). [cited by applicant]
Extended European Search Report in EP Patent Application No. 18866299.3 dated Oct. 23, 2020, 9 pages. [cited by applicant]
First Examination Report in IN Patent Application No. 20187030012 dated May 31, 2021 (8 pages). [cited by applicant]
Hou et al., “Tube Convolutional Neural Network (T-CNN) for Action Detection in Videos,” Computer Vision Foundation, DOI: 10.1109/ICCV.2017.620, retrieved Jan. 17, 2019 from URL: https://arxiv.org/pdf/1703.10664.pdf (10 … [cited by applicant]
Hunter, et al., “The path inference filter: model-based low-latency map matching of probe vehicle data,”, Algorithmic Foundations of Robotics X, Jun. 20, 2012, arXiv:1109.1966v2, retrieved from URL: https://arxiv.org/pd… [cited by applicant]
International Preliminary Report on Patentability in International Patent Application No. PCT/US2017/013062 dated Mar. 30, 2017 (8 pages). [cited by applicant]
International Preliminary Report on Patentability in International Patent Application No. PCT/US2017/044755 dated Sep. 30, 2018 (33 pages). [cited by applicant]
International Preliminary Report on Patentability in International Patent Application No. PCT/US2018/055631 dated Apr. 14, 2020 (5 pages). [cited by applicant]
International Search Report and Written Opinion in International Patent Application No. PCT/US2018/053636 dated Dec. 7, 2018 (12 pages). [cited by applicant]
International Search Report and Written Opinion in International Patent Application No. PCT/US2017/044755 dated Oct. 17, 2017 (10 pages). [cited by applicant]
International Search Report and Written Opinion in International Patent Application No. PCT/US2017/13062 dated Mar. 30, 2017 (9 pages). [cited by applicant]
International Search Report and Written Opinion in International Patent Application No. PCT/US2018/055631 dated Jan. 4, 2019 (6 pages). [cited by applicant]
Extended European Search Report in EP Patent Application No. 23203631.9 dated Jan. 26, 2024, 7 pages. [cited by applicant]