IP Library Granted Patent US 12,589,776
Granted Patent B2
US 12,589,776 · App. 18/507,038 · Granted Mar 31, 2026

Data-driven prediction-based system and method for trajectory planning of autonomous vehicles

Inventors: Xing Sun (San Diego, CA); Wutu Lin (San Diego, CA); Liu Liu (San Diego, CA); Kai-Chieh Ma (San Diego, CA); Zijie Xuan (San Diego, CA); Yufei Zhao (San Diego, CA)
Assignee: CreateAI, Inc.
G05D1/0221B62D15/0255B62D15/026B62D15/0265G05D1/0088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,589,776
App. No.
18/507,038
Granted
Mar 31, 2026
Kind
B2
Abstract

A data-driven prediction-based system and method for trajectory planning of autonomous vehicles are disclosed. A particular embodiment includes: generating a first suggested trajectory for an autonomous vehicle; generating predicted resulting trajectories of proximate agents using a prediction module; scoring the first suggested trajectory based on the predicted resulting trajectories of the proximate agents; generating a second suggested trajectory for the autonomous vehicle and generating corresponding predicted resulting trajectories of proximate agents, if the score of the first suggested trajectory is below a minimum acceptable threshold; and outputting a suggested trajectory for the autonomous vehicle wherein the score corresponding to the suggested trajectory is at or above the minimum acceptable threshold.

Claims (33)

1 . A system comprising:

a data processor; and

a trajectory planning module executable by the data processor and configured to perform a trajectory planning operation for an autonomous vehicle, the trajectory planning operation includes:

generating a suggested trajectory for the autonomous vehicle and a distribution of predicted resulting trajectories for each of proximate agents using a prediction module, the distribution of predicted resulting trajectories being reactions to the suggested trajectory of the autonomous vehicle, wherein the proximate agents are vehicles in vicinity of the autonomous vehicle;

determining whether a score of the suggested trajectory based on the distribution of predicted resulting trajectories of the proximate agents violates or satisfies a pre-defined goal; and

upon determination that the suggested trajectory violates the pre-defined goal, rejecting the suggested trajectory and generating a new suggested trajectory for the autonomous vehicle and a new distribution of predicted resulting trajectories for each of the proximate agents using the prediction module; or

upon determination that the suggested trajectory satisfies the pre-defined goal, providing the suggested trajectory as an output from trajectory planning module,

wherein the trajectory planning operation is repeated until a predetermined condition is met,

wherein the trajectory planning module is configured to cause a vehicle control subsystem of the autonomous vehicle to manipulate the autonomous vehicle to follow the suggested trajectory upon determination that the suggested trajectory satisfies the pre-defined goal.

2 . The system of claim 1 , wherein the predetermined condition is met upon determination that the new suggested trajectory for the autonomous vehicle satisfies the pre-defined goal.

3 . The system of claim 1 , wherein the predetermined condition is met upon determination that an iteration count of the trajectory planning operation has exceeded a maximum iteration count.

4 . The system of claim 1 , wherein the predetermined condition is met upon determination that a time period during which the trajectory planning operation is performed has exceeded a maximum time period.

5 . The system of claim 1 , wherein the score of the suggested trajectory based on the distribution of predicted resulting trajectories of the proximate agents violates the pre-defined goal upon determination that the score of the suggested trajectory is below a minimum acceptable threshold.

6 . The system of claim 1 , wherein the score of the suggested trajectory based on the distribution of predicted resulting trajectories of the proximate agents satisfies the pre-defined goal upon determination that the score of the suggested trajectory is at or above a minimum acceptable threshold.

7 . The system of claim 1 , wherein the distribution of predicted resulting trajectories includes a set of predicted trajectories with probability values obtained based on the suggested trajectory, wherein each of the predicted trajectories in the distribution of predicted resulting trajectories has a corresponding probability value obtained based on the suggested trajectory.

8 . The system of claim 7 , wherein the new suggested trajectory for the autonomous vehicle is generated upon determination that the score of the suggested trajectory corresponding to a highest probability value of the probability values is below a minimum acceptable threshold.

9 . The system of claim 7 , wherein the new suggested trajectory for the autonomous vehicle is not generated upon determination that the score of the suggested trajectory corresponding to a highest probability value of the probability values is at or above a minimum acceptable threshold.

10 . A method comprising:

repeating a trajectory planning operation until a predetermined condition is met,

wherein the trajectory planning operation includes:

generating a suggested trajectory for an autonomous vehicle and a distribution of predicted resulting trajectories for each of proximate agents using a prediction module, the distribution of predicted resulting trajectories being reactions to the suggested trajectory of the autonomous vehicle, wherein the proximate agents are vehicles in vicinity of the autonomous vehicle;

determining whether a score of the suggested trajectory based on the distribution of predicted resulting trajectories of the proximate agents violates or satisfies a pre-defined goal; and

upon determination that the suggested trajectory violates the pre-defined goal, rejecting the suggested trajectory and generating a new suggested trajectory for the autonomous vehicle and a new distribution of predicted resulting trajectories for each of the proximate agents using the prediction module; or

upon determination that the suggested trajectory satisfies the pre-defined goal, providing the suggested trajectory as an output from trajectory planning module,

the method further comprising causing a vehicle control subsystem of the autonomous vehicle to manipulate the autonomous vehicle to follow the suggested trajectory upon determination that the suggested trajectory satisfies the pre-defined goal.

11 . The method of claim 10 , wherein the predetermined condition is met upon determination that the new suggested trajectory for the autonomous vehicle satisfies the pre-defined goal.

12 . The method of claim 10 , wherein the predetermined condition is met upon determination that an iteration count of the trajectory planning operation has exceeded a maximum iteration count.

13 . The method of claim 10 , wherein the predetermined condition is met upon determination that a time period during which the trajectory planning operation is performed has exceeded a maximum time period.

14 . The method of claim 10 , wherein the score of the suggested trajectory based on the distribution of predicted resulting trajectories of the proximate agents violates the pre-defined goal upon determination that the score of the suggested trajectory is below a minimum acceptable threshold.

15 . The method of claim 10 , wherein the score of the suggested trajectory based on the distribution of predicted resulting trajectories of the proximate agents satisfies the pre-defined goal upon determination that the score of the suggested trajectory is at or above a minimum acceptable threshold.

16 . The method of claim 10 , wherein the distribution of predicted resulting trajectories includes a set of predicted trajectories with probability values obtained based on the suggested trajectory, wherein each of the predicted trajectories in the distribution of predicted resulting trajectories has a corresponding probability value obtained based on the suggested trajectory.

17 . The method of claim 16 , wherein the new suggested trajectory for the autonomous vehicle is generated upon determination that the score of the suggested trajectory corresponding to a highest probability value of the probability values is below a minimum acceptable threshold.

18 . The method of claim 16 , wherein the new suggested trajectory for the autonomous vehicle is not generated upon determination that the score of the suggested trajectory corresponding to a highest probability value of the probability values is at or above a minimum acceptable threshold.

Assignments (2)
CHANGE OF NAME Recorded Dec 3, 2025
From: TUSIMPLE, INC.
To: CREATEAI, INC.
Reel/Frame 073832/0485 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 11, 2023
From: SUN, XING; LIN, WUTU; LIU, LIU; MA, KAI-CHIEH; XUAN, ZIJIE; ZHAO, YUFEI
To: TUSIMPLE, INC.
Reel/Frame 065533/0183 →
Continuity (3)
Continuation 16848809 · Apr 14, 2020
Continuation 15698607 · Sep 7, 2017
Related Publication 20240288868A1 · Aug 29, 2024
References Cited (400)
US 6084870A · Wooten et al. · 2000 [cited by applicant]
US 6263088B1 · Crabtree et al. · 2001 [cited by applicant]
US 6594821B1 · Banning et al. · 2003 [cited by applicant]
US 6777904B1 · Degner · 2004 [cited by applicant]
US 6791471B2 · Wehner et al. · 2004 [cited by applicant]
US 6975923B2 · Spriggs · 2005 [cited by applicant]
US 7103460B1 · Breed · 2006 [cited by applicant]
US 7689559B2 · Canright · 2010 [cited by applicant]
US 7742841B2 · Sakai et al. · 2010 [cited by applicant]
US 7783403B2 · Breed · 2010 [cited by applicant]
US 7844595B2 · Canright · 2010 [cited by applicant]
US 8041111B1 · Wilensky · 2011 [cited by applicant]
US 8064643B2 · Stein · 2011 [cited by applicant]
US 8082101B2 · Stein · 2011 [cited by applicant]
US 8164628B2 · Stein · 2012 [cited by applicant]
US 8175376B2 · Marchesotti · 2012 [cited by applicant]
US 8265850B2 · Shin · 2012 [cited by applicant]
US 8271871B2 · Marchesotti · 2012 [cited by applicant]
US 8346480B2 · Trepagnier et al. · 2013 [cited by applicant]
US 8378851B2 · Stein · 2013 [cited by applicant]
US 8392117B2 · Dolgov · 2013 [cited by applicant]
US 8401292B2 · Park · 2013 [cited by applicant]
US 8412449B2 · Trepagnier · 2013 [cited by applicant]
US 8428820B2 · Ottenhues et al. · 2013 [cited by applicant]
US 8436880B2 · Matsushima et al. · 2013 [cited by applicant]
US 8478072B2 · Aisaka · 2013 [cited by applicant]
US 8553088B2 · Stein · 2013 [cited by applicant]
US 8706394B2 · Trepagnier et al. · 2014 [cited by applicant]
US 8718861B1 · Montemerlo et al. · 2014 [cited by applicant]
US 8788134B1 · Litkouhi · 2014 [cited by applicant]
US 8908041B2 · Stein · 2014 [cited by applicant]
US 8917169B2 · Schofield · 2014 [cited by applicant]
US 8963913B2 · Baek · 2015 [cited by applicant]
US 8965621B1 · Urmson · 2015 [cited by applicant]
US 8981966B2 · Stein · 2015 [cited by applicant]
US 8983708B2 · Choe et al. · 2015 [cited by applicant]
US 8993951B2 · Schofield · 2015 [cited by applicant]
US 9002632B1 · Emigh · 2015 [cited by applicant]
US 9008369B2 · Schofield · 2015 [cited by applicant]
US 9025880B2 · Perazzi · 2015 [cited by applicant]
US 9042648B2 · Wang · 2015 [cited by applicant]
US 9081385B1 · Ferguson et al. · 2015 [cited by applicant]
US 9088744B2 · Grauer et al. · 2015 [cited by applicant]
US 9111444B2 · Kaganovich · 2015 [cited by applicant]
US 9117133B2 · Barnes · 2015 [cited by applicant]
US 9118816B2 · Stein · 2015 [cited by applicant]
US 9120485B1 · Dolgov · 2015 [cited by applicant]
US 9122954B2 · Srebnik · 2015 [cited by applicant]
US 9134402B2 · Sebastian · 2015 [cited by applicant]
US 9145116B2 · Clarke · 2015 [cited by applicant]
US 9147255B1 · Zhang · 2015 [cited by applicant]
US 9156473B2 · Clarke · 2015 [cited by applicant]
US 9176006B2 · Stein · 2015 [cited by applicant]
US 9179072B2 · Stein · 2015 [cited by applicant]
US 9183447B1 · Gdalyahu · 2015 [cited by applicant]
US 9185360B2 · Stein · 2015 [cited by applicant]
US 9191634B2 · Schofield · 2015 [cited by applicant]
US 9214084B2 · Grauer et al. · 2015 [cited by applicant]
US 9219873B2 · Grauer et al. · 2015 [cited by applicant]
US 9233659B2 · Rosenbaum · 2016 [cited by applicant]
US 9233688B2 · Clarke · 2016 [cited by applicant]
US 9248832B2 · Huberman · 2016 [cited by applicant]
US 9248834B1 · Ferguson · 2016 [cited by applicant]
US 9248835B2 · Tanzmeister · 2016 [cited by applicant]
US 9251708B2 · Rosenbaum · 2016 [cited by applicant]
US 9277132B2 · Berberian · 2016 [cited by applicant]
US 9280711B2 · Stein · 2016 [cited by applicant]
US 9282144B2 · Tebay et al. · 2016 [cited by applicant]
US 9286522B2 · Stein · 2016 [cited by applicant]
US 9297641B2 · Stein · 2016 [cited by applicant]
US 9299004B2 · Lin · 2016 [cited by applicant]
US 9315192B1 · Zhu · 2016 [cited by applicant]
US 9317033B2 · Ibanez-guzman · 2016 [cited by applicant]
US 9317776B1 · Honda · 2016 [cited by applicant]
US 9330334B2 · Lin · 2016 [cited by applicant]
US 9342074B2 · Dolgov · 2016 [cited by applicant]
US 9347779B1 · Lynch · 2016 [cited by applicant]
US 9355635B2 · Gao · 2016 [cited by applicant]
US 9365214B2 · Ben Shalom · 2016 [cited by applicant]
US 9399397B2 · Mizutani · 2016 [cited by applicant]
US 9418549B2 · Kang et al. · 2016 [cited by applicant]
US 9428192B2 · Schofield · 2016 [cited by applicant]
US 9436880B2 · Bos · 2016 [cited by applicant]
US 9438878B2 · Niebla · 2016 [cited by applicant]
US 9443163B2 · Springer · 2016 [cited by applicant]
US 9446765B2 · Ben Shalom · 2016 [cited by applicant]
US 9459515B2 · Stein · 2016 [cited by applicant]
US 9466006B2 · Duan · 2016 [cited by applicant]
US 9476970B1 · Fairfield · 2016 [cited by applicant]
US 9483839B1 · Kwon et al. · 2016 [cited by applicant]
US 9490064B2 · Hirosawa · 2016 [cited by applicant]
US 9494935B2 · Okumura et al. · 2016 [cited by applicant]
US 9507346B1 · Levinson et al. · 2016 [cited by applicant]
US 9513634B2 · Pack et al. · 2016 [cited by applicant]
US 9531966B2 · Stein · 2016 [cited by applicant]
US 9535423B1 · Debreczeni · 2017 [cited by applicant]
US 9538113B2 · Grauer et al. · 2017 [cited by applicant]
US 9547985B2 · Tuukkanen · 2017 [cited by applicant]
US 9549158B2 · Grauer et al. · 2017 [cited by applicant]
US 9555803B2 · Pawlicki · 2017 [cited by applicant]
US 9568915B1 · Berntorp · 2017 [cited by applicant]
US 9587952B1 · Slusar · 2017 [cited by applicant]
US 9599712B2 · Van Der Tempel et al. · 2017 [cited by applicant]
US 9600889B2 · Boisson et al. · 2017 [cited by applicant]
US 9602807B2 · Crane et al. · 2017 [cited by applicant]
US 9612123B1 · Levinson et al. · 2017 [cited by applicant]
US 9620010B2 · Grauer et al. · 2017 [cited by applicant]
US 9625569B2 · Lange · 2017 [cited by applicant]
US 9628565B2 · Stenneth et al. · 2017 [cited by applicant]
US 9632502B1 · Levinson et al. · 2017 [cited by applicant]
US 9649999B1 · Amireddy et al. · 2017 [cited by applicant]
US 9652860B1 · Maali et al. · 2017 [cited by applicant]
US 9669827B1 · Ferguson et al. · 2017 [cited by applicant]
US 9672446B1 · Vallespi-Gonzalez · 2017 [cited by applicant]
US 9672734B1 · Ratnasingam · 2017 [cited by applicant]
US 9690290B2 · Prokhorov · 2017 [cited by applicant]
US 9691286B2 · Bahrami et al. · 2017 [cited by applicant]
US 9701023B2 · Zhang et al. · 2017 [cited by applicant]
US 9712754B2 · Grauer et al. · 2017 [cited by applicant]
US 9718466B2 · Kim et al. · 2017 [cited by applicant]
US 9720418B2 · Stenneth · 2017 [cited by applicant]
US 9723097B2 · Harris · 2017 [cited by applicant]
US 9723099B2 · Chen · 2017 [cited by applicant]
US 9723233B2 · Grauer et al. · 2017 [cited by applicant]
US 9726754B2 · Massanell et al. · 2017 [cited by applicant]
US 9729860B2 · Cohen et al. · 2017 [cited by applicant]
US 9738280B2 · Rayes · 2017 [cited by applicant]
US 9739609B1 · Lewis · 2017 [cited by applicant]
US 9746550B2 · Nath · 2017 [cited by applicant]
US 9753128B2 · Schweizer et al. · 2017 [cited by applicant]
US 9753141B2 · Grauer et al. · 2017 [cited by applicant]
US 9754490B2 · Kentley et al. · 2017 [cited by applicant]
US 9760837B1 · Nowozin et al. · 2017 [cited by applicant]
US 9766625B2 · Boroditsky et al. · 2017 [cited by applicant]
US 9769456B2 · You et al. · 2017 [cited by applicant]
US 9773155B2 · Shotton et al. · 2017 [cited by applicant]
US 9779276B2 · Todeschini et al. · 2017 [cited by applicant]
US 9785145B2 · Gordon et al. · 2017 [cited by applicant]
US 9785149B2 · Wang et al. · 2017 [cited by applicant]
US 9805294B2 · Liu et al. · 2017 [cited by applicant]
US 9810785B2 · Grauer et al. · 2017 [cited by applicant]
US 9823339B2 · Cohen · 2017 [cited by applicant]
US 9953236B1 · Huang et al. · 2018 [cited by applicant]
US 10019011B1 · Green et al. · 2018 [cited by applicant]
US 10037699B1 · Toyoda et al. · 2018 [cited by applicant]
US 10133275B1 · Kobilarov et al. · 2018 [cited by applicant]
US 10147193B2 · Huang et al. · 2018 [cited by applicant]
US 10223806B1 · Luo et al. · 2019 [cited by applicant]
US 10223807B1 · Luo et al. · 2019 [cited by applicant]
US 10268191B1 · Lockwood et al. · 2019 [cited by applicant]
US 10268200B2 · Fang et al. · 2019 [cited by applicant]
US 10410055B2 · Wang et al. · 2019 [cited by applicant]
US 10449962B2 · Saigusa et al. · 2019 [cited by applicant]
US 10564638B1 · Lockwood et al. · 2020 [cited by applicant]
US 10649458B2 · Sun et al. · 2020 [cited by applicant]
US 11892846B2 · Zhang et al. · 2024 [cited by applicant]
US 20020121989A1 · Burns · 2002 [cited by applicant]
US 20030114980A1 · Klausner et al. · 2003 [cited by applicant]
US 20030174773A1 · Comaniciu et al. · 2003 [cited by applicant]
US 20070183661A1 · El-Maleh et al. · 2007 [cited by applicant]
US 20070183662A1 · Wang et al. · 2007 [cited by applicant]
US 20070230792A1 · Shashua · 2007 [cited by applicant]
US 20070286526A1 · Abousleman et al. · 2007 [cited by applicant]
US 20080249667A1 · Horvitz · 2008 [cited by applicant]
US 20090040054A1 · Wang · 2009 [cited by applicant]
US 20090087029A1 · Coleman et al. · 2009 [cited by applicant]
US 20100049397A1 · Lin · 2010 [cited by applicant]
US 20100111417A1 · Ward et al. · 2010 [cited by applicant]
US 20100226564A1 · Marchesotti · 2010 [cited by applicant]
US 20100256836A1 · Mudalige · 2010 [cited by applicant]
US 20100281361A1 · Marchesotti · 2010 [cited by applicant]
US 20110071731A1 · Eidehall et al. · 2011 [cited by applicant]
US 20110142283A1 · Huang et al. · 2011 [cited by applicant]
US 20110190972A1 · Timmons et al. · 2011 [cited by applicant]
US 20110206282A1 · Aisaka · 2011 [cited by applicant]
US 20110247031A1 · Jacoby · 2011 [cited by applicant]
US 20120041636A1 · Johnson et al. · 2012 [cited by applicant]
US 20120105639A1 · Stein · 2012 [cited by applicant]
US 20120140076A1 · Rosenbaum · 2012 [cited by applicant]
US 20120274629A1 · Baek · 2012 [cited by applicant]
US 20120314070A1 · Zhang et al. · 2012 [cited by applicant]
US 20130051613A1 · Bobbitt et al. · 2013 [cited by applicant]
US 20130083959A1 · Owechko et al. · 2013 [cited by applicant]
US 20130182134A1 · Grundmann et al. · 2013 [cited by applicant]
US 20130204465A1 · Phillips et al. · 2013 [cited by applicant]
US 20130266187A1 · Bulan et al. · 2013 [cited by applicant]
US 20130329052A1 · Chew · 2013 [cited by applicant]
US 20140072170A1 · Zhang et al. · 2014 [cited by applicant]
US 20140104051A1 · Breed · 2014 [cited by applicant]
US 20140142799A1 · Ferguson et al. · 2014 [cited by applicant]
US 20140143839A1 · Ricci · 2014 [cited by applicant]
US 20140145516A1 · Hirosawa · 2014 [cited by applicant]
US 20140198184A1 · Stein · 2014 [cited by applicant]
US 20140207325A1 · Mudalige · 2014 [cited by applicant]
US 20140253722A1 · Smyth · 2014 [cited by applicant]
US 20140303883A1 · Aso · 2014 [cited by applicant]
US 20140321704A1 · Partis · 2014 [cited by applicant]
US 20140334668A1 · Saund · 2014 [cited by applicant]
US 20150046060A1 · Nikovski et al. · 2015 [cited by applicant]
US 20150062304A1 · Stein · 2015 [cited by applicant]
US 20150266390A1 · Shin et al. · 2015 [cited by applicant]
US 20150310370A1 · Burry et al. · 2015 [cited by applicant]
US 20150353082A1 · Lee · 2015 [cited by applicant]
US 20160026787A1 · Nairn et al. · 2016 [cited by applicant]
US 20160037064A1 · Stein · 2016 [cited by applicant]
US 20160094774A1 · Li · 2016 [cited by applicant]
US 20160118080A1 · Chen · 2016 [cited by applicant]
US 20160129907A1 · Kim · 2016 [cited by applicant]
US 20160165157A1 · Stein · 2016 [cited by applicant]
US 20160176398A1 · Prokhorov · 2016 [cited by applicant]
US 20160210528A1 · Duan · 2016 [cited by applicant]
US 20160275766A1 · Venetianer et al. · 2016 [cited by applicant]
US 20160314687A1 · Koshizen · 2016 [cited by applicant]
US 20160321381A1 · English · 2016 [cited by applicant]
US 20160334230A1 · Ross et al. · 2016 [cited by applicant]
US 20160342837A1 · Hong et al. · 2016 [cited by applicant]
US 20160347322A1 · Clarke et al. · 2016 [cited by applicant]
US 20160375907A1 · Erban · 2016 [cited by applicant]
US 20170008519A1 · Vijayan · 2017 [cited by applicant]
US 20170010618A1 · Shashua et al. · 2017 [cited by applicant]
US 20170053169A1 · Cuban et al. · 2017 [cited by applicant]
US 20170120926A1 · Yoon · 2017 [cited by applicant]
US 20170124476A1 · Levinson et al. · 2017 [cited by applicant]
US 20170134631A1 · Zhao et al. · 2017 [cited by applicant]
US 20170177951A1 · Yang et al. · 2017 [cited by applicant]
US 20170210378A1 · Gunaratne · 2017 [cited by applicant]
US 20170248960A1 · Shashua et al. · 2017 [cited by applicant]
US 20170301104A1 · Qian et al. · 2017 [cited by applicant]
US 20170305423A1 · Green · 2017 [cited by applicant]
US 20180141544A1 · Xiao et al. · 2018 [cited by applicant]
US 20180151063A1 · Pun et al. · 2018 [cited by applicant]
US 20180158197A1 · Dasgupta et al. · 2018 [cited by applicant]
US 20180260956A1 · Huang et al. · 2018 [cited by applicant]
US 20180283892A1 · Behrendt et al. · 2018 [cited by applicant]
US 20180286258A1 · Derbanne · 2018 [cited by applicant]
US 20180326982A1 · Paris · 2018 [cited by examiner]
US 20180341269A1 · Lv et al. · 2018 [cited by applicant]
US 20180354518A1 · Inou et al. · 2018 [cited by applicant]
US 20180373980A1 · Huval · 2018 [cited by applicant]
US 20180374341A1 · Branson et al. · 2018 [cited by applicant]
US 20180374359A1 · Li et al. · 2018 [cited by applicant]
US 20190016339A1 · Ishioka · 2019 [cited by applicant]
US 20190025841A1 · Haynes et al. · 2019 [cited by applicant]
US 20190025853A1 · Julian et al. · 2019 [cited by applicant]
US 20190034794A1 · Ogale et al. · 2019 [cited by applicant]
US 20190049987A1 · Djuric et al. · 2019 [cited by applicant]
US 20190065863A1 · Luo et al. · 2019 [cited by applicant]
US 20190066329A1 · Luo et al. · 2019 [cited by applicant]
US 20190066330A1 · Luo et al. · 2019 [cited by applicant]
US 20190072965A1 · Zhang et al. · 2019 [cited by applicant]
US 20190072966A1 · Zhang et al. · 2019 [cited by applicant]
US 20190072973A1 · Sun et al. · 2019 [cited by applicant]
US 20190079526A1 · Vallespi-Gonzalez et al. · 2019 [cited by applicant]
US 20190108384A1 · Wang et al. · 2019 [cited by applicant]
US 20190129436A1 · Sun et al. · 2019 [cited by applicant]
US 20190132391A1 · Thomas et al. · 2019 [cited by applicant]
US 20190132392A1 · Liu et al. · 2019 [cited by applicant]
US 20190210564A1 · Han et al. · 2019 [cited by applicant]
US 20190210613A1 · Sun et al. · 2019 [cited by applicant]
US 20190236950A1 · Li et al. · 2019 [cited by applicant]
US 20190266420A1 · Ge et al. · 2019 [cited by applicant]
US 20190325325A1 · Monteil et al. · 2019 [cited by applicant]
US 20200241546A1 · Sun et al. · 2020 [cited by applicant]
CN 104882025A · 2015 [cited by applicant]
CN 106340197A · 2017 [cited by applicant]
CN 106384540A · 2017 [cited by applicant]
CN 106781591A · 2017 [cited by applicant]
CN 108010360A · 2018 [cited by applicant]
DE 2608513A1 · 1977 [cited by applicant]
EP 1754179A1 · 2007 [cited by applicant]
EP 2448251A2 · 2012 [cited by applicant]
EP 2463843A2 · 2012 [cited by applicant]
EP 2463843A3 · 2013 [cited by applicant]
EP 2761249A1 · 2014 [cited by applicant]
EP 2463843B1 · 2015 [cited by applicant]
EP 2448251A3 · 2015 [cited by applicant]
EP 2946336A2 · 2015 [cited by applicant]
EP 2993654A1 · 2016 [cited by applicant]
EP 3081419A1 · 2016 [cited by applicant]
KR 100802511B1 · 2008 [cited by applicant]
WO 2005098782A1 · 2005 [cited by applicant]
WO WO2005098739A1 · 2005 [cited by applicant]
WO WO2005098751A1 · 2005 [cited by applicant]
WO WO2005098782 · 2005 [cited by applicant]
WO WO2010109419A1 · 2010 [cited by applicant]
WO 2013045612A1 · 2013 [cited by applicant]
WO WO2013045612 · 2013 [cited by applicant]
WO WO2014111814A2 · 2014 [cited by applicant]
WO WO2014111814A3 · 2014 [cited by applicant]
WO 2014166245A1 · 2014 [cited by applicant]
WO 2014201324A1 · 2014 [cited by applicant]
WO WO2014201324 · 2014 [cited by applicant]
WO 2015083009A1 · 2015 [cited by applicant]
WO WO2015083009 · 2015 [cited by applicant]
WO WO2015103159A1 · 2015 [cited by applicant]
WO 2015125022A2 · 2015 [cited by applicant]
WO WO2015125022 · 2015 [cited by applicant]
WO WO2015186002A2 · 2015 [cited by applicant]
WO WO2015186002A3 · 2015 [cited by applicant]
WO 2016090282A1 · 2016 [cited by applicant]
WO 2016135736A2 · 2016 [cited by applicant]
WO WO2016135736 · 2016 [cited by applicant]
WO WO2017013875A1 · 2017 [cited by applicant]
WO 2017079349A1 · 2017 [cited by applicant]
WO 2017079460A2 · 2017 [cited by applicant]
WO 2017094849A1 · 2017 [cited by applicant]
WO 2017095614A1 · 2017 [cited by applicant]
WO WO2017120336A2 · 2017 [cited by applicant]
WO 2018094374A1 · 2018 [cited by applicant]
WO 2019040800A1 · 2019 [cited by applicant]
WO WO2019060927A2 · 2019 [cited by applicant]
WO 2019084491A1 · 2019 [cited by applicant]
WO 2019084494A1 · 2019 [cited by applicant]
WO 2019140277A2 · 2019 [cited by applicant]
WO 2019168986A1 · 2019 [cited by applicant]
Spinello, Luciano, Triebel, Rudolph, Siegwart, Roland, “Multiclass Multimodal Detection and Tracking in Urban Environments”, Sage Journals, vol. 29 issue: 12, pp. 1498-1515 Article first published online: Oct. 7, 2010;I… [cited by applicant]
Matthew Barth, Carrie Malcolm, Theodore Younglove, and Nicole Hill, “Recent Validation Efforts for a Comprehensive Modal Emissions Model”, Transportation Research Record 1750, Paper No. 01-0326, College of Engineering, … [cited by applicant]
Kyoungho Ahn, Hesham Rakha, “The Effects of Route Choice Decisions on Vehicle Energy Consumption and Emissions”, Virginia Tech Transportation Institute, Blacksburg, VA 24061, date unknown. [cited by applicant]
Ramos, Sebastian, Gehrig, Stefan, Pinggera, Peter, Franke, Uwe, Rother, Carsten, “Detecting Unexpected Obstacles for Self-Driving Cars: Fusing Deep Learning and Geometric Modeling”, arXiv:1612.06573v1 [cs.CV] Dec. 20, 2… [cited by applicant]
Schroff, Florian, Dmitry Kalenichenko, James Philbin, (Google), “FaceNet: A Unified Embedding for Face Recognition and Clustering”, CVPR 2015. [cited by applicant]
Dai, Jifeng, Kaiming He, Jian Sun, (Microsoft Research), “Instance-aware Semantic Segmentation via Multi-task Network Cascades”, CVPR 2016. [cited by applicant]
Huval, Brody, Tao Wang, Sameep Tandon, Jeff Kiske, Will Song, Joel Pazhayampaliii, Mykhaylo Andriluka, Pranav Rajpurkar, Toki Migimatsu, Royce Cheng-Yue, Fernando Mujica, Adam Coates, Andrew Y. Ng, “An Empirical Evaluat… [cited by applicant]
Tian Li, “Proposal Free Instance Segmentation Based on Instance-aware Metric”, Department of Computer Science, Cranberry-Lemon University, Pittsburgh, PA., date unknown. [cited by applicant]
Mohammad Norouzi, David J. Fleet, Ruslan Salakhutdinov, “Hamming Distance Metric Learning”, Departments of Computer Science and Statistics, University of Toronto, date unknown. [cited by applicant]
Jain, Suyong Dutt, Grauman, Kristen, “Active Image Segmentation Propagation”, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, Jun. 2016. [cited by applicant]
MacAodha, Oisin, Campbell, Neill D.F., Kautz, Jan, Brostow, Gabriel J., “Hierarchical Subquery Evaluation for Active Learning on a Graph”, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition… [cited by applicant]
Kendall, Alex, Gal, Yarin, “What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision”. arXiv:1703.04977v1 [cs.CV] Mar. 15, 2017. [cited by applicant]
Wei, Junqing, John M. Dolan, Bakhtiar Litkhouhi, “A Prediction- and Cost Function-Based Algorithm for Robust Autonomous Freeway Driving”, 2010 IEEE Intelligent Vehicles Symposium, University of California, San Diego, CA… [cited by applicant]
Peter Welinder, Steve Branson, Serge Belongie, Pietro Perona, “The Multidimensional Wisdom of Crowds”; http://www.vision.caltech.edu/visipedia/papers/WelinderEtalNIPS10.pdf, 2010. [cited by applicant]
Kai Yu, Yang Zhou, Da Li, Zhang Zhang, Kaiqi Huang, “Large-scale Distributed Video Parsing and Evaluation Platform”, Center for Research on Intelligent Perception and Computing, institute of Automation, Chinese Academy … [cited by applicant]
P. Guarneri, G. Rocca and M. Gobbi, “A Neural-Network-Based Model for the Dynamic Simulation of the Tire/Suspension System While Traversing Road Irregularities,” in IEEE Transactions on Neural Networks, vol. 19, No. 9, … [cited by applicant]
C. Yang, Z. Li, R. Cui and B. Xu, “Neural Network-Based Motion Control of an Underactuated Wheeled Inverted Pendulum Model,” in IEEE Transactions on Neural Networks and Learning Systems, vol. 25, No. 11, pp. 2004-2016, … [cited by applicant]
Stephan R. Richter, Vibhav Vineet, Stefan Roth, Vladlen Koltun, “Playing for Data: Ground Truth from Computer Games”, Intel Labs, European Conference on Computer Vision (ECCV), Amsterdam, the Netherlands, 2016. [cited by applicant]
Thanos Athanasiadis, Phivos Mylonas, Yannis Avrithis, and Stefanos Kollias, “Semantic Image Segmentation and Object Labeling”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, No. 3, Mar. 2007. [cited by applicant]
Marius Cordts, Mohamed Omran, Sebastian Ramos, Timo Rehfeld, Markus Enzweiler Rodrigo Benenson, Uwe Franke, Stefan Roth, and Bernt Schiele, “The Cityscapes Dataset for Semantic Urban Scene Understanding”, Proceedings of… [cited by applicant]
Adhiraj Somani, Nan Ye, David Hsu, and Wee Sun Lee, “DESPOT: Online POMDP Planning with Regularization”, Department of Computer Science, National University of Singapore, date unknown. [cited by applicant]
Adam Paszke, Abhishek Chaurasia, Sangpil Kim, and Eugenio Culurciello. Enet: A deep neural network architecture for real-time semantic segmentation. CoRR, abs/1606.02147, 2016. [cited by applicant]
PCT International Search Report and Written Opinion, International Appl. No. PCT/US18/59689, International filing date Nov. 7, 2018, mailing date Apr. 24, 2019. [cited by applicant]
Hou, Xiaodi and Zhang, Liqing, “Saliency Detection: A Spectral Residual Approach”, Computer Vision and Pattern Recognition, CVPR'07—IEEE Conference, pp. 1-8, 2007. [cited by applicant]
Hou, Xiaodi and Harel, Jonathan and Koch, Christof, “Image Signature: Highlighting Sparse Salient Regions”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, No. 1, pp. 194-201, 2012. [cited by applicant]
Hou, Xiaodi and Zhang, Liqing, “Dynamic Visual Attention: Searching For Coding Length Increments”, Advances in Neural Information Processing Systems, vol. 21, pp. 681-688, 2008. [cited by applicant]
Li, Yin and Hou, Xiaodi and Koch, Christof and Rehg, James M. and Yuille, Alan L., “The Secrets of Salient Object Segmentation”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 280-287… [cited by applicant]
Zhou, Bolei and Hou, Xiaodi and Zhang, Liqing, “A Phase Discrepancy Analysis of Object Motion”, Asian Conference on Computer Vision, pp. 225-238, Springer Berlin Heidelberg, 2010. [cited by applicant]
Hou, Xiaodi and Yuille, Alan and Koch, Christof, “Boundary Detection Benchmarking: Beyond F-Measures”, Computer Vision and Pattern Recognition, CVPR'13, vol. 2013, pp. 1-8, IEEE, 2013. [cited by applicant]
Hou, Xiaodi and Zhang, Liqing, “Color Conceptualization”, Proceedings of the 15th ACM International Conference on Multimedia, pp. 265-268, ACM, 2007. [cited by applicant]
Hou, Xiaodi and Zhang, Liqing, “Thumbnail Generation Based on Global Sallency”, Advances in Cognitive Neurodynamics, ICCN 2007, pp. 999-1003, Springer Netherlands, 2008. [cited by applicant]
Hou, Xiaodi and Yuille, Alan and Koch, Christof, “A Meta-Theory of Boundary Detection Benchmarks”, arXiv preprint arXiv:1302.5985, 2013. [cited by applicant]
Li, Yanghao and Wang, Naiyan and Shi, Jianping and Liu, Jiaying and Hou, Xiaodi, “Revisiting Batch Normalization for Practical Domain Adaptation”, arXiv preprint arXiv:1603.04779, 2016. [cited by applicant]
Li, Yanghao and Wang, Naiyan and Liu, Jiaying and Hou, Xiaodi, “Demystifying Neural Style Transfer”, arXiv preprint arXiv:1701.01036, 2017. [cited by applicant]
Hou, Xiaodi and Zhang, Liqing, “A Time-Dependent Model of Information Capacity of Visual Attention”, International Conference on Neural Information Processing, pp. 127-136, Springer Berlin Heidelberg, 2006. [cited by applicant]
Wang, Panqu and Chen, Pengfei and Yuan, Ye and Liu, Ding and Huang, Zehua and Hou, Xiaodi and Cottrell, Garrison, “Understanding Convolution for Semantic Segmentation”, arXiv preprint arXiv:1702.08502, 2017. [cited by applicant]
Li, Yanghao and Wang, Naiyan and Liu, Jiaying and Hou, Xiaodi, “Factorized Bilinear Models for Image Recognition”, arXiv preprint arXiv:1611.05709, 2016. [cited by applicant]
Hou, Xiaodi, “Computational Modeling and Psychophysics in Low and Mid-Level Vision”, California Institute of Technology, 2014. [cited by applicant]
Ducher, Alban. European Application No. 18854601.4, European Exam Report Mailed Mar. 23, 2022, pp. 1-5. [cited by applicant]
Ducher, Alban. European Application No. 18854601.4, European Exam Report Mailed Nov. 18, 2022, pp. 1-5. [cited by applicant]
Chinese Application No. 201880058298.8, Notice of Decision to Grant Mailed Jul. 27, 2022, pp. 1-2. [cited by applicant]
Chinese Application No. 201880058298.8, Office Action Mailed Feb. 8, 2022, pp. 1-14. [cited by applicant]
Ducher, Alban. European Application No. 18854601.4, Extended European Search Report Mailed Apr. 13, 2021, pp. 1-9. [cited by applicant]
Rameau, Pascal. European Application No. 19788382.0, Extended European Search Report Mailed Nov. 2, 2021, pp. 1-11. [cited by applicant]
Chaudhari, Pratick et al. “Incremental minimum-violating control synthesis for robots interacting with external agents” 2015 American Control Conference (ACC), IEEE, Jun. 4, 2014, pp. 1761-1768. [cited by applicant]
Office Action from corresponding Chinese Application No. 2018800584860, dated Jan. 28, 2023. [cited by applicant]
Search Report from corresponding Chinese Application No. 2018800584860, dated Jan. 15, 2023. [cited by applicant]
Examination Report from corresponding EuropeanAustralian Patent Application No. 2018330031, dated Dec. 15, 2022 (5 pages). [cited by applicant]
International Preliminary Report on Patentability, International Application No. PCT/2018/059689, Mailed Mar. 10, 2020., Mar. 10, 2020. [cited by applicant]
PCT International Search Report and Written Opinion, International Application No. PCT/US2018/059689, Mailed Apr. 24, 2019., Apr. 24, 2019. [cited by applicant]
Ahn, Kyoungho , et al., “The Effects of Route Choice Decisions on Vehicle Energy Consumption and Emissions”, Virginia Tech Transportation Institute, date unknown. [cited by applicant]
Athanasiadis, Thanos , et al., “Semantic Image Segmentation and Object Labeling”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, No. 3, Mar. 2007., Mar. 2007. [cited by applicant]
Barth, Matthew , et al., “Recent Validation Efforts for a Comprehensive Modal Emissions Model”, Transportation Research Record 1750, Paper No. 01-0326, College of Engineering, Center for Environmental Research and Tech.… [cited by applicant]
Cordts, Marius , et al., “The Cityscapes Dataset for Semantic Urban Scene Understanding”, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, Nevada, 2016., … [cited by applicant]
Dai, Jifeng , et al., “Instance-aware Semantic Segmentation via Multi-task Network Cascades”, CVPR 2016., 2016. [cited by applicant]
Guarneri, Paolo , et al., “A Neural-Network Based Model for the Dynamic Simulation of the Tire/Suspension System While Traversing Road Irregularities”, IEEE Transactions on Neural Networks, vol. 19, No. 9, pp. 1549-1563… [cited by applicant]
Hou, Xiaodi , et al., “A Meta-Theory of Boundary Detection Benchmarks”, arXiv Preprint arXiv: 1302.5985, 2013., 2013. [cited by applicant]
Hou, Xiaodi , et al., “A Time-Dependent Model of Information Capacity of Visual Attention”, International Conference on Neural Information Processing, pp. 127-136, Springer Berlin Heidelberg, 2006., 2006, pp. 127-136. [cited by applicant]
Hou, Xiaodi , et al., “Boundary Detection Benchmarking: Beyond F-Measures”, Computer Vision and Pattern Recognition, CVPR'13, vol. 2013, pp. 1-8, IEEE, 2013., pp. 1-8. [cited by applicant]
Hou, Xiaodi , et al., “Color Conceptualization”, Proceedings of the 15th ACM International Conference on Multimedia, pp. 265-268, ACM, 2007., 2007, pp. 265-268. [cited by applicant]
Hou, Xiaodi , “Computational Modeling and Psychophysics in Low and Mid-Level Vision”, California Institute of Technology, 2014., 2014. [cited by applicant]
Hou, Xiaodi , et al., “Dynamic Visual Attention: Searching for Coding Length Increments”, Advances in Neural Information Processing Systems, vol. 21, pp. 681-688, 2008., 2008, pp. 681-688. [cited by applicant]
Hou, Xiaodi , et al., “Image Signature: Highlighting Sparse Salient Regions”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, No. 1, pp. 194-201, 2012., 2012, pp. 194-201. [cited by applicant]
Hou, Xiaodi , et al., “Saliency Detection: A Spectral Residual Approach”, Computer Vision and Pattern Recognition, CVPR'07—IEEE Conference, pp. 1-8, 2007, 2007, pp. 1-8. [cited by applicant]
Hou, Xiaodi , et al., “Thumbnail Generation Based on Global Saliency”, Advances in Cognitive Neurodynamics, ICCN 2007, pp. 999-1003, Springer Netherlands, 2008., 2008, 999-1003. [cited by applicant]
Huval, Brody , et al., “An Empirical Evaluation of Deep Learning on Highway Driving”, arXiv: 1504.01716v3 [cs.RO], Apr. 17, 2015., Apr. 17, 2015. [cited by applicant]
Jain, Suyong Dutt , et al., “Active Image Segmentation Propagation”, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, Jun. 2016., Jun. 2016. [cited by applicant]
Kendall, Alex , et al., “What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision”, arXiv: 1703.04977v1 [csCV], Mar. 15, 2017., Mar. 15, 2017. [cited by applicant]
Li, Yanghao , et al., “Demystifying Neural Style Transfer”, arXiv preprint arXiv: 1701.01036, 2017., 2017. [cited by applicant]
Li, Yanghao , et al., “Factorized Bilinear Models for Image Recognition”, arXiv preprint arXiv: 1611.05709, 2016., 2016. [cited by applicant]
Li, Tian , “Proposal Free Instance Segmentation Based on Instance-aware Metric”, Department of Computer Science, Cranberry-Lemon University, Pittsburgh, PA, date unknown. [cited by applicant]
Li, Yanghao , et al., “Revisiting Batch Normalization for Practical Domain Adaptation”, arXiv preprint arXiv: 1603.04779, 2016., 2016. [cited by applicant]
Li, Yin , et al., “The Secrets of Salient Object Segmentation”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 280-287, 2014., 2014, pp. 280-287. [cited by applicant]
Macaodha, Oisin , et al., “Hierarchical Subquery Evaluation for Active Learning on a Graph”, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014., 2014. [cited by applicant]
Norouzi, Mohammad , et al., “Hamming Distance Metric Learning”, Departments of Computer Science and Statistics, University of Toronto, date unknown. [cited by applicant]
Paszke, Adam , et al., “Enet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation”, CoRR, abs/1606.02147, 2016., 2016. [cited by applicant]
Ramos, Sebastian , et al., “Detecting Unexpected Obstacles for Self-Driving Cars: Fusing Deep Learning and Geometric Modeling”, arXiv: 1612.06573v1 [cs.CV], Dec. 20, 2016., Dec. 20, 2016. [cited by applicant]
Richter, Stephan R, et al., “Playing for Data: Ground Truth from Computer Games”, Intel Labs, European Conference on Computer Vision (ECCV), Amsterdam, Netherlands, 2016., 2016. [cited by applicant]
Schroff, Florian , et al., “FaceNet: A Unified Embedding for Face Recognition and Clustering”, CVPR 2015., 2015. [cited by applicant]
Somani, Adhiraj , et al., “DESPOT: Online POMDP Planning with Regularization”, Department of Computer Science, National University of Singapore, date unknown. [cited by applicant]
Spinello, Luciano , et al., “Multiclass Multimodal Detection and Tracking in Urban Environments”, Sage Journals, vol. 29, Issue: 12, pp. 1498-1515, Oct. 1, 2010., Oct. 1, 2010, pp. 1498-1515. [cited by applicant]
Szeliski, Richard , “Computer Vision: Algorithms and Applications”, http://szeliski.org/book, 2010., 2010. [cited by applicant]
Wang, Panqu , et al., “Understanding Convolution for Semantic Segmentation”, arXiv preprint arXiv: 1702.08502, 2017., 2017. [cited by applicant]
Wei, Junqing , et al., “A Prediction- and Cost Function-Based Algorithm for Robust Autonomous Freeway Driving”, 2010 IEEE Intelligent Vehicles Symposium, University of California, San Diego, CA, USA, Jun. 21-24, 2010., … [cited by applicant]
Welinder, Peter , et al., “The Multidimensional Wisdom of Crowds”, http://www.vision.caltech.edu/visipedia/papers/WelinderEtalNIPS.pdf, 2010., 2010. [cited by applicant]