IP Library Granted Patent US 12,270,661
Granted Patent B2
US 12,270,661 · App. 18/456,015 · Granted Apr 8, 2025

Lane marking localization and fusion

Inventors: Mingdong Wang (San Diego, CA); Chenzhe Qian (San Diego, CA); Xue Mei (San Diego, CA)
Assignee: TUSIMPLE, INC.
G01C21/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,270,661
App. No.
18/456,015
Granted
Apr 8, 2025
Kind
B2
Abstract

Various embodiments provide a system and method for iterative lane marking localization that may be utilized by autonomous or semi-autonomous vehicles traveling within the lane. In an embodiment, the system comprises a locating device adapted to determine the vehicle's geographic location; a database; a region map; a response map; a plurality of cameras; and a computer connected to the locating device, database, and cameras, wherein the computer is adapted to receive the region map, wherein the region map corresponds to a specified geographic location; generate the response map by receiving information from the camera, the information relating to the environment in which the vehicle is located; identifying lane markers observed by the camera; and plotting identified lane markers on the response map; compare the response map to the region map; and iteratively generate a predicted vehicle location based on the comparison of the response map and the region map.

Claims (42)

1. A method for determining a location of a vehicle, comprising:

receiving a first region map and a second region map from a database;

receiving a first response image and a second response image generated by different imaging devices respectively, the first response image and the second response image comprising information relating to an environment of the vehicle;

generating a first response map from the first response image, and a second response map from the second response image;

generating a first location of the vehicle based on a comparison of the first response map and the first region map;

generating a second location of the vehicle based on a comparison of the second response map and the second region map; and

predicting the location of the vehicle based on the first location and the second location.

2. The method of claim 1 , wherein at least one of the first region map or the second region map includes information from a previously generated vehicle location.

3. The method of claim 1 , wherein the first response map includes information pertaining to a same structure as defined in the first region map and the second response map includes information pertaining to a same structure as defined in the second region map.

4. The method of claim 1 , further comprising:

identifying lanes of a travel of the vehicle in the first region map; and

determining a lateral position of the vehicle within a lane.

5. The method of claim 1 , further comprising:

generating a confidence score of the location of the vehicle; and

outputting the location of the vehicle to an advanced driver assistance system (ADAS) of the vehicle based the confidence score.

6. The method of claim 1 , further comprising:

receiving a third region map from the database;

receiving a third response image generated by an imaging device, the third response image comprising information relating to the environment of the vehicle;

generating a third response map from the third response image; and

generating a third corrected location of the vehicle based on comparing the third response map to the third region map,

wherein the location of the vehicle is predicted based on the third corrected location.

7. The method of claim 6 , wherein the first response image is generated by a first imaging device, the second response image is generated by a second imaging device, and the third response image is generated by a third imaging device, wherein the first imaging device, the second imaging device, and the third imaging device are each adapted to perceive different aspects of the environment of the vehicle.

8. A system of determining a location of a vehicle, comprising:

a data processor; and

a memory storing instructions executable by the data processor to:

receive a first region map and a second region map from a database;

receive a first response image and a second response image generated by different imaging devices respectively, the first response image and the second response image comprising information relating to an environment of the vehicle;

generate a first response map from the first response image, and a second response map from the second response image;

generate a first location of the vehicle based on a comparison of the first response map and the first region map;

generate a second location of the vehicle based on a comparison of the second response map to the second region map; and

predict the location of the vehicle based on the first location and the second location.

9. The system of claim 8 , wherein at least one of the first region map or the second region map includes information from a previously generated vehicle location.

10. The system of claim 8 , wherein the first response map includes information pertaining to a same structure as defined in the first region map and the second response map includes information pertaining to a same structure as defined in the second region map.

11. The system of claim 8 , wherein the instructions further cause the data processor to:

identify lanes of a travel of the vehicle in the first region map; and

determine a lateral position of the vehicle within a lane.

12. The system of claim 8 , wherein the instructions further cause the data processor to:

generate a confidence score of the location of the vehicle; and

output the location of the vehicle to an advanced driver assistance system (ADAS) of the vehicle based the confidence score.

13. The system of claim 8 , wherein the instructions further cause the data processor to:

detect lane markers in the first response image, the lane markers pertaining to physical aspects contained in the first response image; and

plot a plurality of first response points on the first response map, the plurality of first response points indicating locations of the lane markers.

Assignments (2)
CHANGE OF NAME Recorded Dec 3, 2025
From: TUSIMPLE, INC.
To: CREATEAI, INC.
Reel/Frame 073832/0485 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2023
From: WANG, MINGDONG; QIAN, CHENZHE; MEI, XUE
To: TUSIMPLE, INC.
Reel/Frame 064729/0022 →
Continuity (4)
Continuation 17320888 · May 14, 2021
Continuation 16184926 · Nov 8, 2018
Continuation In Part 15896077 · Feb 14, 2018
Related Publication 20230408264A1 · Dec 21, 2023
References Cited (400)
US 6084870A · Wooten et al. · 2000 [cited by applicant]
US 6243648B1 · Kilfeather et al. · 2001 [cited by applicant]
US 6263088B1 · Crabtree et al. · 2001 [cited by applicant]
US 6594821B1 · Banning et al. · 2003 [cited by applicant]
US 6777904B1 · Degner et al. · 2004 [cited by applicant]
US 6975923B2 · Spriggs · 2005 [cited by applicant]
US 7103460B1 · Breed · 2006 [cited by applicant]
US 7689559B2 · Canright et al. · 2010 [cited by applicant]
US 7742841B2 · Sakai et al. · 2010 [cited by applicant]
US 7783403B2 · Breed · 2010 [cited by applicant]
US 7844595B2 · Canright et al. · 2010 [cited by applicant]
US 8041111B1 · Wilensky · 2011 [cited by applicant]
US 8064643B2 · Stein et al. · 2011 [cited by applicant]
US 8082101B2 · Stein et al. · 2011 [cited by applicant]
US 8164628B2 · Stein et al. · 2012 [cited by applicant]
US 8175376B2 · Marchesotti et al. · 2012 [cited by applicant]
US 8271871B2 · Marchesotti · 2012 [cited by applicant]
US 8346480B2 · Trepagnier et al. · 2013 [cited by applicant]
US 8378851B2 · Stein et al. · 2013 [cited by applicant]
US 8392117B2 · Dolgov et al. · 2013 [cited by applicant]
US 8401292B2 · Park et al. · 2013 [cited by applicant]
US 8412449B2 · Trepagnier et al. · 2013 [cited by applicant]
US 8478072B2 · Aisaka et al. · 2013 [cited by applicant]
US 8553088B2 · Stein et al. · 2013 [cited by applicant]
US 8706394B2 · Trepagnier et al. · 2014 [cited by applicant]
US 8718861B1 · Montemerlo et al. · 2014 [cited by applicant]
US 8788134B1 · Litkouhi et al. · 2014 [cited by applicant]
US 8908041B2 · Stein et al. · 2014 [cited by applicant]
US 8917169B2 · Schofield et al. · 2014 [cited by applicant]
US 8963913B2 · Baek · 2015 [cited by applicant]
US 8965621B1 · Urmson et al. · 2015 [cited by applicant]
US 8981966B2 · Stein et al. · 2015 [cited by applicant]
US 8983708B2 · Choe et al. · 2015 [cited by applicant]
US 8993951B2 · Schofield et al. · 2015 [cited by applicant]
US 9002632B1 · Emigh · 2015 [cited by applicant]
US 9008369B2 · Schofield et al. · 2015 [cited by applicant]
US 9025880B2 · Perazzi et al. · 2015 [cited by applicant]
US 9042648B2 · Wang et al. · 2015 [cited by applicant]
US 9063548B1 · Ferguson · 2015 [cited by applicant]
US 9081385B1 · Ferguson et al. · 2015 [cited by applicant]
US 9088744B2 · Grauer et al. · 2015 [cited by applicant]
US 9111444B2 · Kaganovich · 2015 [cited by applicant]
US 9117133B2 · Barnes et al. · 2015 [cited by applicant]
US 9118816B2 · Stein et al. · 2015 [cited by applicant]
US 9120485B1 · Dolgov · 2015 [cited by applicant]
US 9122954B2 · Srebnik et al. · 2015 [cited by applicant]
US 9134402B2 · Sebastian et al. · 2015 [cited by applicant]
US 9145116B2 · Clarke et al. · 2015 [cited by applicant]
US 9147255B1 · Zhang et al. · 2015 [cited by applicant]
US 9156473B2 · Clarke et al. · 2015 [cited by applicant]
US 9176006B2 · Stein · 2015 [cited by applicant]
US 9179072B2 · Stein et al. · 2015 [cited by applicant]
US 9183447B1 · Gdalyahu et al. · 2015 [cited by applicant]
US 9185360B2 · Stein et al. · 2015 [cited by applicant]
US 9191634B2 · Schofield et al. · 2015 [cited by applicant]
US 9214084B2 · Grauer et al. · 2015 [cited by applicant]
US 9219873B2 · Grauer et al. · 2015 [cited by applicant]
US 9233659B2 · Rosenbaum et al. · 2016 [cited by applicant]
US 9233688B2 · Clarke et al. · 2016 [cited by applicant]
US 9248832B2 · Huberman · 2016 [cited by applicant]
US 9248835B2 · Tanzmeister · 2016 [cited by applicant]
US 9251708B2 · Rosenbaum et al. · 2016 [cited by applicant]
US 9277132B2 · Berberian · 2016 [cited by applicant]
US 9280711B2 · Stein · 2016 [cited by applicant]
US 9282144B2 · Tebay et al. · 2016 [cited by applicant]
US 9286522B2 · Stein et al. · 2016 [cited by applicant]
US 9297641B2 · Stein · 2016 [cited by applicant]
US 9299004B2 · Lin et al. · 2016 [cited by applicant]
US 9315192B1 · Zhu et al. · 2016 [cited by applicant]
US 9317033B2 · Ibanez-Guzman et al. · 2016 [cited by applicant]
US 9317776B1 · Honda et al. · 2016 [cited by applicant]
US 9330334B2 · Lin et al. · 2016 [cited by applicant]
US 9342074B2 · Dolgov et al. · 2016 [cited by applicant]
US 9347779B1 · Lynch · 2016 [cited by applicant]
US 9355635B2 · Gao et al. · 2016 [cited by applicant]
US 9365214B2 · Ben Shalom et al. · 2016 [cited by applicant]
US 9399397B2 · Mizutani et al. · 2016 [cited by applicant]
US 9418549B2 · Kang et al. · 2016 [cited by applicant]
US 9428192B2 · Schofield et al. · 2016 [cited by applicant]
US 9436880B2 · Bos et al. · 2016 [cited by applicant]
US 9438878B2 · Niebla et al. · 2016 [cited by applicant]
US 9443163B2 · Springer · 2016 [cited by applicant]
US 9446765B2 · Ben Shalom et al. · 2016 [cited by applicant]
US 9459515B2 · Stein · 2016 [cited by applicant]
US 9466006B2 · Duan · 2016 [cited by applicant]
US 9476970B1 · Fairfield · 2016 [cited by examiner]
US 9483839B1 · Kwon et al. · 2016 [cited by applicant]
US 9490064B2 · Hirosawa et al. · 2016 [cited by applicant]
US 9494935B2 · Okumura et al. · 2016 [cited by applicant]
US 9507346B1 · Levinson et al. · 2016 [cited by applicant]
US 9513634B2 · Pack et al. · 2016 [cited by applicant]
US 9531966B2 · Stein et al. · 2016 [cited by applicant]
US 9535423B1 · Debreczeni · 2017 [cited by applicant]
US 9538113B2 · Grauer et al. · 2017 [cited by applicant]
US 9547985B2 · Tuukkanen · 2017 [cited by applicant]
US 9549158B2 · Grauer et al. · 2017 [cited by applicant]
US 9552657B2 · Ueno · 2017 [cited by examiner]
US 9555803B2 · Pawlicki et al. · 2017 [cited by applicant]
US 9568915B1 · Berntorp et al. · 2017 [cited by applicant]
US 9587952B1 · Slusar · 2017 [cited by applicant]
US 9599712B2 · Van Der Tempel et al. · 2017 [cited by applicant]
US 9600889B2 · Boisson et al. · 2017 [cited by applicant]
US 9602807B2 · Crane et al. · 2017 [cited by applicant]
US 9612123B1 · Levinson et al. · 2017 [cited by applicant]
US 9620010B2 · Grauer et al. · 2017 [cited by applicant]
US 9625569B2 · Lange · 2017 [cited by applicant]
US 9628565B2 · Stenneth et al. · 2017 [cited by applicant]
US 9649999B1 · Amireddy et al. · 2017 [cited by applicant]
US 9652860B1 · Maali et al. · 2017 [cited by applicant]
US 9669827B1 · Ferguson et al. · 2017 [cited by applicant]
US 9672446B1 · Vallespi-Gonzalez · 2017 [cited by applicant]
US 9690290B2 · Prokhorov · 2017 [cited by applicant]
US 9701023B2 · Zhang et al. · 2017 [cited by applicant]
US 9712754B2 · Grauer et al. · 2017 [cited by applicant]
US 9720418B2 · Stenneth · 2017 [cited by applicant]
US 9723097B2 · Harris et al. · 2017 [cited by applicant]
US 9723099B2 · Chen et al. · 2017 [cited by applicant]
US 9723233B2 · Grauer et al. · 2017 [cited by applicant]
US 9726754B2 · Massanell et al. · 2017 [cited by applicant]
US 9729860B2 · Cohen et al. · 2017 [cited by applicant]
US 9738280B2 · Rayes · 2017 [cited by applicant]
US 9739609B1 · Lewis · 2017 [cited by applicant]
US 9746550B2 · Nath et al. · 2017 [cited by applicant]
US 9753128B2 · Schweizer et al. · 2017 [cited by applicant]
US 9753141B2 · Grauer et al. · 2017 [cited by applicant]
US 9754490B2 · Kentley et al. · 2017 [cited by applicant]
US 9760837B1 · Nowozin et al. · 2017 [cited by applicant]
US 9766625B2 · Boroditsky et al. · 2017 [cited by applicant]
US 9769456B2 · You et al. · 2017 [cited by applicant]
US 9773155B2 · Shotton et al. · 2017 [cited by applicant]
US 9779276B2 · Todeschini et al. · 2017 [cited by applicant]
US 9785149B2 · Wang et al. · 2017 [cited by applicant]
US 9792507B2 · Das · 2017 [cited by applicant]
US 9805294B2 · Liu et al. · 2017 [cited by applicant]
US 9810785B2 · Grauer et al. · 2017 [cited by applicant]
US 9823339B2 · Cohen · 2017 [cited by applicant]
US 9842399B2 · Yamaguchi · 2017 [cited by examiner]
US 9953236B1 · Huang et al. · 2018 [cited by applicant]
US 10147193B2 · Huang et al. · 2018 [cited by applicant]
US 10223806B1 · Luo et al. · 2019 [cited by applicant]
US 10223807B1 · Luo et al. · 2019 [cited by applicant]
US 10410055B2 · Wang et al. · 2019 [cited by applicant]
US 10529089B2 · Ahmad et al. · 2020 [cited by applicant]
US 10698100B2 · Becker et al. · 2020 [cited by applicant]
US 10816354B2 · Liu · 2020 [cited by applicant]
US 11009356B2 · Wang et al. · 2021 [cited by applicant]
US 11009365B2 · Wang et al. · 2021 [cited by applicant]
US 11573095B2 · Liu et al. · 2023 [cited by applicant]
US 20010051845A1 · Itoh · 2001 [cited by applicant]
US 20030114980A1 · Klausner et al. · 2003 [cited by applicant]
US 20030174773A1 · Comaniciu et al. · 2003 [cited by applicant]
US 20040264763A1 · Mas et al. · 2004 [cited by applicant]
US 20070088497A1 · Jung · 2007 [cited by examiner]
US 20070183661A1 · El-Maleh et al. · 2007 [cited by applicant]
US 20070183662A1 · Wang et al. · 2007 [cited by applicant]
US 20070230792A1 · Shashua et al. · 2007 [cited by applicant]
US 20070286526A1 · Abousleman et al. · 2007 [cited by applicant]
US 20080109118A1 · Schwartz et al. · 2008 [cited by applicant]
US 20080249667A1 · Hor et al. · 2008 [cited by applicant]
US 20090040054A1 · Wang et al. · 2009 [cited by applicant]
US 20090087029A1 · Coleman et al. · 2009 [cited by applicant]
US 20090243825A1 · Schofield · 2009 [cited by examiner]
US 20100049397A1 · Liu et al. · 2010 [cited by applicant]
US 20100082238A1 · Nakamura · 2010 [cited by examiner]
US 20100111417A1 · Ward et al. · 2010 [cited by applicant]
US 20100226564A1 · Marchesotti et al. · 2010 [cited by applicant]
US 20100281361A1 · Marchesotti · 2010 [cited by applicant]
US 20110142283A1 · Huang et al. · 2011 [cited by applicant]
US 20110206282A1 · Aisaka et al. · 2011 [cited by applicant]
US 20110247031A1 · Jacoby · 2011 [cited by applicant]
US 20120041636A1 · Johnson et al. · 2012 [cited by applicant]
US 20120105639A1 · Stein et al. · 2012 [cited by applicant]
US 20120120069A1 · Kodaira et al. · 2012 [cited by applicant]
US 20120140076A1 · Rosenbaum et al. · 2012 [cited by applicant]
US 20120274629A1 · Baek · 2012 [cited by applicant]
US 20120314070A1 · Zhang et al. · 2012 [cited by applicant]
US 20130051613A1 · Bobbitt et al. · 2013 [cited by applicant]
US 20130083959A1 · Owechko et al. · 2013 [cited by applicant]
US 20130182134A1 · Grundmann et al. · 2013 [cited by applicant]
US 20130182957A1 · Wujcicki · 2013 [cited by applicant]
US 20130204465A1 · Phillips et al. · 2013 [cited by applicant]
US 20130266187A1 · Bulan et al. · 2013 [cited by applicant]
US 20130329052A1 · Chew · 2013 [cited by applicant]
US 20140063489A1 · Steffey · 2014 [cited by examiner]
US 20140072170A1 · Zhang et al. · 2014 [cited by applicant]
US 20140104051A1 · Breed · 2014 [cited by applicant]
US 20140142799A1 · Ferguson et al. · 2014 [cited by applicant]
US 20140143839A1 · Ricci · 2014 [cited by applicant]
US 20140145516A1 · Hirosawa et al. · 2014 [cited by applicant]
US 20140198184A1 · Stein et al. · 2014 [cited by applicant]
US 20140270482A1 · Chakraborty · 2014 [cited by applicant]
US 20140314322A1 · Snavely · 2014 [cited by examiner]
US 20140321704A1 · Partis · 2014 [cited by applicant]
US 20140334668A1 · Saund · 2014 [cited by applicant]
US 20150057889A1 · Tamaizumi · 2015 [cited by applicant]
US 20150062304A1 · Stein et al. · 2015 [cited by applicant]
US 20150112765A1 · Sundaresh · 2015 [cited by applicant]
US 20150127239A1 · Breed · 2015 [cited by examiner]
US 20150253428A1 · Holz · 2015 [cited by examiner]
US 20150269437A1 · Maruyama et al. · 2015 [cited by applicant]
US 20150269438A1 · Samarasekera et al. · 2015 [cited by applicant]
US 20150292891A1 · Kojo · 2015 [cited by examiner]
US 20150310370A1 · Burry et al. · 2015 [cited by applicant]
US 20150353082A1 · Lee et al. · 2015 [cited by applicant]
US 20150354976A1 · Ferencz · 2015 [cited by applicant]
US 20160008988A1 · Kennedy et al. · 2016 [cited by applicant]
US 20160026787A1 · Nairn et al. · 2016 [cited by applicant]
US 20160037064A1 · Stein et al. · 2016 [cited by applicant]
US 20160046290A1 · Aharony et al. · 2016 [cited by applicant]
US 20160094774A1 · Li et al. · 2016 [cited by applicant]
US 20160118080A1 · Chen · 2016 [cited by applicant]
US 20160125608A1 · Sorstedt · 2016 [cited by applicant]
US 20160129907A1 · Kim et al. · 2016 [cited by applicant]
US 20160165157A1 · Stein et al. · 2016 [cited by applicant]
US 20160191860A1 · Jung · 2016 [cited by examiner]
US 20160210528A1 · Duan · 2016 [cited by applicant]
US 20160275766A1 · Venetianer et al. · 2016 [cited by applicant]
US 20160321381A1 · English et al. · 2016 [cited by applicant]
US 20160321817A1 · Ratcliff et al. · 2016 [cited by applicant]
US 20160327948A1 · Taguchi · 2016 [cited by applicant]
US 20160334230A1 · Ross et al. · 2016 [cited by applicant]
US 20160342837A1 · Hong et al. · 2016 [cited by applicant]
US 20160347322A1 · Clarke et al. · 2016 [cited by applicant]
US 20160375907A1 · Erban · 2016 [cited by applicant]
US 20170008521A1 · Braunstein · 2017 [cited by applicant]
US 20170039436A1 · Chen · 2017 [cited by applicant]
US 20170053169A1 · Cuban et al. · 2017 [cited by applicant]
US 20170061632A1 · Lindner et al. · 2017 [cited by applicant]
US 20170124476A1 · Levinson et al. · 2017 [cited by applicant]
US 20170134631A1 · Zhao et al. · 2017 [cited by applicant]
US 20170177951A1 · Yang et al. · 2017 [cited by applicant]
US 20170227647A1 · Baik · 2017 [cited by examiner]
US 20170301104A1 · Qian et al. · 2017 [cited by applicant]
US 20170305423A1 · Green · 2017 [cited by applicant]
US 20170318407A1 · Meister et al. · 2017 [cited by applicant]
US 20170363423A1 · Dormody et al. · 2017 [cited by applicant]
US 20170366945A1 · Uliyar · 2017 [cited by applicant]
US 20180005407A1 · Browning · 2018 [cited by examiner]
US 20180111274A1 · Seok · 2018 [cited by examiner]
US 20180120859A1 · Eagelberg · 2018 [cited by applicant]
US 20180131924A1 · Jung · 2018 [cited by examiner]
US 20180149739A1 · Becker · 2018 [cited by examiner]
US 20180151063A1 · Pun et al. · 2018 [cited by applicant]
US 20180158197A1 · Dasgupta et al. · 2018 [cited by applicant]
US 20180188043A1 · Chen · 2018 [cited by examiner]
US 20180216943A1 · Hawkins · 2018 [cited by examiner]
US 20180260956A1 · Huang et al. · 2018 [cited by applicant]
US 20180268566A1 · Houts et al. · 2018 [cited by applicant]
US 20180283892A1 · Behrendt · 2018 [cited by applicant]
US 20180284278A1 · Russell · 2018 [cited by examiner]
US 20180312125A1 · Jung et al. · 2018 [cited by applicant]
US 20180315201A1 · Cameron · 2018 [cited by examiner]
US 20180364717A1 · Douillard · 2018 [cited by examiner]
US 20180373254A1 · Song · 2018 [cited by applicant]
US 20180373980A1 · Huval · 2018 [cited by examiner]
US 20190025853A1 · Julian · 2019 [cited by applicant]
US 20190063945A1 · Liu · 2019 [cited by applicant]
US 20190065863A1 · Luo et al. · 2019 [cited by applicant]
US 20190066329A1 · Luo et al. · 2019 [cited by applicant]
US 20190066330A1 · Luo et al. · 2019 [cited by applicant]
US 20190108384A1 · Wang et al. · 2019 [cited by applicant]
US 20190132391A1 · Thomas et al. · 2019 [cited by applicant]
US 20190132392A1 · Liu et al. · 2019 [cited by applicant]
US 20190163989A1 · Guo · 2019 [cited by examiner]
US 20190210564A1 · Han et al. · 2019 [cited by applicant]
US 20190210613A1 · Sun et al. · 2019 [cited by applicant]
US 20190226851A1 · Nicosevici · 2019 [cited by examiner]
US 20190236950A1 · Li et al. · 2019 [cited by applicant]
US 20190266420A1 · Ge et al. · 2019 [cited by applicant]
US 20190271549A1 · Zhang et al. · 2019 [cited by applicant]
US 20190312993A1 · Yamashita et al. · 2019 [cited by applicant]
US 20190339084A1 · Korenaga · 2019 [cited by examiner]
US 20200089973A1 · Efland · 2020 [cited by applicant]
US 20200271453A1 · Wang et al. · 2020 [cited by applicant]
US 20200271473A1 · Wang et al. · 2020 [cited by applicant]
US 20210033420A1 · Liu · 2021 [cited by applicant]
US 20210183099A1 · Fujii et al. · 2021 [cited by applicant]
US 20210278221A1 · Wang et al. · 2021 [cited by applicant]
US 20210319584A1 · Qian et al. · 2021 [cited by applicant]
US 20210373161A1 · Lu et al. · 2021 [cited by applicant]
US 20230160712A1 · Liu et al. · 2023 [cited by applicant]
CN 102184535A · 2011 [cited by applicant]
CN 102815305A · 2012 [cited by applicant]
CN 105667518A · 2016 [cited by applicant]
CN 105825173A · 2016 [cited by applicant]
CN 106340197A · 2017 [cited by applicant]
CN 106781591A · 2017 [cited by applicant]
CN 106909876A · 2017 [cited by applicant]
CN 107015238A · 2017 [cited by applicant]
CN 107111742A · 2017 [cited by applicant]
CN 108010360A · 2018 [cited by applicant]
CN 111256693A · 2020 [cited by applicant]
DE 2608513A1 · 1977 [cited by applicant]
EP 0890470A2 · 1999 [cited by applicant]
EP 1754179A1 · 2007 [cited by applicant]
EP 2448251A2 · 2012 [cited by applicant]
EP 2463843A2 · 2012 [cited by applicant]
EP 2761249A1 · 2014 [cited by applicant]
EP 2918974A1 · 2015 [cited by applicant]
EP 2946336A2 · 2015 [cited by applicant]
EP 2993654A1 · 2016 [cited by applicant]
EP 3081419A1 · 2016 [cited by applicant]
EP 3819673A1 · 2021 [cited by applicant]
JP 2017198566A · 2017 [cited by applicant]
KR 100802511B1 · 2008 [cited by applicant]
KR 20170065083A · 2017 [cited by applicant]
WO 1991009375A1 · 1991 [cited by applicant]
WO 2005098739A1 · 2005 [cited by applicant]
WO 2005098751A1 · 2005 [cited by applicant]
WO 2005098782A1 · 2005 [cited by applicant]
WO 2010109419A1 · 2010 [cited by applicant]
WO 2013045612A1 · 2013 [cited by applicant]
WO 2014111814A2 · 2014 [cited by applicant]
WO 2014166245A1 · 2014 [cited by applicant]
WO 2014201324A1 · 2014 [cited by applicant]
WO 2015083009A1 · 2015 [cited by applicant]
WO 2015103159A1 · 2015 [cited by applicant]
WO 2015125022A2 · 2015 [cited by applicant]
WO 2015186002A2 · 2015 [cited by applicant]
WO 2016090282A1 · 2016 [cited by applicant]
WO 2016135736A2 · 2016 [cited by applicant]
WO 2017013875A1 · 2017 [cited by applicant]
WO 2017079349A1 · 2017 [cited by applicant]
WO 2017079460A2 · 2017 [cited by applicant]
WO 2018132608A2 · 2018 [cited by applicant]
WO 2019040800A1 · 2019 [cited by applicant]
WO 2019084491A1 · 2019 [cited by applicant]
WO 2019084494A1 · 2019 [cited by applicant]
WO 2019140277A2 · 2019 [cited by applicant]
WO 2019161134A1 · 2019 [cited by applicant]
WO 2019168986A1 · 2019 [cited by applicant]
WO 2020038118A1 · 2020 [cited by applicant]
WO 2020097512A2 · 2020 [cited by applicant]
WO 2021017213A1 · 2021 [cited by applicant]
Harry Y. Oh, U.S. Appl. No. 15/896,077, Non-Final Office Action Mailed Mar. 13, 2020, pp. 1-21. [cited by applicant]
Harry Y. Oh, U.S. Appl. No. 15/896,077, Final Office Action Mailed Jul. 9, 2020, pp. 1-30. [cited by applicant]
Harry Y. Oh, U.S. Appl. No. 15/896,077, Non-Final Office Action Mailed Oct. 1, 2020, pp. 1-34. [cited by applicant]
International application No. PCT/US2019/060547 International Search Report and Written Opinion, Mailed Jun. 25, 2020, pp. 1-23. [cited by applicant]
Carle, Patrick J.F., “Global Rover Localization by Matching Lidar and Orbital 3D Maps.”, IEEE, Anchorage Convention Distriction, pp. 1-6, May 3-8, 2010. (Anchorage Alaska, US), May 3-8, 2019. [cited by applicant]
Young, Lee W., International Application No. PCT/US19/18113 Search Report and Written Opinion Mailed May 8, 2019. (pp. 1-13). [cited by applicant]
Caselitz, T. et al., “Monocular camera localization in 3D LiDAR maps,” European Conference on Computer Vision (2014) Computer Vision—ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol. 8690. Springer, Cham. [cited by applicant]
Mur-Artal, R. et al., “ORB-SLAM: A Versatile and Accurate Monocular SLAM System,” IEEE Transaction on Robotics, Oct. 2015, pp. 1147-1163, vol. 31, No. 5, Spain. [cited by applicant]
Sattler, T. et al., “Are Large-Scale 3D Models Really Necessary for Accurate Visual Localization?” CVPR, IEEE, 2017, pp. 1-10. [cited by applicant]
Engel J., et al., LSD-SLAM: Large-Scale Direct Monocular SLAM. In: Fleet D., Pajdla T., Schiele B., Tuytelaars T. (eds) Computer Vision—ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol. 8690. Springer, Cham. [cited by applicant]
Levinson, Jesse et al., Experimental Robotics, Unsupervised Calibration for Multi-Beam Lasers, pp. 179-194, 12th Ed., Oussama Khatib, Vijay Kumar, Gaurav Sukhatme (Eds.) Springer-Verlag Berlin Heidelberg 2014. [cited by applicant]
International Application No. PCT/US2019/013322, International Search Report and Written Opinion Mailed Apr. 2, 2019. [cited by applicant]
International Application No. PCT/US19/12934, International Search Report and Written Opinion Mailed Apr. 29, 2019. [cited by applicant]
International Application No. PCT/US18/53795, International Search Report and Written Opinion Mailed Dec. 31, 2018. [cited by applicant]
International Application No. PCT/US18/57484, International Search Report and Written Opinion Mailed Jan. 7, 2019. [cited by applicant]
International Application No. PCT/US2018/057851, International Search Report and Written Opinion Mailed Feb. 1, 2019. [cited by applicant]
International Application No. PCT/US2019/019839, International Search Report and Written Opinion Mailed May 23, 2019. [cited by applicant]
International Application No. PCT/US19/25995, International Search Report and Written Opinion Mailed Jul. 9, 2019. [cited by applicant]
Geiger, Andreas et al., “Automatic Camera and Range Sensor Calibration using a single Shot”, Robotics and Automation (ICRA), pp. 1-8, 2012 IEEE International Conference. [cited by applicant]
Zhang, Z. et al. A Flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence (vol. 22, Issue: 11, Nov. 2000). [cited by applicant]
International Application No. PCT/US2018/047830, International Search Report and Written Opinion Mailed Apr. 27, 2017. [cited by applicant]
Bar-Hillel, Aharon et al. “Recent progress in road and lane detection: a survey.” Machine Vision and Applications 25 (2011): 727-745. [cited by applicant]
Schindler, Andreas et al. “Generation of high precision digital maps using circular arc splines,” 2012 IEEE Intelligent Vehicles Symposium, Alcala de Henares, 2012, pp. 246-251. doi: 10.1109/IVS.2012.6232124. [cited by applicant]
International Application No. PCT/US2018/047608, International Search Report and Written Opinion Mailed Dec. 28, 2018. [cited by applicant]
Hou, Xiaodi and Zhang, Liqing, “Saliency Detection: A Spectral Residual Approach”, Computer Vision and Pattern Recognition, CVPR'07—IEEE Conference, pp. 1-8, 2007. [cited by applicant]
Hou, Xiaodi and Harel, Jonathan and Koch, Christof, “Image Signature: Highlighting Sparse Salient Regions”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, No. 1, pp. 194-201, 2012. [cited by applicant]
Hou, Xiaodi and Zhang, Liqing, “Dynamic Visual Attention: Searching For Coding Length Increments”, Advances in Neural Information Processing Systems, vol. 21, pp. 681-688, 2008. [cited by applicant]
Li, Yin and Hou, Xiaodi and Koch, Christof and Rehg, James M. and Yuille, Alan L., “The Secrets of Salient Object Segmentation”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 280-287… [cited by applicant]
Zhou, Bolei and Hou, Xiaodi and Zhang, Liqing, “A Phase Discrepancy Analysis of Object Motion”, Asian Conference on Computer Vision, pp. 225-238, Springer Berlin Heidelberg, 2010. [cited by applicant]
Hou, Xiaodi and Yuille, Alan and Koch, Christof, “Boundary Detection Benchmarking: Beyond F-Measures”, Computer Vision and Pattern Recognition, CVPR'13, vol. 2013, pp. 1-8, IEEE, 2013. [cited by applicant]
Hou, Xiaodi and Zhang, Liqing, “Color Conceptualization”, Proceedings of the 15th ACM International Conference on Multimedia, pp. 265-268, ACM, 2007. [cited by applicant]
Hou, Xiaodi and Zhang, Liqing, “Thumbnail Generation Based on Global Saliency”, Advances in Cognitive Neurodynamics, ICCN 2007, pp. 999-1003, Springer Netherlands, 2008. [cited by applicant]
Hou, Xiaodi and Yuille, Alan and Koch, Christof, “A Meta-Theory of Boundary Detection Benchmarks”, arXiv preprint arXiv:1302.5985, 2013. [cited by applicant]
Li, Yanghao and Wang, Naiyan and Shi, Jianping and Liu, Jiaying and Hou, Xiaodi, “Revisiting Batch Normalization for Practical Domain Adaptation”, arXiv preprint arXiv:1603.04779, 2016. [cited by applicant]
Li, Yanghao and Wang, Naiyan and Liu, Jiaying and Hou, Xiaodi, “Demystifying Neural Style Transfer”, arXiv preprint arXiv:1701.01036, 2017. [cited by applicant]
Hou, Xiaodi and Zhang, Liqing, “A Time-Dependent Model of Information Capacity of Visual Attention”, International Conference on Neural Information Processing, pp. 127-136, Springer Berlin Heidelberg, 2006. [cited by applicant]
Wang, Panqu and Chen, Pengfei and Yuan, Ye and Liu, Ding and Huang, Zehua and Hou, Xiaodi and Cottrell, Garrison, “Understanding Convolution for Semantic Segmentation”, arXiv preprint arXiv:1702.08502, 2017. [cited by applicant]
Li, Yanghao and Wang, Naiyan and Liu, Jiaying and Hou, Xiaodi, “Factorized Bilinear Models for Image Recognition”, arXiv preprint arXiv:1611.05709, 2016. [cited by applicant]
Hou, Xiaodi, “Computational Modeling and Psychophysics in Low and Mid-Level Vision”, California Institute of Technology, 2014. [cited by applicant]
Spinello, Luciano, Triebel, Rudolph, Siegwart, Roland, “Multiclass Multimodal Detection and Tracking in Urban Environments”, Sage Journals, vol. 29 Issue 12, pp. 1498-1515 Article first published online: Oct. 7, 2010; I… [cited by applicant]
Matthew Barth, Carrie Malcolm, Theodore Younglove, and Nicole Hill, “Recent Validation Efforts for a Comprehensive Modal Emissions Model”, Transportation Research Record 1750, Paper No. 01-0326, College of Engineering, … [cited by applicant]
Kyoungho Ahn, Hesham Rakha, “The Effects of Route Choice Decisions on Vehicle Energy Consumption and Emissions”, Virginia Tech Transportation Institute, Blacksburg, VA 24061, date unknown. [cited by applicant]
Ramos, Sebastian, Gehrig, Stefan, Pinggera, Peter, Franke, Uwe, Rother, Carsten, “Detecting Unexpected Obstacles for Self-Driving Cars: Fusing Deep Learning and Geometric Modeling”, arXiv:1612.06573v1 [cs.CV] Dec. 20, 2… [cited by applicant]
Schroff, Florian, Dmitry Kalenichenko, James Philbin, (Google), “FaceNet: A Unified Embedding for Face Recognition and Clustering”, CVPR 2015. [cited by applicant]
Dai, Jifeng, Kaiming He, Jian Sun, (Microsoft Research), “Instance-aware Semantic Segmentation via Multi-task Network Cascades”, CVPR 2016. [cited by applicant]
Huval, Brody, Tao Wang, Sameep Tandon, Jeff Kiske, Will Song, Joel Pazhayampallil, Mykhaylo Andriluka, Pranav Rajpurkar, Toki Migimatsu, Royce Cheng-Yue, Fernando Mujica, Adam Coates, Andrew Y. Ng, “An Empirical Evaluat… [cited by applicant]
Tian Li, “Proposal Free Instance Segmentation Based on Instance-aware Metric”, Department of Computer Science, Cranberry-Lemon University, Pittsburgh, PA., date unknown. [cited by applicant]
Mohammad Norouzi, David J. Fleet, Ruslan Salakhutdinov, “Hamming Distance Metric Learning”, Departments of Computer Science and Statistics, University of Toronto, date unknown. [cited by applicant]
Jain, Suyong Dutt, Grauman, Kristen, “Active Image Segmentation Propagation”, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, Jun. 2016. [cited by applicant]
MacAodha, Oisin, Campbell, Neill D.F., Kautz, Jan, Brostow, Gabriel J., “Hierarchical Subquery Evaluation for Active Learning on a Graph”, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition… [cited by applicant]
Kendall, Alex, Gal, Yarin, “What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision”, arXiv:1703.04977v1 [cs.CV] Mar. 15, 2017. [cited by applicant]
Wei, Junqing, John M. Dolan, Bakhtiar Litkhouhi, “A Prediction- and Cost Function-Based Algorithm for Robust Autonomous Freeway Driving”, 2010 IEEE Intelligent Vehicles Symposium, University of California, San Diego, CA… [cited by applicant]
Peter Welinder, Steve Branson, Serge Belongie, Pietro Perona, “The Multidimensional Wisdom of Crowds” http://www.vision.caltech.edu/visipedia/papers/WelinderEtaINIPS10.pdf, 2010. [cited by applicant]
C. Yang, Z. Li, R. Cui and B. Xu, “Neural Network-Based Motion Control of an Underactuated Wheeled Inverted Pendulum Model,” in IEEE Transactions on Neural Networks and Learning Systems, vol. 25, No. 11, pp. 2004-2016, … [cited by applicant]
Stephan R. Richter, Vibhav Vineet, Stefan Roth, Vladlen Koltun, “Playing for Data: Ground Truth from Computer Games”, Intel Labs, European Conference on Computer Vision (ECCV), Amsterdam, the Netherlands, 2016. [cited by applicant]
Thanos Athanasiadis, Phivos Mylonas, Yannis Avrithis, and Stefanos Kollias, “Semantic Image Segmentation and Object Labeling”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, No. 3, Mar. 2007. [cited by applicant]
Marius Cordts, Mohamed Omran, Sebastian Ramos, Timo Rehfeld, Markus Enzweiler Rodrigo Benenson, Uwe Franke, Stefan Roth, and Bernt Schiele, “The Cityscapes Dataset for Semantic Urban Scene Understanding”, Proceedings of… [cited by applicant]
Adhiraj Somani, Nan Ye, David Hsu, and Wee Sun Lee, “DESPOT: Online POMDP Planning with Regularization”, Department of Computer Science, National University of Singapore, date unknown. [cited by applicant]
Adam Paszke, Abhishek Chaurasia, Sangpil Kim, and Eugenio Culurciello. Enet: A deep neural network architecture for real-time semantic segmentation. CoRR, abs/1606.02147, 2016. [cited by applicant]
Szeliski, Richard, “Computer Vision: Algorithms and Applications” http://szeliski.org/Book/, 2010. [cited by applicant]
Office Action Mailed in Chinese Application No. 201810025516.X, Mailed Sep. 3, 2019. [cited by applicant]
Luo, Yi et al. U.S. Appl. No. 15/684,389 Notice of Allowance Mailed Oct. 9, 2019. [cited by applicant]
Kai Yu, Yang Zhou, Da Li, Zhang Zhang, Kaiqi Huang, “Large-scale Distributed Video Parsing and Evaluation Platform”, Center for Research on Intelligent Perception and Computing, Institute of Automation, Chinese Academy … [cited by applicant]
P. Guarneri, G. Rocca and M. Gobbi, “A Neural-Network-Based Model for the Dynamic Simulation of the Tire/ Suspension System While Traversing Road Irregularities,” in IEEE Transactions on Neural Networks, vol. 19, No. 9,… [cited by applicant]
Siyuan Liu, U.S. Appl. No. 17/074,468 Notice of Allowance mailed Oct. 7, 2022, p. 1-7. [cited by applicant]
Chenzhe Qian, U.S. Appl. No. 17/225,396, Non-Final Office Action Mailed Oct. 24, 2022, pp. 1-19. [cited by applicant]