IP Library Granted Patent US 10,215,571
Granted Patent B2
US 10,215,571 · App. 15/897,901 · Granted Feb 26, 2019

System and method for precision localization and mapping

Inventors: Vaibhav Ghadiok (Palo Alto, CA); Michael Gleeson-May (Palo Alto, CA)
Assignee: Nauto, Inc.
G01C21/28G01C21/30G01C21/34G01C21/3476G05D1/0246G05D1/0274G06F17/30241G06F17/30268G06F17/30377G06K9/00818G06K9/2054G06K9/46G06T7/74G05D2201/0213G06K9/6256G06K2209/21G06T2207/30204G06T2207/30241G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,215,571
App. No.
15/897,901
Granted
Feb 26, 2019
Kind
B2
Abstract

A method for localization and mapping, including recording an image at a camera mounted to a vehicle, the vehicle associated with a global system location; identifying a landmark depicted in the image with a landmark identification module of a computing system associated with the vehicle, the identified landmark having a landmark geographic location and a known parameter; extracting a set of landmark parameters from the image with a feature extraction module of the computing system; determining, at the computing system, a relative position between the vehicle and the landmark geographic location based on a comparison between the extracted set of landmark parameters and the known parameter; and updating, at the computing system, the global system location based on the relative position.

Claims (31)

1. A method for localization and mapping, comprising:

at a camera mounted to a first vehicle, the first vehicle associated with a first global system location and a location error, recording a sequence of images in response to the location error exceeding a threshold error value;

identifying a landmark depicted in an image of the sequence of images with a landmark identification module of a computing system associated with the vehicle, the landmark associated with a landmark geographic location and a known dimension;

identifying the landmark in each of the sequence of images;

extracting a landmark pose from the image, based on the known dimension of the landmark, with a feature extraction module of the computing system;

extracting a corresponding landmark pose from each of the sequence of images;

determining, at the computing system, a relative position between the vehicle and the landmark geographic location based on the landmark pose;

determining a temporal pattern based on the corresponding landmark pose extracted from each of the sequence of images;

determining a vehicle trajectory based on the temporal pattern, wherein the vehicle is controlled along the vehicle trajectory based on the location error, and wherein the vehicle is an autonomous vehicle;

updating, at the computing system, the first global system location based on the relative position;

setting the location error to an error value below the threshold error value in response to updating the global system location;

determining, at the computing system, a speed value and heading value associated with the vehicle, wherein the speed value is associated with a speed error and the heading value is associated with a heading error;

continuously updating the first global system location based on the speed value and heading value; and

continuously incrementing the location error in proportion to an elapsed time subsequent to updating the global system location and based on the speed error and the heading error.

2. The method of claim 1 , further comprising determining the landmark geographic location of the landmark based on the first global system location and the relative position, and storing the landmark geographic location at a database associated with the computing system.

3. The method of claim 1 , further comprising:

identifying a plurality of landmarks depicted in the image, each of the plurality of landmarks associated with a corresponding geographic location;

extracting a corresponding landmark pose associated with each of the plurality of landmarks from the image;

determining a set of landmark geographic locations based on the corresponding landmark poses associated with each of the plurality of landmarks; and

determining the first global system location based on the set of landmark geographic locations.

4. The method of claim 1 , further comprising:

transmitting the first global system location to a second vehicle associated with a second global system location;

determining a second relative position between the second vehicle and the first vehicle; and

updating the second global system location based on the global system location and the second relative position.

5. The method of claim 1 , further comprising determining a route based on an accumulation rate of the location error exceeding a threshold accumulation rate value, and navigating the first vehicle according to the route.

6. The method of claim 1 , wherein the landmark is associated with a landmark position, and further comprising:

determining, at the computing system, a second relative position between the first vehicle and the landmark position;

determining the landmark geographic location based on the first global system location and the second relative position;

associating the landmark pose and the second relative position to generate a pose-position pair;

storing the pose-position pair and the landmark geographic location at a database.

7. The method of claim 6 , further comprising determining a change in the known dimension of the landmark, based on the image, and updating the known dimension at the database based on the change.

Assignments (8)
RELEASE OF SECURITY INTEREST Recorded Jun 19, 2026
From: ORIX GROWTH CAPITAL, LLC
To: NAUTO, INC.
Reel/Frame 075016/0824 →
SECURITY INTEREST Recorded Aug 8, 2025
From: NAUTO, INC.
To: ORIX GROWTH CAPITAL, LLC, AS AGENT
Reel/Frame 071976/0818 →
SECURITY INTEREST Recorded Nov 10, 2022
From: NAUTO, INC.
To: SILICON VALLEY BANK
Reel/Frame 061722/0392 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE STREET ADDRESS PREVIOUSLY RECORDED AT REEL: 047977 FRAME: 0299. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 14, 2019
From: NAUTO GLOBAL LIMITED
To: NAUTO, INC.
Reel/Frame 049475/0814 →
CORRECTIVE ASSIGNMENT TO CORRECT THE STATE OF INCORPORATION INSIDE THE ASSIGNMENT DOCUMENT PREVIOUSLY RECORDED AT REEL: 047821 FRAME: 0958. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 21, 2018
From: NAUTO GLOBAL LIMITED
To: NAUTO, INC.
Reel/Frame 047977/0299 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2018
From: NAUTO GLOBAL INC.
To: NAUTO, INC.
Reel/Frame 047821/0958 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2018
From: GHADIOK, VAIBHAV; GLEESON-MAY, MICHAEL
To: NAUTO, INC.
Reel/Frame 044946/0111 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2018
From: NAUTO, INC.
To: NAUTO GLOBAL LIMITED
Reel/Frame 044946/0209 →
Continuity (4)
Division 15673098 · Aug 9, 2017
Provisional Application 62372633 · Aug 9, 2016
Provisional Application 62492790 · May 1, 2017
Related Publication 20180172454A1 · Jun 21, 2018
Cited By (6)
US 12,449,809 US 12,518,544 US 12,530,381 US 12,608,406 US 12,684,095 US 12,709,252