IP Library › Granted Patent US 12,741,672
Granted Patent B2
US 12,741,672 · App. 18/941,767 · Granted Sep 22, 2026

Remote live map system for autonomous vehicles

Inventors: Niels Joubert (Los Altos, CA); Benjamin Kaplan (Denver, CO); Stephen O'Hara (Fort Collins, CO)
Assignee: Aurora Operations, Inc.
B60W60/001B60W40/10G01C21/3841G01C21/3896G08G1/096708B60W2420/00B60W2552/50B60W2554/20B60W2556/40B60W2756/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,741,672
App. No.
18/941,767
Granted
Sep 22, 2026
Kind
B2
Abstract

A live map system may be used to propagate observations collected by autonomous vehicles operating in an environment to other autonomous vehicles and thereby supplement a digital map used in the control of the autonomous vehicles. In addition, a live map system in some instances may be used to propagate location-based teleassist triggers to autonomous vehicles operating within an environment. A location-based teleassist trigger may be generated, for example, in association with a teleassist session conducted between an autonomous vehicle and a remote teleassist system proximate a particular location, and may be used to automatically trigger a teleassist session for another autonomous vehicle proximate that location and/or to propagate a suggested action to that other autonomous vehicle.

Claims (33)

1 . A method, comprising:

conducting a teleassist session with a first autonomous vehicle operating in an environment, including exchanging situational data and teleassist operator input received from a human operator between the first autonomous vehicle and a remote teleassist system;

generating a location-based teleassist trigger in association with the teleassist session, the location-based teleassist trigger including an associated location-based criterion based on information of the first autonomous vehicle; and

communicating the location-based teleassist trigger to a remote live map system to cause the remote live map system to forward the location-based teleassist trigger to a second autonomous vehicle to cause the second autonomous vehicle to be controlled based at least in part on the location-based teleassist trigger when the second autonomous vehicle is determined to meet the associated location-based criterion of the location-based teleassist trigger.

2 . The method of claim 1 , wherein the location-based teleassist trigger includes a session suggestion that selectively suggests automatic initiation of a teleassist session with the second autonomous vehicle when the second autonomous vehicle satisfies the location-based criterion associated with the location-based teleassist trigger.

3 . The method of claim 1 , wherein the location-based teleassist trigger includes a suggested action to be undertaken by the second autonomous vehicle when the second autonomous vehicle meets the location-based criterion associated with the location-based teleassist trigger.

4 . The method of claim 1 , wherein the location-based teleassist trigger includes a suggested path to be followed by the second autonomous vehicle when the second autonomous vehicle meets the location-based criterion associated with the location-based teleassist trigger.

5 . The method of claim 1 , further comprising, in the first autonomous vehicle, receiving, from the remote live map system, observation data associated with one or more observations collected from the environment and controlling the first autonomous vehicle using the received observation data.

6 . The method of claim 1 , further comprising selectively propagating observation data collected in association with the teleassist session to the remote live map system in response to teleassist operator input.

7 . The method of claim 1 , further comprising selectively modifying teleassist session data collected in association with the teleassist session in response to teleassist operator input.

8 . The method of claim 1 , wherein communicating the location-based teleassist trigger to the remote live map system causes the remote live map system to forward the location-based teleassist trigger to a plurality of autonomous vehicles in a fleet of autonomous vehicles.

9 . A method, comprising:

receiving, from a remote live map system, observation data associated with one or more observations collected from an environment within which a first autonomous vehicle operates;

controlling the first autonomous vehicle using the observation data;

receiving, from the remote live map system, a location-based teleassist trigger generated in association with a teleassist session conducted between a human operator of a remote teleassist system and a second autonomous vehicle, the location-based teleassist trigger including an associated location-based criterion based on information of the second autonomous vehicle;

determining activation of the location-based teleassist trigger in response to determining that the first autonomous vehicle meets the associated location-based criterion of the location-based teleassist trigger; and

controlling the first autonomous vehicle based at least in part on determining activation of the location-based teleassist trigger.

10 . The method of claim 9 , wherein the teleassist session is a first teleassist session, wherein the location-based teleassist trigger includes a session suggestion that selectively suggests automatic initiation of a second teleassist session, and the method further comprises automatically initiating the second teleassist session between the remote teleassist system and the first autonomous vehicle when the first autonomous vehicle meets the location-based criterion associated with the location-based teleassist trigger.

11 . The method of claim 9 , wherein the location-based teleassist trigger includes a suggested action to be undertaken by the first autonomous vehicle, and the method further includes controlling the first autonomous vehicle based at least in part on the suggested action.

12 . The method of claim 11 , wherein the suggested action defines a suggested path to be undertaken by the first autonomous vehicle, and the method further includes controlling the first autonomous vehicle based at least in part on the suggested path.

13 . The method of claim 9 , wherein the location-based criterion defines a geofence and activation of the location-based teleassist trigger occurs in response to the first autonomous vehicle crossing the geofence.

14 . The method of claim 9 , wherein the location-based criterion defines a predetermined location and activation of the location-based teleassist trigger occurs in response to the first autonomous vehicle being within a predetermined distance from the predetermined location.

15 . A system, comprising:

one or more processors; and

memory storing instructions that, when executed by the one or more processors, cause the system to:

maintain observation data associated with a plurality of observations collected by a plurality of autonomous vehicles operating in an environment;

maintain a location-based teleassist trigger generated in association with a teleassist session conducted between a human operator of a remote teleassist system and a first autonomous vehicle of the plurality of autonomous vehicles, the location-based teleassist trigger including an associated location-based criterion based on information of the first autonomous vehicle; and

communicate a portion of the observation data and the location-based teleassist trigger to a second autonomous vehicle of the plurality of autonomous vehicles to cause the second autonomous vehicle to be controlled based at least in part on the location-based teleassist trigger when the second autonomous vehicle is determined to meet the associated location-based criterion of the location-based teleassist trigger.

16 . The system of claim 15 , wherein the location-based teleassist trigger includes a session suggestion that selectively suggests automatic initiation of a teleassist session with the second autonomous vehicle when the second autonomous vehicle satisfies the location-based criterion associated with the location-based teleassist trigger.

17 . The system of claim 15 , wherein the location-based teleassist trigger includes a suggested action to be undertaken by the second autonomous vehicle when the second autonomous vehicle meets the location-based criterion associated with the location-based teleassist trigger.

18 . The system of claim 15 , wherein the location-based teleassist trigger includes a suggested path to be followed by the second autonomous vehicle when the second autonomous vehicle meets the location-based criterion associated with the location-based teleassist trigger.

19 . The system of claim 15 , wherein the location-based criterion defines a geofence such that activation of the location-based teleassist trigger occurs in response to the second autonomous vehicle crossing the geofence.

20 . The system of claim 15 , wherein the location-based criterion defines a predetermined location such that activation of the location-based teleassist trigger occurs in response to the second autonomous vehicle being within a predetermined distance from the predetermined location.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2025
From: JOUBERT, NIELS; KAPLAN, BENJAMIN; O'HARA, STEPHEN
To: AURORA OPERATIONS, INC.
Reel/Frame 072030/0809 →
Continuity (3)
Continuation 18581173 · Feb 19, 2024
Continuation 18090364 · Dec 28, 2022
Related Publication 20250065912A1 · Feb 27, 2025
References Cited (47)
US 9222795B1 · Gerlach · 2015 [cited by applicant]
US 9612123B1 · Levinson · 2017 [cited by examiner]
US 11287267B2 · Rabel · 2022 [cited by examiner]
US 11480435B2 · Li · 2022 [cited by examiner]
US 11938963B1 · Joubert · 2024 [cited by examiner]
US 12077183B2 · Kothbauer · 2024 [cited by examiner]
US 12078987B2 · Iwamoto · 2024 [cited by examiner]
US 12151706B2 · Joubert · 2024 [cited by examiner]
US 20060122768A1 · Sumizawa · 2006 [cited by examiner]
US 20170122749A1 · Urano · 2017 [cited by examiner]
US 20170248963A1 · Levinson et al. · 2017 [cited by applicant]
US 20180025235A1 · Fridman · 2018 [cited by examiner]
US 20180149487A1 · Lee · 2018 [cited by examiner]
US 20180188045A1 · Wheeler · 2018 [cited by examiner]
US 20180200889A1 · Yang · 2018 [cited by examiner]
US 20180349715A1 · Gupta · 2018 [cited by examiner]
US 20190265045A1 · Baik · 2019 [cited by examiner]
US 20190325235A1 · Stenneth · 2019 [cited by examiner]
US 20190354111A1 · Cheng · 2019 [cited by examiner]
US 20190376809A1 · Hanniel · 2019 [cited by examiner]
US 20200064843A1 · Shashua et al. · 2020 [cited by applicant]
US 20200109954A1 · Li · 2020 [cited by examiner]
US 20200160068A1 · Silver · 2020 [cited by examiner]
US 20200191601A1 · Jiang · 2020 [cited by examiner]
US 20200192351A1 · Rastoll · 2020 [cited by examiner]
US 20200211370A1 · Chen · 2020 [cited by examiner]
US 20210072744A1 · Urano · 2021 [cited by examiner]
US 20210124369A1 · Zander · 2021 [cited by examiner]
US 20210233390A1 · Georgiou · 2021 [cited by examiner]
US 20210264175A1 · Zhang · 2021 [cited by examiner]
US 20210318133A1 · Sharma · 2021 [cited by examiner]
US 20210409379A1 · Hwang · 2021 [cited by examiner]
US 20220001872A1 · Taieb · 2022 [cited by examiner]
US 20220316919A1 · Ukai · 2022 [cited by examiner]
US 20220340145A1 · Stenneth · 2022 [cited by examiner]
US 20220388536A1 · Kothbauer · 2022 [cited by examiner]
US 20220412770A1 · Li · 2022 [cited by examiner]
US 20230137058A1 · Tam · 2023 [cited by examiner]
US 20230160713A1 · Xu · 2023 [cited by examiner]
US 20240217546A1 · Joubert et al. · 2024 [cited by applicant]
DE 102012212740 · 2014 [cited by applicant]
EP 3073224 · 2016 [cited by applicant]
JP 2021165787 · 2021 [cited by applicant]
WO 2018015811 · 2018 [cited by applicant]
WO 2018127461 · 2018 [cited by applicant]
International Search Report and Written Opinion issued for Application No. PCT/US2023/086074, 14 pages, dated Jul. 1, 2024. [cited by applicant]
Extended European Search Report issued for Application No. 23913671.6, 16 pages, dated Jun. 16, 2026. [cited by applicant]