IP Library Granted Patent US 10,209,716
Granted Patent B1
US 10,209,716 · App. 15/678,675 · Granted Feb 19, 2019

Systems and methods for communicating autonomous vehicle scenario evaluation and intended vehicle actions

Inventor: Noah Zych (Pittsburgh, PA)
Assignee: Uber Technologies, Inc.
G05D1/0214B60K28/02B60Q5/006B60W30/08B60W30/09B60W30/095B60W30/0953B60W30/0956B60W50/14G05D1/0055G08G1/166
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,209,716
App. No.
15/678,675
Granted
Feb 19, 2019
Kind
B1
Abstract

Systems and methods for communicating autonomous vehicle operations are provided. In one example embodiment, a computer implemented method includes obtaining data associated with the autonomous vehicle. The method includes identifying an object within the surrounding environment of the autonomous vehicle or a planned vehicle motion action of the autonomous vehicle based at least in part on the data associated with the autonomous vehicle. The method includes determining an audible vehicle indication that is associated with the identified object or the planned vehicle motion action. The audible vehicle indication is indicative of a type of the object or a type of the planned vehicle motion. The method includes outputting, via one or more output devices onboard the autonomous vehicle, the audible vehicle indication.

Claims (53)

1. A computer-implemented method for communicating autonomous vehicle operations, comprising:

obtaining, by a computing system comprising one or more computing devices onboard an autonomous vehicle, data associated with the autonomous vehicle;

identifying, by the computing system, one or more objects within a surrounding environment of the autonomous vehicle or one or more planned vehicle motion actions of the autonomous vehicle based at least in part on the data associated with the autonomous vehicle;

identifying a relevant object of the one or more objects or a relevant planned vehicle motion action of the one or more planned vehicle motions based at least in part on a type of an intended audience of an audible vehicle indication associated with the relevant object or the relevant planned vehicle motion action, wherein the type of the intended audience includes an operator of the autonomous vehicle or a passenger of the autonomous vehicle;

generating, by the computing system, the audible vehicle indication that is associated with the relevant object or the relevant planned vehicle motion action; and

outputting, by the computing system via one or more output devices onboard the autonomous vehicle, the audible vehicle indication, wherein the audible vehicle indication is outputted within an interior of the autonomous vehicle in a manner that is indicative of one or more locations associated with the relevant object or one or more locations associated with the relevant planned vehicle motion action.

2. The computer-implemented method of claim 1 , wherein identifying, by the computing system, the relevant object or the relevant planned vehicle motion action comprises:

identifying, by the computing system, a current location of the relevant object based at least in part on the data associated with the autonomous vehicle; and

determining, by the computing system, that the relevant object is relevant to the intended audience of the audible vehicle indication based at least in part on the current location of the relevant object.

3. The computer-implemented method of claim 2 , wherein the audible vehicle indication is indicative of a distance of the relevant object relative to the autonomous vehicle.

4. The computer-implemented method of claim 1 , wherein identifying, by the computing system, the relevant object comprises:

identifying, by the computing system, one or more predicted future locations of the relevant object; and

determining, by the computing system, that the relevant object is relevant to the intended audience of the audible vehicle indication based at least in part on the one or more predicted future locations of the relevant object.

5. The computer-implemented method of claim 4 , wherein the audible vehicle indication is outputted in a manner that is indicative of the one or more future locations.

6. The computer-implemented method of claim 1 , wherein identifying, by the computing system, the relevant planned vehicle motion action comprises:

identifying, by the computing system, a plurality of planned vehicle motion actions of a motion plan of the autonomous vehicle based at least in part on the data associated with the autonomous vehicle, wherein the relevant planned vehicle motion action is included in the plurality of planned vehicle motion actions; and

determining, by the computing system, that the relevant planned vehicle motion action is relevant to the intended audience of the audible vehicle indication.

7. The computer-implemented method of claim 6 , wherein determining, by the computing system, that the relevant planned vehicle motion action is relevant to the intended audience of the audible vehicle indication comprises determining, by the computing system, that the relevant planned vehicle motion action is relevant to the intended audience of the audible vehicle indication based at least in part on at least one of a type of the relevant planned vehicle motion action or an effect of the relevant planned vehicle motion action on at least one of a heading or a speed of the autonomous vehicle.

8. The computer-implemented method of claim 1 , wherein the data associated with the autonomous vehicle comprises at least one of perception data obtained by an autonomy system of the autonomous vehicle, prediction data obtained by the autonomy system of the autonomous vehicle, data associated with a motion plan of the autonomous vehicle, or data associated with a collision mitigation system of the autonomous vehicle.

9. The computer-implemented method of claim 1 , wherein the autonomous vehicle comprises a plurality of output devices onboard the autonomous vehicle, and wherein outputting the audible vehicle indication comprises:

selecting, by the computing system, a subset of the plurality of output devices located onboard the autonomous vehicle based at least in part on the one or more locations associated with the relevant object or the one or more locations associated with the relevant planned vehicle motion action; and

outputting, by the computing system via the subset of the plurality of output devices, the audible vehicle indication.

10. The computer-implemented method of claim 9 , wherein one or more positions of the subset of output devices correspond to the one or more locations associated with the relevant object or the one or more locations associated with the relevant planned vehicle motion action.

11. The computer-implemented method of claim 10 , wherein the one or more locations associated with the relevant object comprise at least one of a current location of the relevant object or one or more predicted future locations of the relevant object.

12. The computer-implemented method of claim 1 , wherein determining, by the computing system, the audible vehicle indication comprises:

accessing, by the computing system, a data structure stored in a memory located onboard the autonomous vehicle, wherein the data structure is indicative of a plurality of auditory characteristics;

identifying, by the computing system, one or more auditory characteristics of the plurality of auditory characteristics for the audible vehicle indication based at least in part on the data structure, and

wherein outputting, by the computing system via the one or more output devices onboard the autonomous vehicle, the audible vehicle indication comprises outputting the audible vehicle indication in accordance with the one or more identified auditory characteristics.

13. The computer-implemented method of claim 12 , wherein at least one of the identified auditory characteristics is based at least in part on the intended audience of the audible vehicle indication.

14. A computing system for communicating autonomous vehicle operations, comprising:

one or more processors; and

one or more memory devices, the one or more memory devices storing instructions that when executed by the one or more processors cause the computing system to perform operations, the operations comprising:

obtaining data associated with the autonomous vehicle;

identifying an object within a surrounding environment of the autonomous vehicle or a planned vehicle motion action of the autonomous vehicle based at least in part on the data associated with the autonomous vehicle and a type of an intended audience of an audible vehicle indication associated with the object or the planned vehicle motion action, wherein the type of the intended audience includes an operator of the autonomous vehicle or a passenger of the autonomous vehicle; and

outputting within an interior of the autonomous vehicle, via one or more output devices, the audible vehicle indication that is associated with the identified object or the planned vehicle motion action.

15. The computing system of claim 14 , wherein identifying the object within the surrounding environment of the autonomous vehicle or the planned vehicle motion action of the autonomous vehicle comprises:

identifying the type of intended audience of the audible vehicle indication; and

identifying the object or the planned vehicle motion action as relevant based at least in part on the type of the intended audience of the audible vehicle indication.

16. The computing system of claim 14 , wherein the one or more output devices correspond to one or more locations associated with the object or one or more locations associated with the planned vehicle motion action.

17. The computing system of claim 14 , wherein the operations further comprise:

providing data indicative of the audible vehicle indication to one or more remote computing devices, wherein the audible vehicle indication is outputted to a remote operator of the autonomous vehicle.

18. An autonomous vehicle, comprising:

one or more output devices;

one or more processors; and

one or more memory devices, the one or more memory devices storing instructions that when executed by the one or more processors cause the autonomous vehicle to perform operations, the operations comprising:

obtaining data associated with the autonomous vehicle;

identifying an object within a surrounding environment of the autonomous vehicle or a planned vehicle motion action of the autonomous vehicle based at least in part on the data associated with the autonomous vehicle and a type of an intended audience of an audible vehicle indication associated with the object or the planned vehicle motion action, wherein the type of the intended audience includes an operator of the autonomous vehicle or a passenger of the autonomous vehicle;

generating the audible vehicle indication that is associated with the identified object or the planned vehicle motion action; and

outputting, via the one or more output devices, the audible vehicle indication, wherein the one or more output devices correspond to one or more locations associated with the object or one or more locations associated with the planned vehicle motion action.

19. The autonomous vehicle of claim 18 , wherein the operations further comprise:

determining a level of attentiveness associated with the operator located within an interior of the autonomous vehicle, and

wherein outputting, via the one or more output devices, the audible vehicle indication comprises outputting the audible vehicle indication based at least in part on the level of attentiveness.

20. The autonomous vehicle of claim 19 , wherein the audible vehicle indication is indicative of an intention of the object within the surrounding environment of the autonomous vehicle.

Assignments (5)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNMENT DOCUMENT PREVIOUSLY RECORDED AT REEL: 054919 FRAME: 0026. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Mar 2, 2022
From: UATC, LLC
To: UBER TECHNOLOGIES, INC.
Reel/Frame 059692/0280 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2021
From: UATC, LLC
To: UBER TECHNOLOGIES, INC.
Reel/Frame 054919/0026 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NATURE OF CONVEYANCE FROM CHANGE OF NAME TO ASSIGNMENT PREVIOUSLY RECORDED ON REEL 050353 FRAME 0884. ASSIGNOR(S) HEREBY CONFIRMS THE CORRECT CONVEYANCE SHOULD BE ASSIGNMENT. Recorded Nov 27, 2019
From: UBER TECHNOLOGIES, INC.
To: UATC, LLC
Reel/Frame 051145/0001 →
CHANGE OF NAME Recorded Sep 12, 2019
From: UBER TECHNOLOGIES, INC.
To: UATC, LLC
Reel/Frame 050353/0884 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2017
From: ZYCH, NOAH
To: UBER TECHNOLOGIES, INC.
Reel/Frame 043814/0453 →