IP Library Granted Patent US 10,434,935
Granted Patent B1
US 10,434,935 · App. 16/024,231 · Granted Oct 8, 2019

Interactive external vehicle-user communication

Inventors: Jingyi Zhang (San Jose, CA); Melissa Cefkin (San Jose, CA)
Assignees: Nissan North America, Inc.; Renault S.A.S.
B60Q1/50G05D1/0088G05D1/0212G07C5/008G08G1/163G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,434,935
App. No.
16/024,231
Granted
Oct 8, 2019
Kind
B1
Abstract

Interactive external vehicle-user communication may include identifying operational environment information representing a current operational environment for an AV; identifying a target external user based on the current operational environment for the AV, the target external user is identified based on sensor information from a sensor of the AV; controlling the AV to output, for the target external user, a first semiotic representation of a control information of the AV related to the operational environment information; receiving an acknowledgement of the first semiotic representation from the target external user; and in response to the acknowledgement, controlling the AV to traverse the portion of the vehicle transportation network, such that controlling the AV to traverse the portion of the vehicle transportation network includes controlling the AV to output a second semiotic representation based on the acknowledgement from the target external user.

Claims (45)

1. An autonomous vehicle (AV) configured to traverse a portion of a vehicle transportation network, the AV comprising:

a processor configured to execute instructions stored on a non-transitory computer readable medium to:

identify operational environment information representing a current operational environment for the AV, such that the operational environment information includes information representing an identified aspect of the current operational environment;

identify a target external user based on the current operational environment for the AV, the target external user is identified based on sensor information from a sensor of the AV;

control the AV to output, for the target external user, a first semiotic representation of a control information of the AV related to the operational environment information;

receive an acknowledgement of the first semiotic representation from the target external user; and

in response to the acknowledgement, control the AV to traverse the portion of the vehicle transportation network, such that controlling the AV to traverse the portion of the vehicle transportation network includes controlling the AV to output a second semiotic representation based on the acknowledgement from the target external user.

2. The AV of claim 1 , wherein the processor is configured to execute the instructions to control the AV to output the second semiotic representation by controlling an output device of the AV to output at least a portion of the second semiotic representation, wherein the output device includes at least one of an external luminous presentation unit of the autonomous vehicle, an external aural presentation unit of the AV, a directional state control unit of the AV, or a kinetic state control unit of the AV.

3. The AV of claim 1 ,

wherein the instructions to receive the acknowledgement from the target external user comprise to:

receive an implicit acknowledgement from the target external user; and

wherein the second semiotic representation comprises an interpretation of the implicit acknowledgement and a vehicle intent.

4. The AV of claim 3 , the processor is further configured to execute the instructions to:

control the AV to traverse a portion of the vehicle transportation network in accordance with the vehicle intent.

5. The AV of claim 1 , wherein the first semiotic representation comprises a vehicle intent and a vehicle intent basis.

6. The AV of claim 1 ,

wherein the instructions to receive the acknowledgement from the target external user comprise to:

receive an explicit acknowledgement from the target external user; and

wherein the second semiotic representation comprises a confirmation of the explicit acknowledgement and a vehicle intent.

7. The AV of claim 1 , wherein the second semiotic representation comprises an informational message.

8. The AV of claim 1 , wherein the processor is further configured to execute the instructions to:

identify a first trajectory of an external user; and

in response to determining that the first trajectory of the external user converging with a second trajectory of the target external user, control the AV to output, for the external user, a third semiotic representation based on the determining that the first trajectory converging with the second trajectory.

9. The AV of claim 8 , wherein the processor is further configured to execute the instructions to:

control the AV to output, for the target external user, a fourth semiotic representation based on the determining that the first trajectory converging with the second trajectory of the target external user.

10. A method of traversing a portion of a vehicle transportation network by an autonomous vehicle (AV), comprising:

identifying operational environment information representing a current operational environment for the AV, such that the operational environment information includes information representing an identified aspect of the current operational environment;

identifying a target external user based on the current operational environment for the AV, the target external user is identified based on sensor information from a sensor of the AV;

controlling the AV to output, for the target external user, a first semiotic representation of a control information of the AV related to the operational environment information;

receiving an acknowledgement of the first semiotic representation from the target external user; and

in response to the acknowledgement, controlling the AV to traverse the portion of the vehicle transportation network, such that controlling the AV to traverse the portion of the vehicle transportation network includes controlling the AV to output a second semiotic representation based on the acknowledgement from the target external user.

11. The method of claim 10 , wherein controlling the AV to output the second semiotic representation comprises:

controlling an output device of the AV to output at least a portion of the second semiotic representation, wherein the output device includes at least one of an external luminous presentation unit of the autonomous vehicle, an external aural presentation unit of the AV, a directional state control unit of the AV, or a kinetic state control unit of the AV.

12. The method of claim 10 ,

wherein receiving the acknowledgement from the target external user comprises:

receiving an implicit acknowledgement from the target external user; and

wherein the second semiotic representation comprises an interpretation of the implicit acknowledgement and a vehicle intent.

13. The method of claim 12 , further comprising:

controlling the AV to traverse the portion of the vehicle transportation network in accordance with the vehicle intent.

14. The method of claim 10 , wherein the first semiotic representation comprises a vehicle intent and a vehicle intent basis.

15. The method of claim 10 ,

wherein receiving the acknowledgement from the target external user comprises:

receiving an explicit acknowledgement from the target external user; and

wherein the second semiotic representation comprises a confirmation of the explicit acknowledgement and a vehicle intent.

16. The method of claim 10 , wherein the second semiotic representation comprises an informational message.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENT NUMBER 10,435,078 PREVIOUSLY RECORDED AT REEL: 053707 FRAME: 0836. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Sep 10, 2020
From: NISSAN NORTH AMERICA, INC.
To: NISSAN MOTOR CO., LTD.
Reel/Frame 053750/0299 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 8, 2020
From: NISSAN NORTH AMERICA, INC.
To: NISSAN MOTOR CO., LTD.
Reel/Frame 053707/0836 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 20, 2019
From: NISSAN NORTH AMERICA, INC.
To: NISSAN NORTH AMERICA, INC.; RENAULT S.A.S.
Reel/Frame 050105/0943 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2018
From: ZHANG, JINGYI; CEFKIN, MELISSA
To: NISSAN NORTH AMERICA, INC.
Reel/Frame 046250/0252 →
Cited By (5)
US 12,236,921 US 12,272,194 US 12,365,362 US 12,498,253 US 12,528,509