Communication between autonomous vehicle and external observers
At least one embodiment of this disclosure includes a method for an autonomous vehicle (e.g., a fully autonomous or semi-autonomous vehicle) to communicate with external observers. The method includes: receiving a task at the autonomous vehicle; collecting data that characterizes a surrounding environment of the autonomous vehicle from a sensor coupled to the autonomous vehicle; determining an intended course of action for the autonomous vehicle to undertake based on the task and the collected data; and conveying a human understandable output via an output device, the human understandable output expressly or implicitly indicating the intended course of action to an external observer.
1 . A computer-implemented method, comprising:
collecting, by a first control system of an autonomous vehicle and from a sensor coupled to the autonomous vehicle, data that characterizes a surrounding environment of the autonomous vehicle;
determining an intended course of action for the autonomous vehicle to undertake based on an assigned task and the collected data;
identifying, based on the collected data, a driver of another vehicle in the surrounding environment;
transmitting inter-device communication comprising radio frequency signals from the first control system to a second control system of the other vehicle,
wherein the inter-device communication indicates the intended course of action of the autonomous vehicle to the second control system for navigation of the other vehicle;
displaying a notification on a ground surface to gain attention of the driver of the other vehicle;
determining that the driver is paying attention to the autonomous vehicle by analyzing the data;
projecting a human understandable output on the ground surface in proximity to the autonomous vehicle;
determining a location of the driver based on the data for projecting light at the driver; and
projecting the light at the driver.
2 . The computer-implemented method of claim 1 , wherein the inter-device communication comprises at least one of wireless digital signals, steganographic communication with digital information encoded into a human understandable presentation, optical signals, or acoustic signals.
3 . The computer-implemented method of claim 1 , wherein the inter-device communication indicates a trajectory of the autonomous vehicle or an area that the autonomous vehicle intends to avoid.
4 . The computer-implemented method of claim 1 , wherein the human understandable output indicates the intended course of action of the autonomous vehicle to the driver.
5 . The computer-implemented method of claim 1 , wherein collecting the data comprises detecting a gesture associated with the driver.
6 . The computer-implemented method of claim 1 , comprising:
projecting the human understandable output, via a projector that manipulates or produces light, to the ground surface in proximity to the autonomous vehicle.
7 . A control system of an autonomous vehicle, the control system comprising:
at least one hardware processor; and
at least one non-transitory memory storing instructions, which, when executed by the at least one hardware processor, cause the control system to:
collect, from a sensor coupled to the autonomous vehicle, data that characterizes a surrounding environment of the autonomous vehicle;
determine an intended course of action for the autonomous vehicle to undertake based on an assigned task and the collected data;
identify, based on the collected data, a driver of another vehicle in the surrounding environment;
transmit radio frequency based inter-device communication to another control system of the other vehicle,
wherein the inter-device communication indicates the intended course of action of the autonomous vehicle to the other control system for navigation of the other vehicle;
display a notification on a ground surface to gain attention of the driver of the other vehicle;
determine that the driver is paying attention to the autonomous vehicle by analyzing the data;
project a human understandable output on the ground surface in proximity to the autonomous vehicle;
determine a location of the driver based on the data for projecting light at the driver; and
project the light at the driver.
8 . The control system of claim 7 , wherein the inter-device communication comprises at least one of wireless digital signals, steganographic communication with digital information encoded into a human understandable presentation, optical signals, or acoustic signals.
9 . The control system of claim 7 , wherein the inter-device communication indicates a trajectory of the autonomous vehicle or an area that the autonomous vehicle intends to avoid.
10 . The control system of claim 7 , wherein the human understandable output indicates indicating the intended course of action of the autonomous vehicle to the driver.
11 . The control system of claim 7 , wherein the instructions to collect the data cause the control system to detect a gesture associated with the driver.
12 . The control system of claim 7 , wherein the instructions cause the control system to:
project the human understandable output, via a projector that manipulates or produces light, to the ground surface in proximity to the autonomous vehicle.
13 . A non-transitory, computer-readable storage medium comprising instructions recorded thereon that, when executed by at least one processor of a control system of an autonomous vehicle, cause the control system to:
collect, from a sensor coupled to the autonomous vehicle, data that characterizes a surrounding environment of the autonomous vehicle;
determine an intended course of action for the autonomous vehicle to undertake based on an assigned task and the collected data;
identify, based on the collected data, a driver of another vehicle in the surrounding environment;
transmit radio frequency based inter-device communication to another control system of the other vehicle,
wherein the inter-device communication indicates the intended course of action of the autonomous vehicle to the other control system for navigation of the other vehicle;
display a notification on a ground surface to gain attention of the driver of the other vehicle;
determine that the driver is paying attention to the autonomous vehicle by analyzing the data;
project a human understandable output on the ground surface in proximity to the autonomous vehicle;
determine a location of the driver based on the data for projecting light at the driver; and
project the light at the driver.
14 . The non-transitory, computer-readable storage medium of claim 13 , wherein the inter-device communication comprises at least one of wireless digital signals, steganographic communication with digital information encoded into a human understandable presentation, optical signals, or acoustic signals.
15 . The non-transitory, computer-readable storage medium of claim 13 , wherein the inter-device communication indicates a trajectory of the autonomous vehicle or an area that the autonomous vehicle intends to avoid.
16 . The non-transitory, computer-readable storage medium of claim 13 , wherein the human understandable output indicates indicating the intended course of action of the autonomous vehicle to the driver.
17 . The non-transitory, computer-readable storage medium of claim 13 , wherein the instructions to collect the data cause the control system to detect a gesture associated with the driver.