Occupant facing vehicle display
Aspects of the present disclosure relate to a vehicle for maneuvering an occupant of the vehicle to a destination autonomously as well as providing information about the vehicle and the vehicle's environment for display to the occupant. The information includes a representation of a scene depicting an external environment of the vehicle. The representation of the scene includes a visual representation of the vehicle and a visual representation of objects in an external environment of the vehicle.
1. A method comprising:
receiving, by one or more processors, sensor data from a sensor of a vehicle, the sensor configured to detect objects in an external environment of the vehicle;
identifying, by the one or more processors, an object in the external environment based on the sensor data;
generating, by the one or more processors, a representation of a scene depicting the external environment, the representation of the scene including:
a visual representation of the vehicle; and
a visual representation of the object, the visual representation of the object utilizing a first color,
wherein a color of the visual representation of the object changes based on whether the vehicle is reacting to the object and an object type of the object; and
displaying, by the one or more processors, the representation of the scene on a display for an occupant of the vehicle.
2. The method of claim 1 , wherein the representation of the scene further includes a background scene having a background color scheme.
3. The method of claim 2 , wherein the first color blends with the background color scheme of the background scene.
4. The method of claim 1 , wherein the object type includes vehicle, pedestrian, and bicyclist.
5. The method of claim 4 , wherein, when the object type is determined to be the pedestrian, the visual representation of the object includes a ring.
6. The method of claim 4 , wherein, when the object type is determined to be the vehicle, the visual representation of the object is one of a box, tray or stylized cuboid.
7. The method of claim 1 , wherein a shape of the visual representation of the object is determined based on the object type.
8. The method of claim 1 , wherein reacting to the object includes yielding to the object, maneuvering around the object, slowing down, and stopping.
9. The method of claim 1 , wherein the color of the visual representation of the object changes when the object moves in a path of the vehicle.
10. The method of claim 1 , wherein the representation of the scene further includes a representation of a path which the vehicle is currently following.
11. A system comprising:
a display; and
one or more processors configured to:
receive sensor data from a sensor of a vehicle, the sensor configured to detect objects in an external environment of the vehicle;
identify an object in the external environment based on the sensor data;
generate a representation of a scene depicting the external environment, the representation of the scene including:
a visual representation of the vehicle; and
a visual representation of the object, the visual representation of the object utilizing a first color,
wherein a color of the visual representation of the object changes based on whether the vehicle is reacting to the object and an object type of the object; and
display the representation of the scene on a display for an occupant of the vehicle.
12. The system of claim 11 , wherein the representation of the scene further includes a background scene having a background color scheme.
13. The system of claim 12 , wherein the first color blends with the background color scheme of the background scene.
14. The system of claim 11 , wherein the object type includes vehicle, pedestrian, and bicyclist.
15. The system of claim 14 , wherein, when the object type is determined to be the pedestrian, the visual representation includes a ring.
16. The system of claim 14 , wherein, when the object type is determined to be the vehicle, the visual representation of the object is one of a box, tray or stylized cuboid.
17. The system of claim 11 , wherein a shape of the visual representation of the object is determined based on the object type.
18. The system of claim 11 , wherein reacting to the object includes yielding to the object, maneuvering around the object, slowing down, and stopping.
19. The system of claim 11 , wherein the color of the visual representation of the object changes when the object moves in a path of the vehicle.
20. The system of claim 11 , wherein the representation of the scene further includes a representation of a path which the vehicle is currently following.