Mirrors to extend sensor field of view in self-driving vehicles
The technology relates to enhancing or extending the field of view of sensors for vehicles configured to operate in an autonomous driving mode. One or more mirrors are used to reflect or redirect beams emitted from onboard sensors that would otherwise be wasted, for instance due to obstruction by a portion of the vehicle or because they are emitted at high pitch angles to the side. The mirrors are also used to redirect incoming beams from the external environment toward one or more of the onboard sensors. Using mirrors for such redirection can reduce or eliminate blind spots around the vehicle. A calibration system may be employed to account for mirror movement due to vibration or wind drag. Each mirror may be a front surface mirror. The mirrors may be positioned on the vehicle body, on a faring, or extending from a sensor housing on the vehicle.
1. A method of operating a vehicle in an autonomous driving mode, comprising:
receiving, by one or more processors of a control system of the vehicle, sensor data obtained from one or more sensors of a perception system of the vehicle;
detecting, by the one or more processors, a blockage or a change in a field of view of the one or more sensors in an area around the vehicle due to an intervening object;
in response to detecting the blockage or the change in the field of view due to the intervening object, obtaining, by the one or more processors, sensor data of reflected signals from one or more mirrors along the vehicle, the one or more mirrors being configured to reflect received signals towards at least one of the one or more sensors to provide an enhanced sensor field of view beyond the intervening object; and
controlling, by the one or more processors, a driving system of the vehicle when operating in the autonomous driving mode, in response to the received sensor data obtained from the one or more sensors and the obtained sensor data of the reflected signals that provides the enhanced sensor field of view associated with the intervening object.
2. The method of claim 1 , wherein the vehicle is a first vehicle, and the intervening object is second vehicle that has moved in front of the first vehicle.
3. The method of claim 2 , wherein obtaining the sensor data of reflected signals from the one or more mirrors includes adjusting the one or more mirrors to provide the enhanced sensor field of view beyond the second vehicle.
4. The method of claim 3 , wherein adjusting the one or more mirrors is performed when the second vehicle has moved between the first vehicle and a given road user.
5. The method of claim 1 , wherein obtaining the sensor data of reflected signals from the one or more mirrors includes deploying the one or more mirrors away from a surface of the vehicle during operation of the vehicle in the autonomous driving mode.
6. The method of claim 5 , further comprising retracting the one or more mirrors onto or into the vehicle when not being used to provide the enhanced sensor field of view.
7. The method of claim 1 , further comprising calibrating the one or more mirrors prior to or during operation in the autonomous driving mode.
8. The method of claim 1 , further comprising:
detecting an amount of vibration for the one or more mirrors; and
providing information regarding the detected amount of vibration to the perception system or the control system during processing of the obtained sensor data.
9. A vehicle configured to operate in an autonomous driving mode, comprising:
a driving system including a steering subsystem, an acceleration subsystem and a deceleration subsystem to control driving of the vehicle in the autonomous driving mode;
a perception system including one or more sensors configured to detect objects in an environment surrounding the vehicle based on obtained sensor data, each of the one or more sensors being disposed in a respective housing positioned along the vehicle;
one or more mirrors configured to reflect received signals towards at least one of the one or more sensors to enhance a sensor field of view around the vehicle; and
a control system operatively connected to the driving system and the perception system, the control system having one or more processors configured to:
receive the sensor data obtained from one or more sensors of the perception system;
detect a blockage or a change in a field of view of the one or more sensors in an area around the vehicle due to an intervening object;
in response to detection of the blockage or the change in the field of view due to the intervening object, obtain sensor data of reflected signals from the one or more mirrors; and
control the driving system of the vehicle when operating in the autonomous driving mode, in response to the sensor data obtained from the one or more sensors and the sensor data of the reflected signals.
10. The vehicle of claim 9 , wherein the one or more processors are configured to obtain the sensor data of reflected signals from the one or more mirrors via adjustment of the one or more mirrors to provide the enhanced sensor field of view beyond the intervening object.
11. The vehicle of claim 9 , wherein the one or more processors are configured to obtain the sensor data of reflected signals from the one or more mirrors via deployment of the one or more mirrors away from a surface of the vehicle during operation of the vehicle in the autonomous driving mode.
12. The vehicle of claim 11 , wherein the one or more processors are further configured to cause retraction of the one or more mirrors onto or into the vehicle when not being used to provide the enhanced sensor field of view.
13. The vehicle of claim 9 , wherein the one or more processors are further configured to calibrate the one or more mirrors prior to or during operation in the autonomous driving mode.
14. A method of operating a vehicle in an autonomous driving mode, comprising:
receiving, by one or more processors of a control system of the vehicle, sensor data obtained from one or more sensors of a perception system of the vehicle;
identifying a field of view limitation adjacent to a side of the vehicle associated with a given one of the one or more sensors of the perception system;
in response to the identified field of view limitation of the given sensor, obtaining, by the one or more processors, sensor data of reflected signals from one or more mirrors arranged along a surface of the vehicle, the one or more mirrors being configured to reflect received signals towards at least one of the one or more sensors to enhance the field of view of the given sensor; and
controlling, by the one or more processors, a driving system of the vehicle when operating in the autonomous driving mode, in response to the received sensor data obtained from the one or more sensors and the obtained sensor data of the reflected signals that provides the enhanced sensor field of view.
15. The method of claim 14 , wherein obtaining the sensor data of reflected signals from the one or more mirrors includes adjusting the one or more mirrors to provide the enhanced sensor field of view.
16. The method of claim 14 , wherein obtaining the sensor data of reflected signals from the one or more mirrors includes deploying the one or more mirrors away from a surface of the vehicle during operation of the vehicle in the autonomous driving mode.
17. The method of claim 16 , further comprising retracting the one or more mirrors onto or into the vehicle when not being used to provide the enhanced sensor field of view.
18. The method of claim 14 , further comprising calibrating the one or more mirrors prior to or during operation in the autonomous driving mode.
19. The method of claim 14 , further comprising dampening vibration of the one or more mirrors during operation in the autonomous driving mode.
20. A vehicle configured to operate in an autonomous driving mode, comprising:
a driving system including a steering subsystem, an acceleration subsystem and a deceleration subsystem to control driving of the vehicle in the autonomous driving mode;
a perception system including one or more sensors configured to detect objects in an environment surrounding the vehicle based on obtained sensor data, each of the one or more sensors being disposed in a respective housing positioned along the vehicle;
one or more mirrors configured to reflect received signals towards at least one of the one or more sensors to enhance a sensor field of view around the vehicle; and
a control system operatively connected to the driving system and the perception system, the control system having one or more processors configured to:
receive sensor data obtained from the one or more sensors of the perception system;
identify a field of view limitation adjacent to a side of the vehicle associated with a given one of the one or more sensors of the perception system;
in response to the identified field of view limitation of the given sensor, obtain sensor data of reflected signals from the one or more mirrors; and
control the driving system of the vehicle when operating in the autonomous driving mode, in response to the received sensor data obtained from the one or more sensors and the obtained sensor data of the reflected signals.