Sensor layout for autonomous vehicles
Disclosed are devices and systems for an optimized sensor layout for an autonomous or semi-autonomous vehicle. In one aspect, the system includes a vehicle capable of semi-autonomous or autonomous operation. A plurality of forward-facing cameras is coupled to the vehicle and configured to have a field of view in front of the vehicle. At least three forward-facing cameras of the plurality of forward-facing cameras have different focal lengths. A right-side camera is coupled to the right side of the vehicle, the right-side camera configured to have a field of view to the right of the vehicle. A left-side camera is coupled to the left side of the vehicle, the left-side camera is configured to have a field of view to the left of the vehicle.
1. A system comprising:
a vehicle capable of semi-autonomous or autonomous operation;
a plurality of forward-facing cameras coupled to the vehicle and configured to have a field of view in front of the vehicle, at least three forward-facing cameras of the plurality of forward-facing cameras having different focal lengths;
a right-side camera coupled to a right side of the vehicle, the right-side camera configured to have a field of view to a right of the vehicle;
a left-side camera coupled to a left side of the vehicle, the left-side camera configured to have a field of view to a left of the vehicle; and
at least two backward-facing cameras coupled to the vehicle and configured to have a field of view behind the vehicle, the at least two backward-facing cameras having a focal length that is same as a focal length of one of the at least three forward-facing cameras.
2. The system of claim 1 , wherein a first forward-facing camera of the plurality of forward-facing cameras has a focal length of 15 mm or less, a second forward-facing camera of the plurality of forward-facing cameras has a focal length of 8-36 mm, and a third forward-facing camera of the plurality of forward-facing cameras has a focal length of at least 25 mm.
3. The system of claim 1 , further comprising:
a set of LiDARs coupled to the vehicle, the set of LiDARs configured to measure a distance between the vehicle and an object; and
a long-range RADAR coupled to the vehicle, the long-range RADAR being a microwave RADAR and configured to detect the object near the vehicle.
4. The system of claim 3 , wherein the long-range RADAR operates at a frequency greater than 40 GHz.
5. The system of claim 1 , further comprising:
a plurality of short-range RADAR coupled to the vehicle, the plurality of short-range RADAR configured to measure velocity and distance of an object near the vehicle and wherein the plurality of short-range RADARs is configured to have a range of vision at or near 360 degrees around the vehicle.
6. The system of claim 1 , wherein the at least two backward-facing cameras are arranged along an edge of a top of the vehicle.
7. The system of claim 1 , wherein a first forward-facing camera of the plurality of forward-facing cameras has a perception range of 250 meters, a second forward-facing camera of the plurality of forward-facing cameras has a perception range of 500 meters, and a third forward-facing camera of the plurality of forward-facing cameras has a perception range of about 1000 meters.
8. A system comprising:
a tractor capable of semi-autonomous or autonomous operation, the tractor coupled to a semi-trailer;
a plurality of forward-facing cameras coupled to one of the tractor or the semi-trailer and configured to have a field of view in front of one of the tractor or the semi-trailer, at least three forward-facing cameras of the plurality of forward-facing cameras having different focal lengths;
a right-side camera coupled to a right side of one of the tractor or the semi-trailer, the right-side camera configured to have a field of view to a right of one of the tractor or the semi-trailer;
a left-side camera coupled to a left side of one of the tractor or the semi-trailer, the left-side camera configured to have a field of view to a left of one of the tractor or the semi-trailer; and
at least two backward-facing cameras coupled to the tractor and configured to have a field of view behind the tractor, the at least two backward-facing cameras having a focal length that is same as a focal length of one of the at least three forward-facing cameras.
9. The system of claim 8 , wherein a first forward-facing camera of the plurality of forward-facing cameras has a focal length less than 12 mm, a second forward-facing camera of the plurality of forward-facing cameras has a focal length of 8-36 mm, and a third forward-facing camera of the plurality of forward-facing cameras has a focal length of at least 25 mm.
10. The system of claim 8 , wherein the at least 3 forward facing cameras of the plurality of forward-facing cameras are mounted above a cabin of the tractor.
11. The system of claim 8 , further comprising:
a semi-trailer LiDAR configured to monitor an angle of the semi-trailer relative to the tractor.
12. The system of claim 11 , further comprising:
a long-range RADAR coupled to the tractor, the long-range RADAR being a microwave RADAR and configured to detect the object near the tractor, and wherein the semi-trailer and the long-range RADAR operates at a frequency greater than 40 GHz.
13. The system of claim 8 , further comprising:
a backward-facing camera coupled to the one of the tractor or the semi-trailer, the backward-facing camera is configured to have a field of view behind one of the tractor or the semi-trailer.
14. The system of claim 8 , further comprising:
a set of LiDARs coupled to the tractor, wherein the set of LiDARs is configured to measure a distance between the tractor and an object and the set of LiDARs is configured to have a range of vision at or near 360 degrees around the tractor.
15. The system of claim 14 , wherein the plurality of forward-facing cameras, the at least two backward-facing cameras, the set of LiDARs, and the long-range RADAR are configured to provide a 360 degree coverage around the tractor.
16. The system of claim 8 , further comprising:
a GPS transceiver coupled to the tractor, the GPS transceiver configured to provide longitude, latitude, and heading angle information; and
an IMU coupled to the tractor, the IMU configured to sense position and orientation changes of the tractor based on inertial acceleration.
17. The system of claim 16 , wherein the GPS transceiver is further configured to provide localization data and pose estimation data and the IMU is further configured to assist in accurately locating the tractor for a period of time during a signal outage.
18. The system of claim 8 , further comprising:
a plurality of short/medium-range RADAR coupled to one of the tractor or the semi-trailer, the plurality of short/medium-range RADAR configured to measure velocity and distance of an object near the tractor and configured to operate at a frequency between 2 and 36 GHz.
19. The system of claim 18 , wherein the plurality of short/medium-range RADAR is configured to have a range of vision at or near 360 degrees around the tractor.
20. The system of claim 8 , further comprising:
a global mobile satellite system (GMSS) coupled to the tractor.