Camera-gated lidar system
A machine vision system comprises a camera configured to generate one or more images of a field of regard of the camera, a lidar system, and a processor. The lidar system includes a laser configured to emit light, where the emitted light is directed toward a region within the field of regard of the camera and a receiver configured to detect light returned from the emitted light. The processor is configured to receive an indication of a location based on the returned light and determine, based on the one or more images generated by the camera, whether the indication of the location is associated with a spurious return.
1. A machine vision system comprising:
a camera configured to generate one or more images of a field of regard (FOR) of the camera;
a lidar system comprising:
a light source configured to emit light comprising pulses of light having a first repetition rate, wherein the lidar system is configured to direct the emitted light toward a region within the FOR of the camera, and
a receiver configured to detect returned light that includes scattered light from the emitted light; and
a processor configured to:
receive an indication of a location based on the returned light,
determine, based on the one or more images generated by the camera, that the indication of the location is associated with a spurious return, and
cause, in response to determining that the indication of the location is associated with a spurious return, the light source to increase the repetition rate of the emitted pulses of light to a second repetition rate higher than the first repetition rate.
2. The machine vision system of claim 1 , wherein the indication of the location being associated with a spurious return corresponds to a solid object not being present at the location.
3. The machine vision system of claim 1 , wherein in response to determining, based on the one or more images, that the indication of the location is associated with a spurious return, the processor is further configured to discard the indication of the location.
4. The machine vision system of claim 3 , wherein discarding the indication of the location comprises (i) deleting the indication, (ii) flagging the indication as corresponding to something that does not need to be avoided by a vehicle or something other than a solid object, or (iii) flagging the indication with a low confidence level.
5. The machine vision system of claim 1 , wherein determining whether the indication of the location is associated with a spurious return comprises detecting, using the one or more images generated by the camera, an obscurant in a path of the emitted light.
6. The machine vision system of claim 5 , wherein the obscurant includes one or more of rain, fog, haze, dust, steam, and car exhaust.
7. The machine vision system of claim 5 , wherein the processor is further configured to discard, in response to detection of the obscurant, the indication of the location.
8. The machine vision system of claim 5 , wherein:
the indication of the location is one of a plurality of indications of location received by the processor, wherein the indications of location are based on the returned light; and
the processor is further configured to discard, in response to detection of the obscurant, at least one of the indications of location.
9. The machine vision system of claim 8 , wherein the processor is further configured to associate a last one of the indications of location with a solid object.
10. The machine vision system of claim 1 , wherein the processor is further configured to detect an absence of targets along a path of the emitted light within a certain range of the lidar system, using the one or more images generated by the camera.
11. The machine vision system of claim 10 , wherein the processor is configured to determine that the indication of the location is associated with a spurious return if the indication of the location corresponds to a distance within the certain range.
12. The machine vision system of claim 1 , wherein the processor is further configured to identify a null-space within the FOR of the camera, the null-space comprising a volume that is free of solid objects.
13. The machine vision system of claim 12 , wherein the processor is configured to determine that the indication of the location is associated with a spurious return further based on the location being within the null-space.
14. The machine vision system of claim 1 , wherein the indication of the location comprises a distance value corresponding to a distance from the lidar system.
15. The machine vision system of claim 1 , wherein the camera comprises a CCD camera or a CMOS camera.
16. The machine vision system of claim 1 , wherein the light source comprises a pulsed laser diode.
17. The machine vision system of claim 1 , wherein the receiver comprises an avalanche photodiode configured to produce an electrical current that corresponds to the returned light detected by the receiver.
18. The machine vision system of claim 1 , further comprising a housing enclosing the camera and the lidar system, wherein the housing comprises a window through which the emitted light and the returned light pass.
19. The machine vision system of claim 1 , wherein the second repetition rate (i) is associated with a reduced range of the lidar system and (ii) is configured to provide information about targets located within the reduced range.