Vision-based indicator signal detection using spatiotemporal filtering
An autonomous vehicle is configured to detect an active turn signal indicator on another vehicle. An image-capture device of the autonomous vehicle captures an image of a field of view of the autonomous vehicle. The autonomous vehicle captures the image with a short exposure to emphasize objects having brightness above a threshold. Additionally, a bounding area for a second vehicle located within the image is determined. The autonomous vehicle identifies a group of pixels within the bounding area based on a first color of the group of pixels. The autonomous vehicle also calculates an oscillation of an intensity of the group of pixels. Based on the oscillation of the intensity, the autonomous vehicle determines a likelihood that the second vehicle has a first active turn signal. Additionally, the autonomous vehicle is controlled based at least on the likelihood that the second vehicle has a first active turn signal.
1. A method comprising:
receiving from an image-capture device coupled to a first vehicle, an image of a field of view of the first vehicle;
based on the image of the field of view of the first vehicle, determining a set of images, wherein a first image in the set of images depicts in a first color channel at least a portion of a second vehicle in the field of view of the first vehicle, and wherein a second image in the set of images depicts in a second color channel at least the portion of the second vehicle;
comparing the first image and the second image to determine a state of the second vehicle; and
controlling the first vehicle based on the comparison.
2. The method of claim 1 , wherein the first color channel is a target color channel, and wherein the second color channel is an undesirable color channel.
3. The method of claim 2 , wherein the target color channel comprises a red or amber color channel, and wherein the undesirable color channel is a blue color channel.
4. The method of claim 1 , wherein the portion of the second vehicle comprises:
a turn signal indicator of the second vehicle.
5. The method of claim 4 , wherein comparing the first image and the second image to determine the state of the second vehicle comprises:
comparing the first image and the second image to determine if the turn signal indicator of the second vehicle is active.
6. The method of claim 5 , wherein controlling the first vehicle based on the comparison comprises:
based on determining that the turn signal indicator of the second vehicle is active, reducing a speed of the first vehicle.
7. The method of claim 5 , wherein controlling the first vehicle based on the comparison comprises:
based on determining that the turn signal indicator of the second vehicle is active, altering a course of navigation of the first vehicle.
8. The method of claim 5 , wherein controlling the first vehicle based on the comparison comprises:
based on determining that the turn signal indicator of the second vehicle is not active, maintaining a speed of the first vehicle.
9. A system comprising:
at least one processor configured to:
receive from an image-capture device coupled to a first vehicle, an image of a field of view of the first vehicle;
based on the image of the field of view of the first vehicle, determine a set of images, wherein a first image in the set of images depicts in a first color channel at least a portion of a second vehicle in the field of view of the first vehicle, and wherein a second image in the set of images depicts in a second color channel at least the portion of the second vehicle;
compare the first image and the second image to determine a state of the second vehicle; and
control the first vehicle based on the comparison.
10. The system of claim 9 , wherein the first color channel is a target color channel, and wherein the second color channel is an undesirable color channel.
11. The system of claim 10 , wherein the target color channel comprises a red or amber color channel, and wherein the undesirable color channel is a blue color channel.
12. The system of claim 9 , wherein the portion of the second vehicle comprises:
a turn signal indicator of the second vehicle.
13. The system of claim 12 , wherein comparing the first image and the second image to determine the state of the second vehicle comprises:
comparing the first image and the second image to determine if the turn signal indicator of the second vehicle is active.
14. The system of claim 13 , wherein controlling the first vehicle based on the comparison comprises:
based on determining that the turn signal indicator of the second vehicle is active, reducing a speed of the first vehicle.
15. The system of claim 13 , wherein controlling the first vehicle based on the comparison comprises:
based on determining that the turn signal indicator of the second vehicle is active, altering a course of navigation of the first vehicle.
16. The method of claim 13 , wherein controlling the first vehicle based on the comparison comprises:
based on determining that the turn signal indicator of the second vehicle is not active, maintaining a speed of the first vehicle.
17. A non-transitory computer-readable medium configured to store instructions, that when executed by a computing system comprising one or more processors, causes the computing system to perform operations comprising:
receiving from an image-capture device coupled to a first vehicle, an image of a field of view of the first vehicle;
based on the image of the field of view of the first vehicle, determining a set of images, wherein a first image in the set of images depicts in a first color channel at least a portion of a second vehicle in the field of view of the first vehicle, and wherein a second image in the set of images depicts in a second color channel at least the portion of the second vehicle;
comparing the first image and the second image to determine a state of the second vehicle; and
controlling the first vehicle based on the comparison.
18. The non-transitory computer-readable medium of claim 17 , wherein receiving from an image-capture device coupled to a first vehicle, an image of a field of view of the first vehicle comprises:
receiving the image of the field of view of the first vehicle captured using a short exposure.
19. The non-transitory computer-readable medium of claim 17 , wherein the first color channel is a target color channel, and wherein the second color channel is an undesirable color channel.
20. The non-transitory computer-readable medium of claim 19 , wherein the target color channel comprises a red or amber color channel, and wherein the undesirable color channel is a blue color channel.