Reducing camera throughput to downstream systems using an intermediary device
Reducing camera throughput to downstream systems using an intermediary device, including: receiving, by a device and from a camera via a first data link between the device and the camera, a frame; selecting, by the device, an area of focus for the frame; generating, by the device from the frame, a downsampled frame and a cropped frame, wherein the cropped frame is based on the area of focus; and providing, by the device to a computing system of an autonomous vehicle via a second data link between the device and the computing system, the downsampled frame and the cropped frame instead of the frame, wherein the second data link has a lower bandwidth than the first data link.
1. A method comprising:
receiving, by a device and from a camera via a first data link between the device and the camera, a frame;
selecting, by the device, an area of focus for the frame;
generating, by the device from the frame, a downsampled frame and a cropped frame, wherein the cropped frame is based on the area of focus; and
providing, by the device to a computing system of an autonomous vehicle via a second data link between the device and the computing system, the downsampled frame and the cropped frame instead of the frame, wherein the second data link has a lower bandwidth than the first data link.
2. The method of claim 1 , wherein providing the downsampled frame and the cropped frame comprises providing the downsampled frame and the cropped frame interleaved within a same stream.
3. The method of claim 1 , wherein providing the downsampled frame and the cropped frame comprises:
providing, via a first data link, the downsampled frame in a stream of downsampled frames; and
providing, via a second data link, the cropped frame in a stream of cropped frames.
4. The method of claim 1 , further comprising:
selecting, by the device, another area of focus for the frame;
generating, by the device from the frame, another cropped frame based on the other area of focus; and
wherein providing the downsampled frame and the cropped frame further comprises providing the other cropped frame.
5. The method of claim 1 , further comprising:
receiving an indication of one or more transformations to be applied to the frame; and
wherein generating the downsampled frame and the cropped frame is performed based on the indication.
6. The method of claim 1 , wherein the camera comprises a camera of an autonomous vehicle.
7. The method of claim 6 , wherein the device is one of a plurality of devices and the camera is one of a plurality of cameras of the autonomous vehicle, and wherein each device of the plurality of devices is coupled to a corresponding camera of the plurality of cameras.
8. A device configured to perform steps comprising:
receiving, by a device and from a camera via a first data link between the device and the camera, a frame;
selecting, by the device, an area of focus for the frame;
generating, by the device from the frame, a downsampled frame and a cropped frame, wherein the cropped frame is based on the area of focus; and
providing, by the device to a computing system of an autonomous vehicle via a second data link between the device and the computing system, the downsampled frame and the cropped frame instead of the frame, wherein the second data link has a lower bandwidth than the first data link.
9. The device of claim 8 , wherein providing the downsampled frame and the cropped frame comprises providing the downsampled frame and the cropped frame interleaved within a same stream.
10. The device of claim 8 , wherein providing the downsampled frame and the cropped frame comprises:
providing, via a first data link, the downsampled frame in a stream of downsampled frames; and
providing, via a second data link, the cropped frame in a stream of cropped frames.
11. The device of claim 8 , wherein the steps further comprise:
selecting, by the device, another area of focus for the frame;
generating, by the device from the frame, another cropped frame based on the other area of focus; and
wherein providing the downsampled frame and the cropped frame further comprises providing the other cropped frame.
12. The device of claim 8 , wherein the steps further comprise:
receiving an indication of one or more transformations to be applied to the frame; and
wherein generating the downsampled frame and the cropped frame is performed based on the indication.
13. The device of claim 12 , wherein the device is one of a plurality of devices and the camera is one of a plurality of cameras of the autonomous vehicle, and wherein each device of the plurality of devices is coupled to a corresponding camera of the plurality of cameras.
14. The device of claim 8 , wherein the camera comprises a camera of an autonomous vehicle.
15. An autonomous vehicle, comprising:
an automation computing system;
a plurality of camera sensors;
a plurality of intermediary devices each linking a corresponding camera of the plurality of cameras to the automation computing system, each of the intermediary devices configured to perform steps comprising:
receiving, by the intermediary device and from the corresponding camera via a first data link between the intermediary device and the corresponding camera, a frame;
selecting, by the intermediary device, an area of focus for the frame;
generating, by the intermediary device from the frame, a downsampled frame and a cropped frame, wherein the cropped frame is based on the area of focus; and
providing, by the intermediary device to the automation computing system via a second data link between the device and the automation computing system, the downsampled frame and the cropped frame instead of the frame, wherein the second data link has a lower bandwidth than the first data link.
16. The autonomous vehicle of claim 15 , wherein providing the downsampled frame and the cropped frame comprises providing the downsampled frame and the cropped frame interleaved within a same stream.
17. The autonomous vehicle of claim 15 , wherein providing the downsampled frame and the cropped frame comprises:
providing, via a first data link, the downsampled frame in a stream of downsampled frames; and
providing, via a second data link, the cropped frame in a stream of cropped frames.
18. The autonomous vehicle of claim 15 , wherein the steps further comprise:
selecting, by the intermediary device, another area of focus for the frame;
generating, by the intermediary device from the frame, another cropped frame based on the other area of focus; and
wherein providing the downsampled frame and the cropped frame further comprises providing the other cropped frame.
19. The autonomous vehicle of claim 15 , wherein the steps further comprise:
receiving an indication of one or more transformations to be applied to the frame; and
wherein generating the downsampled frame and the cropped frame is performed based on the indication.
20. The autonomous vehicle of claim 15 , wherein the plurality of cameras comprises a plurality of pairs of cameras in stereoscopic configuration.