Reducing camera sensor throughput via an intermediary device
Throughput reduction in autonomous vehicle camera sensors, including: generating, by a camera sensor, a frame; selecting an area of focus for the frame; and generating, by the camera sensor from the frame, a downsampled frame and a cropped frame, wherein the cropped frame is based on the area of focus.
1. A method for reducing camera sensor throughput via an intermediary device, comprising:
receiving, by a device and from a camera sensor, a frame;
selecting, by the device, an area of focus for the frame;
generating, by the device from the frame, a downsampled frame and a cropped frame, wherein the cropped frame is based on the area of focus; and
providing, by the device, the downsampled frame and the cropped frame instead of the frame by:
providing, via a first data link, the downsampled frame in a stream of downsampled frames; and
providing, via a second data link, the cropped frame in a stream of cropped frames.
2. The method of claim 1 , wherein providing the downsampled frame and the cropped frame comprises providing the downsampled frame and the cropped frame interleaved within a same stream.
3. The method of claim 1 , further comprising:
selecting, by the device, another area of focus for the frame;
generating, by the device from the frame, another cropped frame based on the other area of focus; and
wherein providing the downsampled frame and the cropped frame further comprises providing the other cropped frame.
4. The method of claim 3 , wherein the cropped frame and the other cropped frame are provided interleaved via a same stream.
5. The method of claim 3 , wherein the cropped frame and the other cropped frame are provided via separate streams using separate data links.
6. The method of claim 1 , wherein the device comprises an intermediary between the camera sensor and a recipient of the downsampled frame and the cropped frame.
7. The method of claim 1 , further comprising:
receiving an indication of one or more transformations to be applied to the frame; and
wherein generating the downsampled frame and the cropped frame is performed based on the indication.
8. The method of claim 1 , wherein the camera sensor comprises a camera sensor of an autonomous vehicle.
9. A device for reducing camera sensor throughput via an intermediary device, the device configured to perform steps comprising:
receiving, by the device and from a camera sensor, a frame;
selecting, by the device, an area of focus for the frame;
generating, by the device from the frame, a downsampled frame and a cropped frame, wherein the cropped frame is based on the area of focus; and
providing, by the device, the downsampled frame and the cropped frame instead of the frame by:
providing, via a first data link, the downsampled frame in a stream of downsampled frames; and
providing, via a second data link, the cropped frame in a stream of cropped frames.
10. The device of claim 9 , wherein providing the downsampled frame and the cropped frame comprises providing the downsampled frame and the cropped frame interleaved within a same stream.
11. The device of claim 9 , further comprising:
selecting, by the device, another area of focus for the frame;
generating, by the device from the frame, another cropped frame based on the other area of focus; and
wherein providing the downsampled frame and the cropped frame further comprises providing the other cropped frame.
12. The device of claim 11 , wherein the cropped frame and the other cropped frame are provided interleaved via a same stream.
13. The device of claim 11 , wherein the cropped frame and the other cropped frame are provided via separate streams using separate data links.
14. The device of claim 9 , wherein the device comprises an intermediary between the camera sensor and a recipient of the downsampled frame and the cropped frame.
15. The device of claim 9 , wherein the camera sensor comprises a camera sensor of an autonomous vehicle.
16. An autonomous vehicle for reducing camera sensor throughput via an intermediary device, comprising:
an automation computing system;
a plurality of camera sensors;
a plurality of intermediary devices each linking a corresponding camera sensor of the plurality of camera sensors to the automation computing system, each of the intermediary devices configured to perform steps comprising:
receiving, from the corresponding camera sensor, a frame;
selecting an area of focus for the frame;
generating, from the frame, a downsampled frame and a cropped frame, wherein the cropped frame is based on the area of focus; and
providing, to the automation computing system, the downsampled frame and the cropped frame instead of the frame by:
providing, via a first data link, the downsampled frame in a stream of downsampled frames; and
providing, via a second data link, the cropped frame in a stream of cropped frames.
17. The autonomous vehicle of claim 16 , wherein providing the downsampled frame and the cropped frame comprises providing the downsampled frame and the cropped frame interleaved within a same stream.
18. The autonomous vehicle of claim 16 , wherein the steps further comprise:
selecting another area of focus for the frame;
generating, from the frame, another cropped frame based on the other area of focus; and
wherein providing the downsampled frame and the cropped frame further comprises providing the other cropped frame.
19. The autonomous vehicle of claim 18 , wherein the cropped frame and the other cropped frame are provided interleaved via a same stream.
20. The autonomous vehicle of claim 18 , wherein the cropped frame and the other cropped frame are provided via separate streams using separate data links.