Systems and methods for transmitting and receiving array camera image data
View Patent ↗Systems and methods for transmitting and receiving image data captured by an imager array including a plurality of focal planes are described. One embodiment of the invention includes capturing image data using a plurality of active focal planes in a camera module, where an image is formed on each active focal plane by a separate lens stack, generating lines of image data by interleaving the image data captured by the plurality of active focal planes, and transmitting the lines of image data and the additional data.
1. A method of transmitting image data, comprising:
capturing image data using a plurality of active cameras in an array of cameras;
generating at least one line of image data by interleaving the image data captured by the plurality of active cameras using a predetermined process, wherein the predetermined process is selected from a plurality of predetermined processes for interleaving captured image data;
generating additional data providing information for deinterleaving a plurality of images from the at least one line of image data, wherein the additional data includes information on which cameras in the array of cameras are active and providing image data and data indicating the predetermined process used to interleave the captured image data; and
transmitting the at least one line of image data and the additional data.
2. The method of claim 1 , wherein the additional data describes said array of cameras.
3. The method of claim 2 , wherein the additional data includes data selected from a group consisting of additional data describing:
a number of active cameras;
dimensions of the array of cameras;
a number of pixels in each dimension of at least one of said plurality of active cameras;
an integration time for pixels in at least one of said plurality of active cameras; and
a gain for pixels in at least one of said plurality of active cameras.
4. The method of claim 3 , wherein the additional data describing the gain for pixels in the at least one of said plurality of active cameras includes additional data describing an analog gain for pixels in said at least one of said plurality of active cameras and additional data describing the digital gain for pixels in said at least one of said plurality of active cameras.
5. The method of claim 1 , wherein:
each of the plurality of active cameras comprises an array of pixels including a plurality of rows of pixels that also form a plurality of columns of pixels; and
the predetermined process selected from the plurality of predetermined processes for interleaving captured image data comprises interleaving image data from a row selected from each of the active cameras.
6. The method of claim 5 , wherein the predetermined process selected from the plurality of predetermined processes for interleaving captured image data comprises using a modulo process, where the modulo process involves interleaving image data captured by pixels in the selected rows of the plurality of active cameras by interleaving a predetermined number of pixels from each of the selected rows.
7. The method of claim 1 , wherein the additional data describes at least one of the at least one line of image data.
8. The method of claim 7 , wherein the additional data includes data selected from the group consisting of additional data describing:
a time at which each of the plurality of active cameras started capturing the image data; and
row numbers of rows in each of the plurality of active cameras used to capture image data used to generate the at least one line of image data.
9. The method of claim 1 , further comprising:
packetizing the at least one line of image data and the additional data to produce at least one packet of data; and
wherein transmitting the at least one line of image data and the additional data further comprises transmitting the at least one packet of data.
10. The method of claim 9 , wherein:
the at least one packet of data comprises a packet header including at least a portion of the additional data and at least one of the at least one line of image data; and
the additional data included in the packet header describes the array of cameras.
11. The method of claim 9 , wherein the at least one packet of data further comprises a packet footer indicating the end of the transmission of the at least one line of the at least one line of image data.
12. The method of claim 9 , wherein:
the at least one packet of data comprises at least one line of the at least one line of image data and a line header associated with each of the at least one line of the at least one line of image data; and
each line header includes additional data describing a line of image data with which the line header is associated.
13. The method of claim 12 , wherein the line header further comprises additional data describing the array of cameras.
14. The method of claim 13 , further comprising:
pausing transmission during frame blanking intervals;
transmitting the at least one line of the at least one line of image data and the additional data between frame intervals; and
pausing during the transmission of the plurality of lines of image data and the additional data during line blanking intervals.
15. The method of claim 1 , further comprising continuously transmitting the at least one line of image data and the additional data until all of the data is transmitted.
16. The method of claim 1 , wherein each camera in the array of cameras has a different field of view.