Methods and apparatus for scalable processing
Methods and apparatus for scalable processing. Conventional image sensors read image data in a sequential row-by-row manner. However, image data may be more efficiently processed at different scales. For example, computer vision processing at a first scale may be used to determine whether subsequent processing with more resolution is helpful. Various embodiments of the present disclosure readout image data according to different scales; scaled readouts may be processed using scale specific computer vision algorithms to determine next steps. In addition to scaled readouts of image data, some variants may also provide commonly used data and/or implement pre-processing steps.
1 . A camera module, comprising:
an array of photosites arranged by rows and columns; and
output logic configured to provide:
a first scaled readout of the array of the photosites for a first exposure and a first integral image of the first scaled readout, and
a second scaled readout of the array of the photosites for the first exposure and a second integral image of the first scaled readout, where the first scaled readout and the second scaled readout comprise destructive photosite discharges.
2 . The camera module of claim 1 , where the first scaled readout is provided before the second scaled readout and the second scaled readout includes the first scaled readout.
3 . The camera module of claim 2 , where the first integral image is provided before the second integral image and the second integral image includes the first integral image.
4 . The camera module of claim 3 , where the first integral image is provided before the second integral image and the second integral image does not include the first integral image.
5 . The camera module of claim 4 , where the output logic comprises a memory buffer.
6 . A method comprising:
capturing light information via an array of photosites in a single exposure;
reading the array to obtain a first scaled readout using a first destructive photosite discharges of a first set of photosites of the array of photosites;
calculating a first scaled integral image from the first scaled readout;
reading the array to obtain a second scaled readout using a second destructive photosite discharges of a second set of photosites of the array of photosites; and
calculating a second scaled integral image from the second scaled readout.
7 . The method of claim 6 , where the first scaled integral image is characterized by a reduced precision.
8 . The method of claim 7 , where the reduced precision is 16-bits.
9 . The method of claim 7 , where the first scaled integral image is limited to a maximum patch size.
10 . The method of claim 6 , where the first scaled readout is a subset of the second scaled readout.
11 . The method of claim 10 , where the first scaled integral image and the second scaled integral image are characterized by a reduced precision.
12 . A camera module, comprising:
an array of photosites arranged by rows and columns; and
output logic configured to provide a first scaled readout of the array of the photosites for a first exposure and a first integral image of the first scaled readout, where the first scaled readout is characterized by a bit-reversed addressing.
13 . The camera module of claim 12 , where the first integral image is characterized by a reduced precision.
14 . The camera module of claim 12 , where the output logic comprises a bus.
15 . The camera module of claim 12 , where the output logic comprises a memory buffer.
16 . The camera module of claim 12 , where the first integral image is characterized by the bit-reversed addressing.
17 . The camera module of claim 13 , where:
the first scaled readout of the array of the photosites comprises a readout of a first subset of photosites of the array of the photosites based on a scale parameter, and
the reduced precision of the first integral image corresponds to the scale parameter.
18 . The camera module of claim 1 , where:
the first scaled readout of the array of the photosites is stored in a first readout memory buffer,
the second scaled readout of the array of photosites is stored in a second readout memory buffer, and
the output logic is configured to output the first readout memory buffer prior to completing storing the second scaled readout in the second readout memory buffer.
19 . The camera module of claim 1 , where:
the first scaled readout of the array of the photosites is stored in a first readout memory buffer and a second readout memory buffer at a set of addresses, and
the second scaled readout of the array of photosites is stored in the second readout memory buffer skipping the set of addresses.
20 . The method of claim 6 , where reading the array to obtain the second scaled readout comprises skipping first photosites of the array of photosites previously read to obtain a first scaled readout.