Images for perception modules of autonomous vehicles
Disclosed are devices, systems and methods for processing an image. In one aspect a method includes receiving an image from a sensor array including an x-y array of pixels, each pixel in the x-y array of pixels having a value selected from one of three primary colors, based on a corresponding x-y value in a mask pattern. The method may further include generating a preprocessed image by performing preprocessing on the image. The method may further include performing perception on the preprocessed image to determine one or more outlines of physical objects.
1. A method for processing an image, comprising:
receiving an image including an x-y array of pixels from a sensor array, each pixel in the x-y array of pixels having a value selected from one of three primary colors, based on a corresponding x-y value in a mask pattern;
generating a preprocessed image by performing preprocessing on the image, wherein the preprocessing excludes scaling one or more pixels' R, G, or B value for white balancing; and
performing computerized perception on the preprocessed image to determine one or more outlines of physical objects.
2. The method of claim 1 , wherein the mask pattern is a Bayer pattern.
3. The method of claim 2 , wherein the Bayer pattern is a red-green-green-blue pattern assigned to a 2-pixel by 2-pixel array repeated across the raw image.
4. The method of claim 1 , wherein the pattern includes a greater number of green pixel values than both red and blue.
5. The method of claim 1 , wherein the pattern is selected such that a value of every other pixel along a row in the reduced image corresponds to green value of the raw image.
6. The method of claim 1 , wherein the pattern is selected such that a value of every other pixel along a column in the reduced image corresponds to green value of the raw image.
7. The method of claim 1 , wherein, each x-y value in the pattern is from one of three possible values.
8. The method of claim 1 , wherein the image is generated using one or more color-selective filters.
9. The method of claim 1 , wherein the preprocessing is performed on the image from the sensor array without human perception image enhancement.
10. The method of claim 9 , wherein the human perception image enhancement includes one or more of de-mosaicing, white balancing, and noise reduction.
11. The method of claim 1 , wherein the preprocessing excludes reconstruction of a full color image from incomplete color samples output from the sensor array overlaid with a color filter array for de-mosaicing.
12. The method of claim 1 , wherein the preprocessing excludes noise reduction, wherein noise reduction includes reduction of salt and pepper noise, wherein a noisy pixel bears little relation to the color of surrounding pixels, or reduction of Gaussian noise.
13. A computer apparatus comprising:
a processor, wherein the processor is configured to at least:
receive an image including an x-y array of pixels from a sensor array, each pixel in the x-y array of pixels having a value selected from one of three primary colors, based on a corresponding x-y value in a mask pattern;
generate a preprocessed image by performing preprocessing on the image, wherein the preprocessing excludes scaling one or more pixels' R, G, or B value for white balancing; and
perform perception of the preprocessed image to determine one or more outlines of physical objects.
14. The apparatus of claim 13 , wherein the mask pattern is a Bayer pattern.
15. The apparatus of claim 14 , wherein the Bayer pattern is a red-green-green-blue pattern assigned to a 2-pixel by 2-pixel array repeated across the raw image.
16. The apparatus of claim 13 , wherein the pattern includes a greater number of green pixel values than both red and blue.
17. The apparatus of claim 13 , wherein the processor selects the pattern such that a value of every other pixel along a row in the reduced image corresponds to green value of the raw image.
18. A computer readable program medium having code stored thereon, the code, when executed by a processor, causing the processor to implement a method comprising:
receiving an image including an x-y array of pixels from a sensor array, each pixel in the x-y array of pixels having a value selected from one of three primary colors, based on a corresponding x-y value in a mask pattern;
generating a preprocessed image by performing preprocessing on the image, wherein the preprocessing excludes scaling one or more pixels' R, G, or B value for white balancing; and
performing computerized perception on the preprocessed image to determine one or more outlines of physical objects.
19. The computer readable program medium of claim 18 , wherein the preprocessing is performed on the image from the sensor array without human perception image enhancement.