Method for processing a pixels matrix in an image processing chain and corresponding electronic device
The method for processing a matrix of pixels each containing an original red, green, blue, or infrared component, comprises at least one interpolation of an interpolated component different from the original component of a pixel of interest from the components of a group of pixels neighboring the pixel of interest. The interpolation comprises: a calculation of the sum of the components of reference pixels weighted by a respectively assigned weight, the reference pixels being pixels of the group having the same original component as the interpolated component, an evaluation of the spatial uniformity of an environment, within the group of each reference pixel, a calculation of the weights assigned to the reference pixels at values which are normalized and proportional to the respective spatial uniformity.
1. A method for processing a pixel matrix in an image processing chain circuit couplable to an imager circuit, each pixel comprising an original component of one of an original red, an original green, an original blue, or an original infrared component, the method comprising:
interpolating an interpolated component different from the original component of a pixel of interest from components of a group of pixels neighboring the pixel of interest, the interpolating comprising:
calculating a sum of the components of reference pixels weighted by an assigned weight, the reference pixels being pixels of the group of pixels having the same original component as the interpolated component,
evaluating a spatial uniformity of each reference pixel in an environment within the group of pixels, wherein the evaluating the spatial uniformity comprises:
calculating a gradient of components of pixels having an original green component adjacent to the reference pixels,
identifying an orientation of spatial variation from a comparison of the components of the reference pixels, and
selecting pixels with an original green component as used for the calculating the gradient of components of pixels based on the orientation of the spatial variation as identified; and
calculating assigned weights of the reference pixels with values normalized and proportional to the spatial uniformity.
2. The method of claim 1 , wherein calculating the gradient of components of pixels comprises measuring an absolute difference between a greatest value and a smallest value of components of pixels having an original green component adjacent to the reference pixels.
3. The method of claim 1 , wherein the group of pixels comprises a set of pixels belonging to a square of pixels having an odd number of pixels on each side, the pixel of interest located at a center of the square of pixels.
4. The method of claim 1 , wherein the pixel matrix is delivered to the image processing chain circuit by the imager circuit in accordance with an elementary pattern of a red-green-blue-infrared (RGB-IR) 4×4 type having two red pixels, eight green pixels, two blue pixels, and four infrared pixels, each red pixel, blue pixel, and infrared pixel arranged such that it is adjacent only to green pixels.
5. The method of claim 1 , wherein the interpolating is implemented in a processing of depollution of an infrared noise from the pixel matrix, the interpolated component being an infrared component, the pixel of interest having an original red component, an original green component, and an original blue component.
6. The method of claim 1 , wherein the interpolating is implemented in a processing of reconstruction of a visible component instead of an infrared component, the interpolated component being a red component and a blue component, the pixel of interest having an original infrared component.
7. The method of claim 1 , wherein the interpolating is implemented in a processing for formatting the pixel matrix into a Bayer matrix, the interpolated component being one of a red component or a blue component, the pixel of interest having one of an original blue component or an original red component.
8. An electronic device, comprising:
an image processing chain circuit couplable to an imager circuit, the image processing chain circuit configured to:
process a pixel matrix, each pixel comprising an original component of one of an original red, an original green, an original blue, or an original infrared component; and
determine an interpolated component different from the original component of a pixel of interest from components of a group of pixels neighboring the pixel of interest, the image processing chain circuit, to determine the interpolated component, is configured to:
calculate a sum of the components of reference pixels weighted by an assigned weight, the reference pixels being pixels of the group of pixels having the same original component as the interpolated component,
evaluate a spatial uniformity of each reference pixel in an environment within the group of pixels, wherein the evaluating the spatial uniformity comprises:
calculating a gradient of components of pixels having an original green component adjacent to the reference pixels,
identifying an orientation of spatial variation from a comparison of the components of the reference pixels, and
selecting pixels with an original green component as used for the calculating the gradient of components of pixels based on the orientation of the spatial variation as identified, and
calculate assigned weights of the reference pixels with values normalized and proportional to the spatial uniformity.
9. The electronic device of claim 8 , wherein the image processing chain circuit, to calculate the gradient of components of pixels, is configured to measure an absolute difference between a greatest value and a smallest value of components of pixels having an original green component adjacent to the reference pixels.
10. The electronic device of claim 8 , wherein the group of pixels comprises a set of pixels belonging to a square of pixels having an odd number of pixels on each side, the pixel of interest located at a center of the square of pixels.
11. The electronic device of claim 8 , wherein the image processing chain circuit is configured to process a pixel matrix in accordance with an elementary pattern of a red-green-blue-infrared (RGB-IR) 4×4 type having two red pixels, eight green pixels, two blue pixels, and four infrared pixels, each red pixel, blue pixel, and infrared pixel arranged such that it is adjacent only to green pixels.
12. The electronic device of claim 8 , wherein the image processing chain circuit comprises a processor for depolluting an infrared noise from the pixel matrix, the interpolated component being an infrared component, the pixel of interest having an original red component, an original green component, and an original blue component.
13. The electronic device of claim 8 , wherein the image processing chain circuit comprises a processor for reconstructing a visible component instead of an infrared component, the interpolated component being a red component and a blue component, the pixel of interest having an original infrared component.
14. The electronic device of claim 8 , wherein the image processing chain circuit comprises a processor for formatting the pixel matrix into a Bayer matrix, the interpolated component being one of a red component or a blue component, the pixel of interest having one of an original blue component or an original red component.
15. An image processing chain circuit configured to:
process a pixel matrix, each pixel comprising an original component of one of an original red, an original green, an original blue, or an original infrared component; and
interpolate an interpolated component different from the original component of a pixel of interest from components of a group of pixels neighboring the pixel of interest, wherein the image processing chain circuit, to determine the interpolated component, is configured to:
calculate a sum of the components of reference pixels weighted by an assigned weight, the reference pixels being pixels of the group of pixels having the same original component as the interpolated component,
evaluate a spatial uniformity of each reference pixel in an environment within the group of pixels, wherein the evaluating the spatial uniformity comprises:
calculating a gradient of components of pixels having an original green component adjacent to the reference pixels,
identifying an orientation of spatial variation from a comparison of the components of the reference pixels; and
selecting pixels with an original green component as used for the calculating the gradient of components of pixels based on the orientation of the spatial variation as identified, and
calculate assigned weights of the reference pixels with values normalized and proportional to the spatial uniformity.
16. The image processing chain circuit of claim 15 , wherein the image processing chain circuit is configured to process a pixel matrix in accordance with an elementary pattern of a red-green-blue-infrared (RGB-IR) 4×4 type having two red pixels, eight green pixels, two blue pixels, and four infrared pixels, each red pixel, blue pixel, and infrared pixel arranged such that it is adjacent only to green pixels.
17. The image processing chain circuit of claim 15 , wherein the image processing chain circuit, to calculate the gradient of components of pixels, is configured to measure an absolute difference between a greatest value and a smallest value of components of pixels having an original green component adjacent to the reference pixels.
18. The image processing chain circuit of claim 15 , wherein the group of pixels comprises a set of pixels belonging to a square of pixels having an odd number of pixels on each side, the pixel of interest located at a center of the square of pixels.
19. The image processing chain circuit of claim 15 , wherein the interpolating is implemented in a processing of depollution of an infrared noise from the pixel matrix, the interpolated component being an infrared component, the pixel of interest having an original red component, an original green component, and an original blue component.
20. The image processing chain circuit of claim 15 , wherein the interpolating is implemented in a processing of reconstruction of a visible component instead of an infrared component, the interpolated component being a red component and a blue component, the pixel of interest having an original infrared component.