Demosaicking system and method for color array based multi-spectral sensors
View Patent ↗A computer-implemented demosaicking system and method that can receive an image (or many images that represent individual frames of a video) at a demosaicking processor from a multi-spectral band camera. The image can include four or more band images that each correspond to an unique spectral band obtained by the multi-spectral band camera. A clustering module can perform spectral clustering of the four or more band images to identify multiple clusters. For each of the plurality of clusters, a weights module can determine a cluster weight by computing correlations between each of the unique spectral bands in each cluster. A super-resolution module can perform super-resolution for each of the unique spectral bands by utilizing the cluster weights from the weights module. The super-resolution module can iteratively apply the super-resolution for each of the unique spectral bands and a value for each unique spectral band can be updated after each iteration.
1. A computer-implemented demosaicking method, comprising the steps of:
receiving an image at a demosaicking processor, wherein the image comprises four or more band images that each correspond to an unique spectral band obtained by a multi-spectral band camera;
performing spectral clustering of the four or more band images to identify a plurality of clusters with a clustering module, wherein the clustering module is implemented in a computer system that comprises instructions stored in a machine-readable medium and a processor that executes the instructions;
for each of the plurality of clusters, determining a cluster weight by computing correlations between each of the unique spectral bands in each cluster with a weights module, wherein the weights module is implemented in a computer system that comprises instructions stored in a machine-readable medium and a processor that executes the instructions; and
performing super-resolution for each of the unique spectral bands utilizing the cluster weights from the weights module with a super-resolution module, wherein super-resolution is applied iteratively for each of the unique spectral bands and a value for each unique spectral band is updated after each iteration, and wherein the super-resolution module is implemented in a computer system that comprises instructions stored in a machine-readable medium and a processor that executes the instructions.
2. The method of claim 1 , further comprising the step of receiving a plurality of images at the demosaicking processor, wherein each of the plurality of images correspond to a video frame obtained by the multi-spectral band camera.
3. The method of claim 2 , wherein the demosaicking method is applied to each video frame wherein the video frame comprises four or more band images that each correspond to an unique spectral band.
4. A demosaicking system, comprising:
a demosaicking processor configured to receive an image, wherein the image comprises four or more band images that each correspond to an unique spectral band;
a clustering module configured to perform spectral clustering of the four or more band images to identify a plurality of clusters, wherein the clustering module is implemented in a computer system that comprises instructions stored in a machine-readable medium and the demosaicking processor executes the instructions;
a weights module configured to determine a cluster weight by computing correlations between each of the unique spectral bands in each cluster with a weights module for each of the plurality of clusters, wherein the weights module is implemented in a computer system that comprises instructions stored in a machine-readable medium and the demosaicking processor executes the instructions; and
a super-resolution module configured to perform super-resolution for each of the unique spectral bands utilizing the cluster weights from the weights module, and wherein the super-resolution module is configured to apply super-resolution iteratively for each of the unique spectral bands and a value for each unique spectral band is updated after each iteration, and wherein the super-resolution module is implemented in a computer system that comprises instructions stored in a machine-readable medium and the demosaicking processor executes the instructions.
5. The demosaicking system of claim 4 , further comprising a multi-spectral band camera configured to obtain the image and send the image to the demosaicking processor.
6. The demosaicking system of claim 5 , wherein the multi-spectral band camera is further configured to obtain video, wherein the video comprises a plurality of frames, and wherein each frame of the video corresponds to an image that can be sent to the demosaicking processor.