System and method for removing specularity from an image
View Patent ↗In a first exemplary embodiment of the present invention, an automated, computerized method is provided for processing an image. According to a feature of the present invention, the method comprises the steps of providing an image file depicting an image, in a computer memory, processing the image to generate intrinsic images including a material image and an illumination image, and detecting and removing specularity as a function of the intrinsic images.
1. An automated, computerized method for processing an image, comprising the steps of:
providing an image file depicting an image, in a computer memory;
processing the image to generate intrinsic images including a material image and an illumination image, the processing of the image being carried out by executing a spatio-spectral operator/constraint/solver model for image segregation such that the material image comprises a representation of material expressed as a separate, multi-band representation for the material, independent of illumination, each band of the multi-band representation for the material corresponding to a segment of the electro-magnetic spectrum, and such that the illumination image comprises a representation of the illumination expressed as a separate, multi-band representation for the illumination, independent of the material, each band multi-band representation for the illumination corresponding to a segment of the electro-magnetic spectrum; and
detecting and removing specularity as a function of the intrinsic images, the detecting specularity including analyzing at least one of the material image and the illumination image.
2. The method of claim 1 wherein the step of removing specularity is executed in respect to the illumination image.
3. The method of claim 2 including the further step of combining the illumination image, after executing the step of detecting and removing specularity in the illumination image, with the material image.
4. The method of claim 2 including the further step of processing the illumination image to generate a diffuse illumination image.
5. The method of claim 4 including the further step of combining the diffuse illumination image with the material image.
6. The method of claim 2 wherein the step of removing specularity in the illumination image is executed by an in-painting technique.
7. The method of claim 1 wherein the step of detecting specularity is executed in respect to the material image and the illumination image, and the step of removing specularity is executed in respect to the illumination image.
8. A computer system which comprises:
a CPU; and
a memory storing an image file containing an image;
the CPU arranged and configured to execute a routine to process the image to generate intrinsic images including a material image and an illumination image, and detect and remove specularity as a function of the intrinsic images, the processing of the image being carried out by executing a spatio-spectral operator/constraint/solver model for image segregation such that the material image comprises a representation of material expressed as a separate, multi-band representation for the material, independent of illumination, each band of the multi-band representation for the material corresponding to a segment of the electro-magnetic spectrum, and such that the illumination image comprises a representation of the illumination expressed as a separate, multi-band representation for the illumination, independent of the material, each band multi-band representation for the illumination corresponding to a segment of the electro-magnetic spectrum, the detecting specularity including analyzing at least one of the material image and the illumination image.
9. The computer system of claim 8 wherein the step of removing specularity as a function of the intrinsic images is executed in respect to the illumination image.
10. The computer system of claim 9 wherein the routine includes the further step of combing combining the illumination image, after executing the step of detecting and removing specularity in the illumination image, with the material image.
11. A computer program product, disposed on a non-transitory computer readable media, the product including computer executable process steps operable to control a computer to: provide an image file depicting an image, in a computer memory, process the image to generate intrinsic images including a material image and an illumination image, and detect and remove specularity as a function of the intrinsic images, the processing of the image being carried out by executing a spatio-spectral operator/constraint/solver model for image segregation such that the material image comprises a representation of material expressed as a separate, multi-band representation for the material, independent of illumination, each band of the multi-band representation for the material corresponding to a segment of the electro-magnetic spectrum, and such that the illumination image comprises a representation of the illumination expressed as a separate, multi-band representation for the illumination, independent of the material, each band multi-band representation for the illumination corresponding to a segment of the electro-magnetic spectrum, the detecting specularity including analyzing at least one of the material image and the illumination image.
12. The computer program product of claim 11 wherein the process step of removing specularity as a function of the intrinsic images is executed in respect to the illumination image.
13. The computer program product of claim 12 including the further process step of combining the illumination image, after executing the step of detecting and removing specularity in the illumination image, with the material image.
14. The computer program product of claim 12 including the further process step of processing the illumination image to generate a diffuse illumination image.
15. The computer program product of claim 14 including the further process step of combining the diffuse illumination image with the material image.
16. The computer program product of claim 12 wherein the process step of removing specularity in the illumination image is executed by an in-painting technique.
17. The computer program product of claim 11 wherein the process step of detecting specularity as a function of the intrinsic images is executed in respect to the material image and the illumination image, and the process step of removing specularity as a function of the intrinsic images is executed in respect to the illumination image.
18. The method as recited in claim 1 wherein the detecting specularity includes determining if a region of the illumination image is a certain predetermined times brighter than surrounding regions of the illumination image and listing the region as not being specular if the region is not the certain predetermined times brighter than the surrounding regions.
19. The method as recited in claim 1 wherein the detecting specularity includes determining if a region of the illumination image is at an intensity that is greater than a certain predetermined percentile and listing the region as not being specular if the region is not greater than the certain predetermined percentile.
20. The method as recited in claim 1 wherein the detecting specularity includes comparing color properties of a region of the material image to color properties of surrounding regions of the material image and listing the region as not being specular if the color properties of the region are not similar to color properties of the surrounding regions.
21. The method as recited in claim 1 wherein the detecting specularity includes determining if a region of the material image is a brighter than surrounding regions of the material image and listing the region as not being specular if the region is not brighter than the surrounding regions.