Methods of content-based image identification
View Patent ↗A method of identifying one or more image features of an image based on content of the image according to one example embodiment includes receiving an image, correcting a distortion and a tone of the image, segmenting the corrected image and extracting the one or more image features, generating an input image descriptor based on the one or more extracted image features, matching the input image descriptor with a reference image descriptor, and performing an action based on the matched reference image descriptor.
1. A method of identifying one or more image features of an image based on content of the image, comprising:
receiving an image at a processor of a mobile device;
correcting a distortion and a tone of the image with the processor;
segmenting the corrected image and extracting the one or more image features;
generating an input image descriptor based on the one or more extracted image features, wherein the input image descriptor is a histogram of a count of gradient magnitudes at different angles;
matching the input image descriptor with a reference image descriptor; and
performing an action based on the matched reference image descriptor.
2. The method of claim 1 , wherein the received image is captured by the mobile device.
3. The method of claim 1 , wherein correcting the tone of the image includes performing local analysis to determine a document background of the image and contrast values in the image.
4. The method of claim 3 , wherein correcting the tone of the image further includes applying varying tone correction in different areas of the image.
5. The method of claim 1 , wherein correcting the tone of the image includes remapping areas in the image to a same constant value.
6. The method of claim 1 , wherein segmenting the corrected image includes segmenting the image into one of a foreground and a background class.
7. The method of claim 6 , further comprising analyzing the foreground class to define at least one connected component.
8. The method of claim 7 , further comprising classifying the at least one connected component into one of a text and a non-text component.
9. The method of claim 7 , further comprising classifying the at least one connected component into one of an edge and a non-edge image content.
10. The method of claim 1 , wherein the action performed is retrieving stored information corresponding to the input image descriptor.
11. A method of identifying one or more image features of an image captured by a mobile device based on content of the image, comprising:
with a processor of the mobile device, segmenting the image into foreground and background and extracting the one or more image features from the foreground of the image;
defining connected components based on pixel values of the foreground of the image;
generating an input image descriptor based on the one or more extracted image features, wherein the input image descriptor is a histogram of percentage area of each connected component relative to areas corresponding to a bounding box of the connected component;
selecting a matching reference image descriptor for the input image descriptor from a plurality of reference image descriptors, the matching reference image descriptor having a highest matching score with the input image descriptor of the plurality of reference image descriptors; and
performing a predetermined action based on the matching reference image descriptor.
12. The method of claim 11 , wherein the action performed includes retrieving information associated with the extracted image features.
13. The method of claim 11 , wherein the action performed includes routing the image to a designated path.
14. The method of claim 1 , wherein the action performed includes retrieving information associated with the extracted image features.
15. The method of claim 1 , wherein the action performed includes producing a printed output of the image.