Image analysis system and method using image recognition and text search
View Patent ↗Provided herein are systems and method for obtaining contextual information of an image published on a digital medium. The methods and systems disclosed herein generally identify and analyze the image to obtain image descriptors corresponding to the image. The methods also identify and analyze text published proximate to the image to obtain textual descriptors, which function to describe, identify, index, or name the image or content within the image. The textual descriptors are then matched to the image descriptors to provide contextual information of the published image.
1. A method of obtaining contextual information for an image published on a digital medium, the method comprising:
obtaining, by an image recognition engine, a set of image tags from an image published on a digital medium, wherein each of the image tags is an object identified in the image;
obtaining, by a text recognition engine, a set of textual tags from text published proximate to the image, wherein each of the textual tags is a subject identified in the text; and
matching, by a matching engine, the set of textual tags with the set of image tags based on object-type matching to obtain contextual information for objects identified in the image.
2. The method of claim 1 , wherein the method further comprises identifying the image published on a digital medium.
3. The method of claim 1 , wherein the image is analyzed with an image recognition engine.
4. The method of claim 1 , wherein the method further comprises identifying the text published proximate to the image.
5. The method of claim 1 , wherein the textual tag functions to describe, identify, index, or name the image or content within the image.
6. A method of obtaining contextual information for an image published on a digital medium, the method comprising:
(a) identifying, by an image recognition engine, an image published on a digital medium;
(b) analyzing the image with an image recognition engine to obtain a set of image tags corresponding to the image, wherein each of the image tags is an object identified in the image;
(c) identifying, by a text recognition engine, text published proximate to the image on the digital medium;
(d) analyzing the text from step (c) to obtain a set of textual tags, wherein each of the textual tags is a subject identified in the text; and
(e) matching, by a matching engine, the set of textual tags with the set of image tags to obtain contextual information of the image, wherein the matched textual tags provide additional specificity for identifying objects in the image.
7. The method of claim 6 , wherein the textual tag is a proper noun.
8. The method of claim 7 , wherein the image tag is a common noun.
9. The method of claim 8 , further comprising:
(f) maintaining a database of proper nouns and corresponding common nouns.
10. The method of claim 9 , further comprising:
(g) conducting a match query against the database to identify matching image tags and textual tags.
11. The method of claim 6 , wherein the image recognition engine creates at least one tag for the image, and wherein the tag includes the image tag and positional information corresponding to the image tag.
12. The method of claim 11 , wherein the positional information includes coordinates selected from the group consisting of: a real position coordinate, a boundary area coordinate, a coordinate that outlines content within the image, and any combination thereof.
13. The method of claim 6 , wherein step (d) further comprises employing a language-independent proximity pattern matching algorithm.
14. The method of claim 6 , wherein the textual tag functions to describe, identify, index, or name the image or content within the image.
15. A system for obtaining contextual information of an image published on a digital medium, the system comprising:
an identification module configured to identify an image published on a digital medium and text published proximate to the image; and
a processor that receives and analyzes the image and text to obtain contextual tags by matching a set of image tags and a set of textual tags corresponding to the image, wherein each of the image tags is an object identified in the image, and wherein the each of textual tags is a subject identified in the text.
16. The system of claim 15 , wherein the textual tag functions to describe, identify, index, or name the image or content within the image.
17. A method of contextual advertising, the method comprising:
(a) identifying, by an image recognition engine, an image published on a digital medium;
(b) analyzing the image with an image recognition engine to obtain a set of image tags corresponding to the image, wherein each of the image tags is an object identified in the image;
(c) identifying, by a text recognition engine, text published proximate to the image on the digital medium;
(d) analyzing the text from step (c) to obtain a set of textual tags, wherein each of the textual tags is a subject identified in the text;
(e) matching, by a matching engine, the set of textual tags with the set of image tags, wherein the linked textual tags and image tags serve as contextual tags for the image; and
(f) providing an advertising creative based on the contextual tags.
18. The method of claim 17 , wherein the tag includes positional information corresponding to the image tag.
19. The method of claim 18 , wherein the positional information includes coordinates selected from the group consisting of: a real position coordinate, a boundary area coordinate, a coordinate that outlines content within the image, and any combination thereof.
20. The method of claim 17 , wherein step (d) further comprises employing a language-independent proximity pattern matching algorithm.
21. The method of claim 17 , wherein the textual tag functions to describe, identify, index, or name the image or content within the image.
22. A non-transitory computer-readable storage medium, comprising:
instructions executable by at least one processing device that, when executed, cause the processing device to
(a) identify, by an image recognition engine, an image published on a digital medium;
(b) analyze the image with an image recognition engine to obtain a set of image tags corresponding to the image, wherein each of the image tags is an object identified in the image;
(c) identify, by a text recognition engine, text published proximate to the image on the digital medium;
(d) analyze the text to obtain a set of textual tags that function to describe, identify, index, or name the image or content within the image, wherein each of the textual tags is a subject identified in the text; and
(e) match, by a matching engine, the set of textual tags with the set of image tags.