Named entity recognition
Embodiments include methods, systems and computer program products for performing named entity recognition. Aspects include obtaining a text having a plurality of words and comparing each of the plurality of words to a dictionary. Aspects also include creating, based on the comparison, an annotation for at least one of the plurality of words that the least one of the plurality of words refers to a named entity. Aspects further include parsing the text to identify a part of speech for each of the plurality of words and removing the annotations from each of the at least one of the plurality of words that has a part of speech that is not one or a noun and a noun supporting adjective.
1. A method for performing named entity recognition, the method comprising:
obtaining a text having a plurality of words;
comparing each of the plurality of words to a dictionary, wherein comparing each of the plurality of words to a dictionary includes performing natural language processing on a definition in the dictionary to determine whether each of the plurality of words refers to a named entity;
creating, based on the comparison, an annotation for at least one of the plurality of words that refer to the named entity, wherein the annotation includes the definition obtained from the dictionary;
parsing only a portion of the text to identify a part of speech, wherein the portion of the text consists of the annotated words; and
removing the annotations from each of the at least one of the plurality of words that has a part of speech that is not one of a noun and a noun supporting adjective.
2. The method of claim 1 , wherein the named entity consists of one of a place and a person.
3. The method of claim 1 , further comprising storing the text with a metadata file that includes the remaining annotations.
4. The method of claim 1 , wherein parsing the text to identify the part of speech for each of the plurality of words includes performing a part of speech tagging algorithm.
5. The method of claim 1 , wherein obtaining the text includes performing optical character recognition on a plurality of images.
6. A system comprising:
a memory having computer readable instructions; and
one or more processors for executing the computer readable instructions, the computer readable instructions controlling the one or more processors to perform operations comprising:
obtaining a text having a plurality of words;
comparing each of the plurality of words to a dictionary, wherein comparing each of the plurality of words to a dictionary includes performing natural language processing on a definition in the dictionary to determine whether each of the plurality of words refers to a named entity;;
creating, based on the comparison, an annotation for at least one of the plurality of words that refer to the named entity, wherein the annotation includes the definition obtained from the dictionary;
parsing only a portion of the text to identify a part of speech, wherein the portion of the text consists of the annotated words; and
removing the annotations from each of the at least one of the plurality of words that has a part of speech that is not one of a noun and a noun supporting adjective.
7. The system of claim 6 , wherein the named entity consists of one of a place and a person.
8. The system of claim 6 , wherein the operations further comprise storing the text with a metadata file that includes the remaining annotations.
9. The system of claim 6 , wherein parsing the text to identify the part of speech for each of the plurality of words includes performing a part of speech tagging algorithm.
10. The system of claim 6 , wherein obtaining the text includes performing optical character recognition on a plurality of images.
11. A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer processor to cause the computer processor to perform a method comprising:
obtaining a text having a plurality of words;
comparing each of the plurality of words to a dictionary, wherein comparing each of the plurality of words to a dictionary includes performing natural language processing on a definition in the dictionary to determine whether each of the plurality of words refers to a named entity;
creating, based on the comparison, an annotation for at least one of the plurality of words that refer to the named entity, wherein the annotation includes the definition obtained from the dictionary;
parsing only a portion of the text to identify a part of speech, wherein the portion of the text consists of the annotated words; and
removing the annotations from each of the at least one of the plurality of words that has a part of speech that is not one of a noun and a noun supporting adjective.
12. The computer program product of claim 11 , wherein the named entity consists of one of a place and a person.
13. The computer program product of claim 11 , wherein the method further comprises storing the text with a metadata file that includes the remaining annotations.
14. The computer program product of claim 11 , wherein parsing the text to identify the part of speech for each of the plurality of words includes performing a part of speech tagging algorithm.