Method and system for identifying key terms in digital document
Disclosed is a method and a system for identifying key terms in a digital document. The method comprises providing the digital document and analysing the digital document to identify key terms in the digital document. The digital document includes a first text in a first language. Furthermore, analysing the digital document comprises translating the first text in the first language to obtain a second text in a second language, translating the first text in the first language to obtain a third text in a third language, translating the obtained second text in the second language to obtain a fourth text in the third language, comparing at least one pair of first text, second text, third text and fourth text to identify at least one set of similar text between the compared at least one pair, and processing the set of similar text to obtain key terms in the digital document.
1. A method of identifying key terms in a digital document, wherein the method comprises:
providing the digital document, wherein the digital document includes a first text in a first language; and
analysing the digital document to identify the key terms in the digital document, wherein analysing comprises:
translating the first text in the first language to obtain a second text in a second language;
translating the first text in the first language to obtain a third text in a third language;
translating the obtained second text in the second language to obtain a fourth text in the third language;
comparing the third text and the fourth text to identify at least one set of similar text therebetween, wherein the at least one set of similar text is identified on the basis of known similarity methods, and wherein the at least one set of similar text is the number of recurring terms identified in the compared pair of text and comprises the terms which display little variation even after multiple language translations; and
processing the at least one set of similar text to obtain key terms in the digital document, wherein processing the at least one set of similar text comprises validating the at least one set of similar text based on an ontology.
2. The method of claim 1 , wherein the method further comprises developing the ontology using at least one curated database by:
applying conceptual indexing to plurality of terms stored in the at least one curated database;
identifying semantic associations, between the plurality of terms, established in the at least one curated database; and
identifying at least one class tagged with the plurality of terms in the at least one curated database.
3. The method of claim 1 , wherein the method further comprises classifying the identified key terms based on the ontology.
4. A system for identifying key terms in a digital document, wherein the system comprises:
a translation module operable to:
receive the digital document, wherein the digital document includes a first text in a first language;
translate the first text in the first language to obtain a second text in a second language;
translate the first text in the first language to obtain a third text in a third language; and
translate the obtained second text in the second language to obtain a fourth text in the third language;
a processing module communicably coupled to the translation module, the processing module operable to identify the key terms by:
comparing the third text and the fourth text to identify at least one set of similar text therebetween, wherein the at least one set of similar text is the number of recurring terms identified in the compared pair of text and comprises the terms which display little variation even after multiple language translations; and
processing the at least one set of similar text to obtain key terms in the digital document, wherein processing the at least one set of similar text comprises validating the at least one set of similar text based on an ontology.
5. The system of claim 4 , wherein the database arrangement is operable to store at least one curated database, wherein the ontology is developed using at least one curated database by:
applying conceptual indexing to plurality of terms stored in the at least one curated database;
identifying semantic associations, between the plurality of terms, established in the at least one curated database; and
identifying at least one class tagged with the plurality of terms in the at least one curated database.
6. The system of claim 4 , wherein the processing module is operable to further classify the identified key terms based on the ontology.
7. A non-transitory computer readable storage medium, containing program instructions for execution on a computer system, which when executed by a computer, cause the computer to perform method steps for identifying key terms in a digital document, the method comprising the steps of:
providing the digital document, wherein the digital document includes a first text in a first language; and
analysing the digital document to identify the key terms in the digital document, wherein analysing comprises:
translating the first text in the first language to obtain a second text in a second language;
translating the first text in the first language to obtain a third text in a third language;
translating the obtained second text in the second language to obtain a fourth text in the third language;
comparing the third text and the fourth text to identify at least one set of similar text therebetween, wherein the at least one set of similar text is the number of recurring terms identified in the compared pair of text and comprises the terms which display little variation even after multiple language translations; and
processing the at least one set of similar text to obtain key terms in the digital document, wherein processing the at least one set of similar text comprises validating the at least one set of similar text based on an ontology.