Validating and correlating content
View Patent ↗Online search retrieval is improved by automatic generation of key phrases. When a search engine crawls an electronic document, key words and phrases greatly help organize the electronic document to one or more topics. A quotient matrix defines a ratio of a key phrase to a total number of words in the electronic document. A correlation coefficient may also determine which key phrase correlates to the electronic document. A title key phrase may then be generated in response to the correlation coefficient having a positive value. When the search engine crawls the electronic document, the title key phrase may be provided as metadata.
1. A method for crawling an electronic document, comprising:
receiving, by an information handling system, the electronic document;
determining, by the information handling system, a positive correlation coefficient between the electronic document and key phrases associated with a product;
generating, by the information handling system, a title associated with the electronic document in response to the positive correlation coefficient;
determining, by the information handling system, a quotient matrix associated with the title, each quotient value in the quotient matrix defined as a quotient between different words in the title and a total count of the words in the electronic document;
adding, by the information handling system, entries to an electronic database that electronically associate the title and the electronic document to the key phrases associated with the product; and
providing, by the information handling system, the key phrases to a search engine when the crawling of the electronic document is performed.
2. The method of claim 1 , further comprising determining a search engine optimization rating based on the words in the electronic document.
3. The method of claim 1 , further comprising discarding a generic word from the title associated with the electronic document.
4. The method of claim 1 , further comprising determining a search engine optimization rating based on the quotient matrix.
5. The method of claim 1 , further comprising determining the quotient matrix for each word of the different words in the title.
6. The method of claim 1 , further comprising discarding a negative correlation coefficient between the electronic document and the key phrases associated with the product.
7. The method of claim 1 , further comprising discarding the key phrases in response to no correlation coefficient between the electronic document and the key phrases associated with the product.
8. An apparatus, comprising:
a hardware processor; and
a memory device accessible to the hardware processor, the memory device storing instructions, the instructions when executed causing the hardware processor to perform operations, the operations including:
receiving an electronic document for crawling by a search engine;
determining positive correlation coefficients between the electronic document and key phrases associated with a product;
ranking the key phrases based on the positive correlation coefficients;
selecting a highest ranking key phrase of the ranking of the key phrases;
generating a title associated with the electronic document based on the highest ranking key phrase;
determining a quotient matrix associated with the electronic document, each quotient value in the quotient matrix defined as a quotient between different words in the title and a total count of the words in the electronic document;
adding entries to an electronic database that electronically associate the title and the electronic document to the key phrases associated with the product; and
providing the key phrases to a search engine when the crawling of the electronic document is performed.
9. The system of claim 8 , wherein the operations further comprise determining a search engine optimization rating based on the words in the electronic document.
10. The system of claim 8 , wherein the operations further comprise discarding a generic word from the title associated with the electronic document.
11. The system of claim 8 , wherein the operations further comprise determining a search engine optimization rating based on the quotient matrix.
12. The system of claim 8 , wherein the operations further comprise determining the quotient matrix for each word of the different words in the title.
13. The system of claim 8 , wherein the operations further comprise discarding a negative correlation coefficient between the electronic document and the key phrases associated with the product.
14. The system of claim 8 , wherein the operations further comprise discarding the key phrases in response to no correlation between the electronic document and the key phrases associated with the product.
15. A memory device storing instructions that when executed cause a hardware processor to perform operations, the operations comprising:
receiving an electronic document for crawling by a search engine;
determining correlation coefficients between textual words in the electronic document and key phrases associated with a product;
determining the key phrases associated with positive values of the correlation coefficients;
determining quotient matrices for the key phrases associated with the positive values of the correlation coefficients, each quotient matrix in the quotient matrices defined as a quotient between words in the key phrases and a total number of the words in the electronic document;
hashing the quotient matrices for the key phrases using an electronic representation of a hashing algorithm to generate hash values;
determining a title for the electronic document, the title based on the hash values generated by the hashing of the quotient matrices for the key phrases associated with the positive values of the correlation coefficients;
associating the title in an electronic database to the electronic document; and
providing the title as metadata for the crawling by the search engine.
16. The memory device of claim 15 , wherein the operations further comprise determining a search engine optimization rating based on the quotient matrices.
17. The memory device of claim 15 , wherein the operations further comprise discarding a generic word associated with the electronic document.
18. The memory device of claim 15 , wherein the operations further comprise determining a greatest value of the quotient matrices.
19. The memory device of claim 15 , wherein the operations further comprise discarding the key phrases associated with negative values of the correlation coefficients.
20. The memory device of claim 15 , wherein the operations further comprise discarding the key phrases having no correlation.