Systems and methods for semantic keyword analysis
In various embodiments, a method for generating from one or more keywords a list of related topics for organic search includes receiving, by a topic tool, an input of one or more keywords for which to generate a list of related topics. The method may further include acquiring, by a crawler, content from a plurality of different web content sources via one or more networks. The method may also include applying, by the topic tool, to the acquired content an ensemble of one or more key phrase extraction algorithms, one or more graph analyses algorithms and one or more natural language processing algorithms to identify a set of semantically relevant topics scored by relevance. The method may also include generating, by the topic tool, from the set of semantically relevant topics, a knowledge graph of related topics for the input of the one or more keywords. The method may further include outputting, by the topic tool based at least partially on the knowledge graph, an enumerated list of topics ranked by at least a relevance score.
1. A system for generating from one or more keywords a list of related topics for organic search, the system comprising:
a client computing device configured to:
send via a computer network connection, to a server, a request for keywords related to a topic or concept,
wherein, the server to which the request is sent utilizes:
a crawler configured to acquire content from a plurality of different web content sources via one or more computer network connections; and
a topic tool configured to execute on a processor on at least one server to:
receive an input including the request for keywords related to a topic or concept for which to generate a list of related topics;
apply to the acquired content an ensemble of algorithms, the ensemble comprising a predetermined sequence of:
one or more key phrase extraction algorithms to generate a set of keywords based on at least the acquired content,
one or more graph analyses algorithms to identify a set of topics semantically relevant to the set of keywords generated using the one or more key phrase extraction algorithms, and
one or more natural language processing algorithms to determine a relevance score for each topic of the set of semantically relevant topics;
generate from the set of semantically relevant topics, a knowledge graph of related topics for the input of the one or more keywords; and
receive via the computer network connection, from the server, output based at least partially on the knowledge graph, an enumerated list of topics ranked by at least the relevance score.
2. The system of claim 1 , wherein the server to which the request is sent further comprises a topic inventory tool configured to generate the input of one or more keywords from analyses of content from an identified web site.
3. The system of claim 1 , wherein the key phrase extraction algorithms comprise a Bayesian statistical ensemble.
4. The system of claim 1 , wherein the ensemble is further configured to perform a plurality of term ranking functions including one or more of the following: a core phrase term ranking function, a tail phrase term ranking function, a hyperdictionary graph traversal algorithm and a semantic knowledgebase path traversal score.
5. A method for generating from one or more keywords a list of related topics for organic search, the method comprising:
sending with a client device, via a computer network connection, to a server, a request for keywords related to a topic or concept,
wherein, the server to which the request is sent utilizes:
a crawler configured to acquire content from a plurality of different web content sources via one or more computer network connections; and
a topic tool configured to execute on a processor on at least one server to:
receive an input including the request for keywords related to a topic or concept for which to generate a list of related topics;
apply to the acquired content an ensemble of algorithms, the ensemble comprising a predetermined sequence of:
one or more key phrase extraction algorithms to generate a set of keywords based on at least the acquired content,
one or more graph analyses algorithms to identify a set of topics semantically relevant to the set of keywords generated using the one or more key phrase extraction algorithms, and
one or more natural language processing algorithms to determine a relevance score for each topic of the set of semantically relevant topics;
generate from the set of semantically relevant topics, a knowledge graph of related topics for the input of the one or more keywords; and
receiving with the client device, via the computer network connection, from the server, output based at least partially on the knowledge graph, an enumerated list of topics ranked by at least the relevance score.
6. The method of claim 5 , wherein the receiving an input further comprises receiving, by the topic tool, the input of one or more keywords from a topic inventory tool, the topic inventory tool generating the input keyword from analyses of content from an identified web site.
7. The method of claim 5 , wherein the acquiring further comprises acquiring content, by the crawler, from the plurality of different web content sources comprising web sites, news articles, blog posts and keyword data.
8. The method of claim 5 , wherein the acquiring further comprises cleansing and normalizing the acquired content.
9. The method of claim 5 , wherein the one or more key phrase extraction algorithms comprise a Bayesian statistical ensemble.
10. The method of claim 5 , wherein the applying further comprises performing a plurality of term ranking functions are performed including one or more of the following: a core phrase term ranking function, a tail phrase term ranking function, a hyperdictionary graph traversal algorithm and a semantic knowledgebase path traversal score.
11. The method of claim 5 , wherein the applying further comprises applying a weight to each of the one or more algorithms of the ensemble to generate the relevance score for the set of semantic relevance scored phrases.
12. The method of claim 5 , wherein the receiving output further comprises receiving the enumerated list of topics ranked by a measure of frequency comprising one or more of the following: frequency in page body, frequency in title, and number of pages where the topics occur.
13. The method of claim 5 , wherein the receiving output further comprises receiving the enumerated list of topics ranked by at least one of an attractiveness score, a volume score and a competition score.
14. The method of claim 5 , wherein the receiving output further comprises receiving the enumerated list of topics ranked by an estimated equivalent value associated with paid advertising.
15. The method of claim 5 , wherein the receiving output further comprises receiving the enumerated list of topics ranked by one or more of the following:
a measure of frequency, an attractiveness score, a volume score, and a competition score.
16. A non-transitory computer-readable storage medium comprising:
instructions that, when executed by a device comprising a processor, facilitate performance of generating topics for organic search operations comprising:
receiving, via a computer network connection, a request for keywords related to a topic or concept,
implementing a crawler configured to acquire content from a plurality of different web content sources via one or more computer network connections; and
implementing a topic tool to:
receive an input including the request for keywords related to a topic or concept for which to generate a list of related topics;
apply to the acquired content an ensemble of algorithms, the ensemble comprising a predetermined sequence of:
one or more key phrase extraction algorithms to generate a set of keywords based on at least the acquired content,
one or more graph analyses algorithms to identify a set of topics semantically relevant to the set of keywords generated using the one or more key phrase extraction algorithms, and
one or more natural language processing algorithms to determine a relevance score for each topic of the set of semantically relevant topics;
generate from the set of semantically relevant topics, a knowledge graph of related topics for the input of the one or more keywords; and
outputting, based at least partially on the knowledge graph, an enumerated list of topics ranked by at least the relevance score.
17. The medium of claim 16 , wherein the instructions for receiving an input further comprise instructions for receiving, by the topic tool, the input of one or more keywords from a topic inventory tool, the topic inventory tool generating the input keyword from analyses of content from an identified web site.
18. The medium of claim 16 , wherein the instructions for acquiring further comprise instructions for acquiring content, by the crawler, from the plurality of different web content sources comprising web sites, news articles, blog posts and keyword data.
19. The medium of claim 16 , wherein the one or more key phrase extraction algorithms comprise a Bayesian statistical ensemble.
20. The medium of claim 16 , wherein the instructions for applying further comprise instructions for performing a plurality of term ranking functions are performed including one or more of the following: a core phrase term ranking function, a tail phrase term ranking function, a hyperdictionary graph traversal algorithm and a semantic knowledgebase path traversal score.