Methods and systems for modeling complex taxonomies with natural language understanding
Systems and methods are presented for the automatic placement of rules applied to topics in a logical hierarchy when conducting natural language processing. In some embodiments, a method includes: accessing, at a child node in a logical hierarchy, at least one rule associated with the child node; identifying a percolation criterion associated with a parent node to the child node, said percolation criterion indicating that the at least one rule associated with the child node is to be associated also with the parent node; associating the at least one rule with the parent node such that the at least one rule defines a second factor for determining whether the document is to also be classified into the parent node; accessing the document for natural language processing; and determining whether the document is to be classified into the parent node or the child node based on the at least one rule.
1. A method for improving natural language processing conducted by a natural language model, the method comprising:
accessing, at a first node in a logical hierarchy configured to guide classification of a plurality of documents by the natural language model, at least one rule associated with the first node, said at least one rule defining a first factor for determining whether a document among the plurality of documents is to be classified into the first node;
identifying a percolation criterion associated with a second node in the logical hierarchy that is a parent node to the first node, said percolation criterion indicating that the at least one rule associated with the first node is to be associated also with the second node; and
based on the identified percolation criterion, associating the at least one rule with the second node such that the at least one rule defines a second factor for determining whether the document is to also be classified into the second node, the document being classifiable according to the logical hierarchy into at least one of the second node and the first node based on the at least one rule associated with both the first node and the second node.
2. The method of claim 1 , wherein the percolation criterion is a first percolation criterion, and the method further comprises:
identifying a second percolation criterion associated with a third node in the logical hierarchy that is a parent node to the second node, said percolation criterion indicating that the at least one rule associated with the first node is to be associated also with the third node; and
based on the identified second percolation criterion, associating the at least one rule with the third node such that the at least one rule defines a third factor for determining whether the document is to also be classified into the third node.
3. The method of claim 1 , further comprising:
determining that a second percolation criterion is not associated with a third node in the logical hierarchy that is a parent node to the second node; and
based on said determination, limiting the at least one rule to be associated only to the first node and the second node.
4. The method of claim 1 , wherein the percolation criterion includes the second node being repeated at least once within the logical hierarchy.
5. The method of claim 1 , wherein the percolation criterion includes a metadata tag that is enabled.
6. The method of claim 1 , wherein the percolation criterion is specified by user input to a user interface.
7. The method of claim 1 , wherein said accessing is based on the at least one rule being defined by user input to a user interface associated with the first node.
8. A system comprising:
a memory; and
a processor coupled to the memory and configured to:
access, at a first node in a logical hierarchy configured to guide classification of a plurality of documents by the natural language model, at least one rule associated with the first node, said at least one rule defining a first factor for determining whether a document among the plurality of documents is to be classified into the first node;
identify a percolation criterion associated with a second node in the logical hierarchy that is a parent node to the first node, said percolation criterion indicating that the at least one rule associated with the first node is to be associated also with the second node; and
based on the identified percolation criterion, associate the at least one rule with the second node such that the at least one rule defines a second factor for determining whether the document is to also be classified into the second node, the document being classifiable according to the logical hierarchy into at least one of the second node and the first node based on the at least one rule associated with both the first node and the second node.
9. The system of claim 8 , wherein the percolation criterion is a first percolation criterion, and the processor is further configured to:
identify a second percolation criterion associated with a third node in the logical hierarchy that is a parent node to the second node, said percolation criterion indicating that the at least one rule associated with the first node is to be associated also with the third node; and
based on the identified second percolation criterion, associate the at least one rule with the third node such that the at least one rule defines a third factor for determining whether the document is to also be classified into the third node.
10. The system of claim 8 , wherein the processor is further configured to:
determine that a second percolation criterion is not associated with a third node in the logical hierarchy that is a parent node to the second node; and
based on said determination, limit the at least one rule to be associated only to the first node and the second node.
11. The system of claim 8 , wherein the percolation criterion includes the second node being repeated at least once within the logical hierarchy.
12. The system of claim 8 , wherein the percolation criterion includes a metadata tag that is enabled.
13. The system of claim 8 , wherein the percolation criterion is specified by user input to a user interface.
14. The system of claim 8 , wherein said accessing is based on the at least one rule being defined by user input to a user interface associated with the first node.
15. A non-transitory computer readable medium comprising instructions that, when executed by a processor, cause the processor to perform operations comprising:
accessing, at a first node in a logical hierarchy configured to guide classification of a plurality of documents by the natural language model, at least one rule associated with the first node, said at least one rule defining a first factor for determining whether a document among the plurality of documents is to be classified into the first node;
identifying a percolation criterion associated with a second node in the logical hierarchy that is a parent node to the first node, said percolation criterion indicating that the at least one rule associated with the first node is to be associated also with the second node; and
based on the identified percolation criterion, associating the at least one rule with the second node such that the at least one rule defines a second factor for determining whether the document is to also be classified into the second node; the document being classifiable according to the logical hierarchy into at least one of the second node and the first node based on the at least one rule associated with both the first node and the second node.
16. The computer readable medium of claim 15 , wherein the percolation criterion is a first percolation criterion, and the operations further comprise:
identifying a second percolation criterion associated with a third node in the logical hierarchy that is a parent node to the second node, said percolation criterion indicating that the at least one rule associated with the first node is to be associated also with the third node; and
based on the identified second percolation criterion, associating the at least one rule with the third node such that the at least one rule defines a third factor for determining whether the document is to also be classified into the third node.
17. The computer readable medium of claim 15 , wherein the operations further comprise:
determining that a second percolation criterion is not associated with a third node in the logical hierarchy that is a parent node to the second node; and
based on said determination, limiting the at least one rule to be associated only to the first node and the second node.
18. The computer readable medium of claim 15 , wherein the percolation criterion includes the second node being repeated at least once within the logical hierarchy.
19. The computer readable medium of claim 15 , wherein the percolation criterion includes a metadata tag that is enabled.
20. The computer readable medium of claim 15 , wherein the percolation criterion is specified by user input to a user interface.