MATCHING ARBITRARY INPUT PHRASES TO STRUCTURED PHRASE DATA
Techniques are disclosed for comparing data between dissimilar data hierarchies. Techniques provide an entity pool comprising multiple entities having established relationships and hierarchies. A user selects data from one hierarchy, and a mapping to a node in a structure that provides a normalized hierarchy is found. After identifying a node mapped to the data selection, elements corresponding to a second hierarchy that also maps to the same node (or otherwise obtained from using known natural language processing techniques) are identified. Doing so allows comparable elements of otherwise dissimilar hierarchies to be identified.
1 . A method for obtaining data corresponding to comparable elements in a first hierarchy and a second hierarchy, the method comprising:
generating an entity pool by clustering a plurality of entities, each respective entity of the plurality of entities comprising at least one mention;
causing a graphical user interface to be displayed, the graphical user interface comprising a plurality of first hierarchy elements;
receiving a selection, via the graphical user interface, of a first hierarchy element of the plurality of first hierarchy elements;
identifying a mapping from the first hierarchy element to an entity in the entity pool; and
upon identifying a mapping from a second hierarchy element to the identified entity in the entity pool:
retrieving data corresponding to the first hierarchy element and the second hierarchy element; and
displaying the data corresponding to the first hierarchy element and the second hierarchy element in the graphical user interface.
2 . The method of claim 1 , wherein each entity in the entity pool is associated with a collection of mentions and metadata.
3 . The method of claim 1 , further comprising retrieving the plurality of entities from one or more public data sources.
4 . The method of claim 1 , further comprising determining a plurality of relationships between the plurality of entities in the entity pool, wherein each relationship between a respective first entity and a respective second entity is based on a measure of similarity between the mentions and metadata of the respective first entity and the respective second entity.
5 . The method of claim 1 , wherein upon identifying no mapping from any element in the second hierarchy to the identified entity; identifying a candidate entity in the entity pool based on a similarity measure between the identified entity and the candidate entity.
6 . The method of claim 5 , wherein upon identifying no mapping from any element in the second hierarchy to the identified entity,
identifying a mapping from a second hierarchy element to the candidate entity;
retrieving data corresponding the second hierarchy element; and
displaying the data corresponding to the first hierarchy element and the second hierarchy element in the graphical user interface.
7 . The method of claim 1 , wherein identifying the mapping from the first hierarchy element to the entity in the entity pool further comprises using natural language processing.
8 . The method of claim 1 , wherein identifying the mapping from the first hierarchy element to the entity in the entity pool is based on ontology relating the first hierarchy element to the entity in the entity pool.
9 . A non-transitory computer-readable storage medium storing instructions, which, when executed on a processor, performs an operation for obtaining data corresponding to comparable elements in a first hierarchy and a second hierarchy, the operation comprising:
generating an entity pool by clustering a plurality of entities, each respective entity of the plurality of entities comprising at least one mention;
causing a graphical user interface to be displayed, the graphical user interface comprising a plurality of first hierarchy element;
receiving a selection, via the graphical user interface, of a first hierarchy element of the plurality of first hierarchy elements;
identifying a mapping from the first hierarchy element to an entity in the entity pool; and
upon identifying a mapping from a second hierarchy element to the identified entity in the entity pool:
retrieving data corresponding to the first hierarchy element and the second hierarchy element; and
displaying the data corresponding to the first hierarchy element and the second hierarchy element in the graphical user interface.
10 . The computer-readable storage medium of claim 9 , wherein each entity in the entity pool is associated with a collection of mentions and metadata.
11 . The computer-readable storage medium of claim 9 , the operation further comprising retrieving the plurality of entities from one or more public data sources.
12 . The computer-readable storage medium of claim 9 , the operation further comprising determining a plurality of relationships between the plurality of entities in the entity pool, wherein each relationship between a respective first entity and a respective second entity is based on a measure of similarity between the mentions and metadata of the respective first entity and the respective second entity.
13 . The computer-readable storage medium of claim 9 , wherein upon identifying no mapping from any element in the second hierarchy to the identified entity; identifying a candidate entity in the entity pool based on a similarity measure between the identified entity and the candidate entity.
14 . The computer-readable storage medium of claim 13 , wherein upon identifying no mapping from any element in the second hierarchy to the identified entity:
identifying a mapping from a second hierarchy element to the candidate entity;
retrieving data corresponding the second hierarchy element; and
displaying the data corresponding to the first hierarchy element and the second hierarchy element in the graphical user interface.
15 . The computer-readable storage medium of claim 9 , wherein identifying the mapping front the first hierarchy element to the entity in the entity pool further comprises using natural language processing.
16 . A system, comprising:
a processor; and
a memory hosting an application, which, when executed on the processor, performs an operation for obtaining data corresponding to comparable elements in a first hierarchy and a second hierarchy, the operation comprising:
generating an entity pool by clustering a plurality of entities, each respective entity of the plurality of entities comprising at least one mention;
causing a graphical user interface to be displayed, the graphical user interface comprising a plurality of first hierarchy elements,
receiving a selection, via the graphical user interface, of a first hierarchy element of the plurality of first hierarchy elements;
identifying a mapping from the first hierarchy element to an entity in the entity pool; and
upon identifying a mapping from a second hierarchy element to the identified entity in the entity pool:
retrieving data corresponding to the first hierarchy element and the second hierarchy element; and
displaying the data corresponding to the first hierarchy element and the second hierarchy element in the graphical user interface.
17 . The system of claim 16 , wherein each entity in the entity pool is associated with a collection of mentions and metadata.
18 . The system of claim 16 , the operation further comprising retrieving the plurality of entities from one or more public data sources.
19 . The system of claim 16 , the operation further comprising determining a plurality of relationships between the plurality of entities in the entity pool, wherein each relationship between a respective first entity and a respective second entity is based on a measure of similarity between the mentions and metadata of the respective first entity and the respective second entity.
20 . The system of claim 16 , wherein upon identifying no mapping from any element in the second hierarchy to the identified entity: identifying a candidate entity in the entity pool based on a similarity measure between the identified entity and the candidate entity.
21 . The system of claim 20 , wherein upon identifying no mapping from any element in the second hierarchy to the identified entity:
identify a mapping from a second hierarchy element to the candidate entity;
retrieving data corresponding the second hierarchy element; and
displaying the data corresponding to the first hierarchy element and the second hierarchy element in the graphical user interface.
22 . The system of claim 16 , wherein identifying the mapping from the first hierarchy element to the entity in the entity pool further comprises using natural language processing.