Method for entity enrichment of digital content to enable advanced search functionality in content management systems
View Patent ↗Disclosed is a system and method for extending search capabilities of contentment management systems, such as SharePoint 2013®, to enable geographic and name entity based searches. Geographic and named entity searches are enabled by a content enrichment web service. The content enrichment web service calls a geotagging or a named entity tagger web service application to tag crawled managed properties as input and return geographically or entity modified managed properties as output. The system associates one or more geographically and named entity modified managed properties with content and stores this information as metadata in a SharePoint 2013® search index. Thus, the search system allows users to identify a particular geographic entity the user is interested in finding, and to receive search results directly related to that geographic entity on SharePoint 2013®.
1. A computer-implemented method comprising:
receiving, by a computer, a plurality of data streams associated with a plurality of data sources respectively;
responsive to the computer detecting a triggering condition associated with data of a data stream, the triggering condition indicating whether the data requires geo-tagging or entity-tagging:
generating, by the computer, geographic data associated with the data of the data stream; and
updating, by the computer, metadata associated with the data of the data stream, the metadata containing the geographic data associated with the data;
responsive to the computer not detecting the triggering condition for the data:
mapping, by the computer, the metadata for the data source to a set of managed properties associated with a search index; and
responsive to the computer determining that the data is image data:
determining, by the computer, a storage location of a machine-readable document file containing the image data, based upon the metadata associated with the image data;
executing, by the computer, an optical character recognition routine on the document file containing the image data received from the data source, thereby generating text data for the data of the data source; and
updating, by the computer, the metadata of the data from the data source, in response to identifying geographic data associated with the text data.
2. The method according to claim 1 , wherein executing the optical character recognition routine further comprises fetching, by the computer, the document file containing the image data from the storage location of the data source.
3. The method according to claim 2 , wherein fetching the document file from the storage location further comprises downloading, by the computer, the document file from a server of the data source having a uniform resource location (URL) address according to the storage location in the metadata associated with the image data.
4. The method according to claim 1 , wherein detecting the triggering condition further comprises:
searching, by the computer, the data from the data source for one or more geographic entities; and
determining, by the computer, that the data contains at least one geographic entity satisfying the triggering condition, wherein satisfying the triggering condition indicates that the data of the data stream requires the geographic data.
5. The method according to claim 1 , wherein generating the geographic data associated with the data of the data stream further comprises identifying, by the computer, one or more geographic entities in the data of the data stream.
6. The method according to claim 5 , wherein identifying the one or more geographic entities in the data further comprises:
querying, by the computer, an entity database comprising non-transitory machine-readable storage media configured to store one or more entity records associated with a plurality of geographic entities respectively, each respective entity record comprising entity data that identifies the respective geographic entity in the text data; and
comparing, by the computer, the text data with the entity data contained in the one or more records of the entity database.
7. The method according to claim 5 , wherein identifying the one or more geographic entities in the data of the data stream further comprises determining, by the computer, a number of co-occurrences of the one or more geographic entities in one or more data sources, wherein the record of each respective geographic entity contains one or more co-occurrence counts for the respective geographic entity.
8. The method according to claim 5 , wherein a geographic entity is selected from the group consisting of a geographic location, a geographic coordinate, and a geographic feature.
9. The method according to claim 5 , wherein the entity database stores at least one entity record containing entity data that identifies an entity selected from the group consisting of: an organization, a person, and a topic.
10. The method according to claim 1 , further comprising:
in response to the computer receiving a query input from a graphical user interface:
querying, by the computer, a content database for one or more geographic entities using the search index, in accordance with the query input, the content database hosted on one or more servers comprising non-transitory machine-readable storage media configured to store the data received from a plurality of data streams,
wherein the data of at least one respective data stream is text data associated with metadata containing the geographic data identified in the text data of the at least one data stream.