Method and system for rule based indexing of multiple data structures
View Patent ↗A system and process for augmenting automated agents to search network based data stores generate a set of rules that describes the contents contained within structured data stores. This set of rules allows an automated agent to perform a focused search of a structured data store, thus eliminating searching for unnecessary content. The structure of the data store is defined and entities are categorized. Additionally, templates are created defining data, such as metadata fields, related to the entities. These definitions, categorizations, and templates are incorporated into the set of rules, which is utilized by the agent to search a data store on a network, such as a web site.
1. A method in a computing system of associating metadata with a media entity comprising:
identifying a first media entity located within a data store;
receiving user input that identifies the first media entity as belonging to a distinguished category;
receiving user input designating a portion of a map of the data store containing the first media entity as corresponding to the distinguished category;
attributing metadata to the first media entity indicating that it belongs to the distinguished category;
automatically identifying a plurality of media entities located within the designated portion of the map; and
based upon the location of each of the plurality of media entities within the designated portion of the map, automatically attributing metadata to each of the plurality of media entities indicating that each of the plurality of media entities belongs to the distinguished category.
2. The method of claim 1 wherein identifying the first and second media entities includes crawling a web site.
3. The method of claim 1 further comprising selecting the distinguished category by examining a path of a URI at which the first media entity is identified.
4. The method of claim 1 further comprising selecting the distinguished category by examining a web site name at which the first media entity is identified.
5. The method of claim 1 wherein attributing metadata includes parsing a file name of the first or second media entity.
6. The method of claim 5 further comprising using a metadata dictionary to store a first string in the metadata when a second string is identified in the file name.
7. The method of claim 1 wherein attributing metadata includes prompting an operator to enter metadata based upon the distinguished category.
8. The method of claim 1 wherein attributing metadata includes extracting metadata from the first media entity.
9. The method of claim 1 further comprising comparing the specified metadata with known good metadata.
10. The method of claim 1 further comprising checking the validity of the identified media entities.
11. The method of claim 1 wherein the media entities are selected from the group consisting of text, audio, video, and images.
12. The method of claim 1 wherein the metadata conforms to one or more of a Dublin Core standard, an MPEG standard, or an XML standard.
13. A computer-readable medium whose contents cause a computing system to perform a method of associating metadata with a media entity, the method comprising:
identifying a first media entity located within a data store;
receiving user input that identifies the first media entity as belonging to a distinguished category;
receiving user input designating a portion of a map of the data store containing the first media entity as corresponding to the distinguished category;
attributing metadata to the first media entity indicating that it belongs to the distinguished category;
automatically identifying a second media entity within the data store belonging to the distinguished category; and
based upon belonging to the category, automatically attributing metadata to the second media entity indicating that it belongs to the distinguished category.
14. The method of claim 13 wherein identifying the first and second media entities includes crawling a web site.
15. The method of claim 13 further comprising selecting the distinguished category by examining a path of a URI at which the first media entity is identified.
16. The method of claim 13 further comprising selecting the distinguished category by examining a web site name at which the first media entity is identified.
17. The method of claim 13 wherein attributing metadata includes parsing a file name of the first or second media entity.
18. The method of claim 17 further comprising using a metadata dictionary to store a first string in the metadata when a second string is identified in the file name.
19. The method of claim 13 wherein attributing metadata includes prompting an operator to enter metadata based upon the distinguished category.
20. The method of claim 13 wherein attributing metadata includes extracting metadata from the first media entity.
21. The method of claim 13 further comprising comparing the specified metadata with known good metadata.
22. The method of claim 13 further comprising checking the validity of the identified media entities.
23. The method of claim 13 wherein the media entities are selected from the group consisting of text, audio, video, and images.
24. The method of claim 13 wherein the metadata conforms to one or more of a Dublin Core standard, an MPEG standard, or an XML standard.
25. A computer memory containing a data structure for associating metadata with a media entity residing in a data store having a map, comprising:
metadata that, when attributed to a media entity, indicates that the media entity belongs to a distinguished category; and
one or more rules for automatically identifying at least one identified media entity belonging to the distinguished category based on the at least one identified media entity residing in a user-designated portion of the map of the data store, at least one of the rules having been generated by:
identifying a first media entity located within the data store;
receiving user input that identifies the first media entity as belonging to the distinguished category;
receiving user input designating the portion of the map of the data store containing the first media entity as corresponding to the distinguished category; and
attributing the metadata to the first media entity indicating that it belongs to the distinguished category;
such that the contents of the data structure are adapted for use to automatically associate the metadata with at least one media entity belonging to the category by:
automatically identifying a second media entity located within the designated portion of the map; and
based upon the location of the second media entity within the designated portion of the map, automatically attributing the metadata to the second media entity indicating that it belongs to the distinguished category.