Indexing multimedia web content
View Patent ↗A method of indexing multimedia content is disclosed. An element associated with a multimedia content is located in a display page. A potential multimedia content data file is identified through automated processing of data associated with the display page. An index data associated with one or more of the following: the display page, the multimedia content, and the potential multimedia content data file, is generated by processing the potential multimedia content data file.
1. A method of indexing multimedia content comprising:
locating in a display page an element by using regular expressions or Document Object Model (DOM) traversal, wherein the element is a tag associated with a multimedia content;
identifying a binary multimedia application code, wherein the binary multimedia application code is embedded in or linked to the display page via the element;
using a processor to automatically scan the binary multimedia application code for a plain text pointer to a potential multimedia content data file;
decompiling the binary multimedia application code;
using a sniffer to parse network traffic to identify an obfuscated potential multimedia content data file by parsing HTTP traffic to recognize XML files by identifying XML tags using regular expressions or DOM traversal;
testing a potential association of the heuristic by matching known values;
in the event the heuristic fails, generating an exception for human interaction and mapping; and
processing the potential multimedia content data file to generate an index data for the multimedia content, wherein:
1) processing the potential multimedia content data file includes building a data model of the potential multimedia content data file; and
2) wherein to build the data model comprises applying a heuristic that associates a short string as a title; a long string as a description; a string included in a set of rating strings as a rating; and a date as a release date.
2. A method as recited in claim 1 , wherein the automated processing comprises monitoring a network communication associated with the display page.
3. A method as recited in claim 1 , wherein the potential multimedia content data file comprises XML.
4. A method as recited in claim 1 , wherein the potential multimedia content data file is contained within a script.
5. A method as recited in claim 1 , wherein the potential multimedia content data file is external to the display page.
6. A method as recited in claim 1 , wherein the potential multimedia content data file is stored externally to a system on which the display page resides.
7. A method as recited in claim 1 , wherein the display page comprises HTML.
8. A method as recited in claim 1 , wherein processing the potential multimedia content data file includes identifying through automated processing of data associated with the potential multimedia content data file a nested potential multimedia content data file.
9. A method as recited in claim 1 , further comprising using the data model to determine that the multimedia content is responsive to a query.
10. A method as recited in claim 1 , wherein to build the data model comprises applying a heuristic.
11. A method as recited in claim 1 , wherein to build the data model comprises applying a heuristic; testing a potential association of the heuristic by matching known values; and generating an exception for human interaction if the heuristic fails.
12. A method as recited in claim 1 , wherein the data model is implemented using a relational database.
13. A method as recited in claim 1 , wherein the data model is implemented using a relational database such that each element type represents a table.
14. A method as recited in claim 1 , wherein the data model is normalized when compared with a second data model associated with a second display page.
15. A method as recited in claim 14 , wherein normalizing the data model comprises standardizing a category of the data model, wherein the category corresponds to a multimedia content data file tag.
16. A method as recited in claim 1 , further comprising using the data model to determine that the multimedia content data file is responsive to a query, and if it responsive to the query, returning data identifying the display page.
17. A method as recited in claim 1 , further comprising decompiling the binary multimedia application code, wherein the binary multimedia application code is a Flash SWF file.
18. A method as recited in claim 17 , further comprising using a sniffer to parse network traffic to identify a second potential multimedia content data file to generate a second index data.
19. A method as recited in claim 18 , wherein parsing network traffic includes parsing HTTP traffic to recognize XML data.
20. A method as recite in claim 1 , wherein multiple occurrences of a same multimedia content data file tag are entered as rows in the table.
21. A method as recite in claim 1 , wherein multimedia content data file tags that are sub-tags of other tags are captured in the data model as a parent-child relationship.
22. A system of indexing a potential multimedia content data file, comprising
a processor;
a sniffer configured to parse network traffic and coupled with the processor; and
a memory coupled with the processor, wherein the memory is configured to provide the processor with instructions which when executed cause the processor to:
locate in a display page an element, by using regular expressions or Document Object Model (DOM) traversal, wherein the element is a tag associated with a multimedia content;
identify a binary multimedia application code, wherein the binary multimedia application code is embedded in or linked to the display page via the element;
automatically scan the binary multimedia application code for a plain text pointer to a potential multimedia content data file;
decompile the binary multimedia application code;
use the sniffer to parse network traffic to identify an obfuscated potential multimedia content data file by parsing HTTP traffic to recognize XML files by identifying XML tags using regular expressions or DOM traversal;
test a potential association of the heuristic by matching known values;
in the event the heuristic fails, generating an exception for human interaction and mapping; and
process the potential multimedia content data file to generate an index data for the multimedia content, wherein:
1) to process the potential multimedia content data file includes building a data model of the potential multimedia content data file; and
2) wherein to build the data model comprises applying a heuristic that associates a short string as a title; a long string as a description; a string included in a set of rating strings as a rating; and a date as a release date.
23. A system as recited in claim 22 , wherein the processor is further configured to decompile the binary multimedia application code, wherein the binary multimedia application code is a Flash SWF file.
24. A system as recited in claim 22 , wherein processing the potential multimedia content data file includes building a data model of the potential multimedia content data file.
25. A computer program product for indexing a potential multimedia content data file, the computer program product being embodied in a non-transitory computer readable medium and comprising computer instructions for:
locating in a display page an element by using regular expressions or Document Object Model (DOM) traversal, wherein the element is a tag associated with a multimedia content;
identifying a binary multimedia application code, wherein the binary multimedia application code is embedded in or linked to the display page via the element;
automatically scanning the binary multimedia application code for a plain text pointer to a potential multimedia content data file;
decompiling the binary multimedia application code;
using a sniffer to parse network traffic to identify an obfuscated potential multimedia content data file by parsing HTTP traffic to recognize XML files by identifying XML tags using regular expressions or DOM traversal;
testing a potential association of the heuristic by matching known values;
in the event the heuristic fails, generating an exception for human interaction and mapping; and
processing the potential multimedia content data file to generate an index data for the multimedia content, wherein:
1) processing the potential multimedia content data file includes building a data model of the potential multimedia content data file; and
2) wherein to build the data model comprises applying a heuristic that associates a short string as a title; a long string as a description; a string included in a set of rating strings as a rating; and a date as a release date.
26. A computer program product as recited in claim 25 , further comprising computer instructions for decompiling the binary multimedia application code, wherein the binary multimedia application code is a Flash SWF file.
27. A computer program product as recited in claim 25 , wherein processing the potential multimedia content data file includes building a data model of the potential multimedia content data file.