Method and system of retrieving ajax web page content
The present disclosure describes a method and a system of retrieving Ajax web page content. The method of retrieving Ajax web page content includes: obtaining information of web page codes; retrieving JavaScript information in the information of the web page codes; analyzing the JavaScript information to determine function(s) that include(s) Ajax call(s) in the web page codes; and triggering the determined function(s) that include(s) the Ajax call(s) to obtain web page content. Through analyzing JavaScript information in web page codes, the above technical scheme obtains function(s) that include(s) Ajax call(s) in the web page codes and further triggers the function(s) to obtain web page content generated thereby, thus achieving retrieval of dynamic content in an Ajax web page. Using the above technical scheme, a search engine can collect more complete web page contents and hence provide a better search service to users.
1. One or more non-transitory storage media comprising computer-executable instructions that, when executed by a computer, perform acts comprising:
retrieving scripting language information from a web page code, the scripting language information being included in one or more external files;
determining a type of one scripting file of the one or more scripting language files based on a file name of the one scripting file,
in an event that the one scripting file is determined to be a framework file:
determining whether the framework file defines one or more functions including one or more Asynchronous JavaScript and XML (Ajax) calls, and
in response to determining that the framework file defines one or more functions including one or more Ajax calls, obtaining Ajax property values, and determining at least one Ajax function in the web page code using the obtained Ajax property values; and in an event that the one scripting file is a non-framework file:
obtaining at least one function based on corresponding Ajax property values and determining at least one Ajax function in the web page code using the Ajax property values associated with the function as defined in the non-framework file;
simulating a user operation corresponding to the at least one Ajax function in the web page code; and
calling the function to generate content associated with the web page code in response to the simulated user operation.
2. The one or more non-transitory storage media as recited in claim 1 , wherein the acts further comprise obtaining the web page code in a markup language format, and wherein the web page code includes a location or a filename of the one or more files.
3. The one or more non-transitory storage media as recited in claim 1 , wherein the web page code includes the scripting language information or indicates a document including scripting language information.
4. The one or more non-transitory storage media as recited in claim 1 , wherein the web page code is associated with a markup language.
5. The one or more non-transitory storage media as recited in claim 4 , wherein the markup language includes a HyperText Markup Language (HTML), and wherein the scripting language information is located in a tag pair of a HTML file corresponding to the web page code.
6. A method of retrieving web page content, the method comprising:
retrieving, by a computing device, scripting language information from a web page code, the scripting language information being included in one or more external files;
determining a type of one scripting file of the one or more scripting language files based on a file name of the one scripting file,
in an event that the one scripting file is determined to be a framework file:
determining whether the framework file defines one or more functions including one or more Asynchronous JavaScript and XML (Ajax) calls, and
in response to determining that the framework file defines one or more functions including one or more Ajax calls, obtaining Ajax property values, and determining at least one Ajax function in the web page code using the obtained Ajax property values; and in an event that the one scripting file is a non-framework file:
obtaining at least one function based on corresponding Ajax property values and determining at least one Ajax function in the web page code using the Ajax property values associated with the function as defined in the non-framework file;
simulating a user operation corresponding to the at least one Ajax function in the web page code; and
calling the function to generate content associated with the web page code in response to the simulated user operation.
7. The method as recited in claim 6 , wherein the method further comprises obtaining a web page code obtaining the web page code in a markup language format, and wherein the web page code includes a location or a filename of the one or more files.
8. The method as recited in claim 6 , wherein the web page code includes the scripting language information or indicates a document including scripting language information.
9. The method as recited in claim 6 , wherein the web page code is associated with a markup language.
10. The method as recited in claim 9 , wherein the markup language includes a HyperText Markup Language (HTML), and wherein the scripting language information is located in a tag pair of a HTML file corresponding to the web page code.
11. A computing device comprising:
one or more processors; and
memory to maintain a plurality of components executable by the one or more processors, the plurality of components comprising:
a script retrieving unit configured to retrieve scripting language information from the web page code the scripting language information being included in one or more external files;
a script analyzing unit configured to:
determine a type of one scripting file of the one or more scripting language files based on a file name of the one scripting file,
in an event that the one scripting file is determined to be a framework file:
determine whether the framework file defines one or more functions including one or more Asynchronous JavaScript and XML (Ajax) calls, and
in response to determining that the framework file defines one or more functions including one ore more Ajax calls, obtain Ajax property values, and determine at least one Ajax function in the web page code using the obtained Ajax property values; and
in an event that the one scripting file is a non-framework file:
obtaining at least one function based on corresponding Ajax property values and determining at least one Ajax function in the web page code using the Ajax property values associated with the function as defined in the non-framework file;
a web page content acquisition unit configured to:
simulate a user operation corresponding to the at least one Ajax function in the web page code, and
call the function to generate content associated with the web page code in response to the simulated user operation.
12. The system as recited in claim 11 , wherein the plurality of components further comprises a web page code acquisition unit configured to obtain a web page code.
13. The system as recited in claim 12 , wherein the web page code is in a markup language format, and wherein the web page code includes a location or a filename of the one or more files.
14. The system as recited in claim 11 , wherein the web page code includes the scripting language information or indicates a document including scripting language information.
15. The system as recited in claim 11 , wherein the web page code is associated with a markup language.
16. The system as recited in claim 15 , wherein the markup language includes a HyperText Markup Language (HTML), and wherein the scripting language information is located in a tag pair of a HTML file corresponding to the web page code.