Method and terminal for extracting webpage content, and non-transitory storage medium
A method, a terminal and a non-transitory storage medium for extracting webpage content includes: responding to a webpage browsing instruction triggered on a browser by a mobile client to obtain a corresponding webpage; parsing the webpage to obtain a DOM node of a tag in a webpage script; obtaining a plug-in tag node from the DOM node; and when a plug-in tag corresponding to the plug-in tag node is a predetermined type tag, extracting a plug-in resource that corresponds to the plug-in tag. The present method can complete extracting of content that complies with a specific protocol specification when a webpage has not been truly rendered, thereby improving a speed of extracting predetermined webpage content and also improving a webpage display speed.
1. A method for extracting webpage content performed at a terminal having one or more processors and a memory for storing programs to be executed by the processors, the method comprising:
responding to a webpage browsing instruction triggered on a browser by a mobile client to obtain a corresponding webpage;
detecting whether an existing predetermined rule within a script code on the terminal for extracting a plug-in resource that corresponds to a predetermined type tag is updated to facilitate dynamic configuration of the existing predetermined rule by a background server;
at a time when the existing predetermined rule for extracting a plug-in resource that corresponds to a predetermined type tag is updated, obtaining an updated predetermined rule from the background server of the browser, the updated predetermined rule including a regular expression rule;
after obtaining the updated predetermined rule, parsing the webpage to obtain a document object model (DOM) node of a tag in a webpage script;
obtaining a plug-in tag node from the DOM node;
when a plug-in tag corresponding to the plug-in tag node is a predetermined type tag, extracting a plug-in resource that corresponds to the plug-in tag;
when the plug-in tag corresponding to the plug-in tag node is not the predetermined type tag, matching a plug-in resource that corresponds to the predetermined type tag of the webpage script by using the updated predetermined rule; and
after the matching succeeds, extracting the plug-in resource that corresponds to the predetermined type tag from the webpage script.
2. The method according to claim 1 , wherein the browser supports a plug-in resource protocol that adapts to the updated predetermined rule.
3. The method according to claim 1 , wherein the parsing the webpage to obtain a DOM node of a tag in a webpage script comprises:
parsing the webpage to generate a DOM tree; and
creating a DOM node, in the DOM tree, for each tag in the webpage script.
4. The method according to claim 1 , further comprising:
transmitting the plug-in resource to a corresponding player for playing.
5. A terminal for extracting webpage content, comprising:
one or more processors;
a memory, wherein the memory stores instructions that when executed by the one or more processors cause the one or more processors to:
respond to a webpage browsing instruction triggered on a browser by a mobile client to obtain a corresponding webpage;
detect whether an existing predetermined rule within a script code on the terminal for extracting a plug-in resource that corresponds to a predetermined type tag is updated to facilitate dynamic configuration of the existing predetermined rule by a background server;
at a time when the existing predetermined rule for extracting a plug-in resource that corresponds to a predetermined type tag is updated, obtain an updated predetermined rule from the background server of the browser, the updated predetermined rule including a regular expression rule;
after obtaining the updated predetermined rule, parse the webpage to obtain a DOM node of a tag in a webpage script;
obtain a plug-in tag node from the DOM node;
when a plug-in tag corresponding to the plug-in tag node is a predetermined type tag, extract a plug-in resource that corresponds to the plug-in tag;
when the plug-in tag corresponding to the plug-in tag node is not the predetermined type tag, match a plug-in resource that corresponds to the predetermined type tag of the webpage script by using the updated predetermined rule; and
after the matching succeeds, extract the plug-in resource that corresponds to the predetermined type tag from the webpage script.
6. The terminal according to claim 5 , wherein the browser supports a plug-in resource protocol that adapts to the updated predetermined rule.
7. The terminal according to claim 5 , wherein the instructions are further configured to cause the one or more processors to:
parse the webpage to generate a DOM tree; and create a DOM node, in the DOM tree, for each tag in the webpage script.
8. The terminal according to claim 5 , wherein the instructions are further configured to cause the one or more processors to:
transmit the plug-in resource to a corresponding player for playing.
9. Non-transitory storage media, comprising computer program codes for executing a process of:
at a terminal:
responding to a webpage browsing instruction triggered on a browser by a mobile client to obtain a corresponding webpage;
detecting whether an existing predetermined rule within a script code on the terminal for extracting a plug-in resource that corresponds to a predetermined type tag is updated to facilitate dynamic configuration of the existing predetermined rule by a background server;
at a time when the existing predetermined rule for extracting a plug-in resource that corresponds to a predetermined type tag is updated, obtaining an updated predetermined rule from the background server of the browser, the updated predetermined rule including a regular expression rule;
after obtaining the updated predetermined rule, parsing the webpage to obtain a document object model (DOM) node of a tag in a webpage script;
obtaining a plug-in tag node from the DOM node;
when a plug-in tag corresponding to the plug-in tag node is a predetermined type tag, extracting a plug-in resource that corresponds to the plug-in tag;
when the plug-in tag corresponding to the plug-in tag node is not the predetermined type tag, matching a plug-in resource that corresponds to the predetermined type tag of the webpage script by using the updated predetermined rule; and
after the matching succeeds, extracting the plug-in resource that corresponds to the predetermined type tag from the webpage script.
10. The non-transitory storage media according to claim 9 , wherein the browser supports a plug-in resource protocol that adapts to the updated predetermined rule.
11. The non-transitory storage media according to claim 9 , wherein the parsing the webpage to obtain a DOM node of a tag in a webpage script comprises:
parsing the webpage to generate a DOM tree; and
creating a DOM node, in the DOM tree, for each tag in the webpage script.
12. The non-transitory storage media according to claim 9 , wherein the process further comprises:
transmitting the plug-in resource to a corresponding player for playing.