Method and system for network access request control
Embodiments of the present application provide a method and system for network access request control. During operation, the system may identify a network access request received by a website. The system may determine a type of the network access request, and control the network access request according to the type of the network access request. The type of the network access request can be one of a user access request, a crawler access request, or an invalid access request. Based on the type of the network access request and/or the access requests overall compared to a cluster stability threshold, the system may take measures to throttle the access requests or otherwise adjust a throttling policy. The system may take measures such as demoting a service to a lower priority, rejecting execution of an access request, redirecting an access request to another service cluster, and expanding a physical layer of a service cluster.
1. A computer-implemented method for network access request control, comprising:
receiving, from a requesting party, a network request to access a webpage;
determining whether a type of the network request is a user access request type;
in response to determining that the network request is a user access request type, determining an Internet protocol (IP) address of a service cluster for responding to the network request based on a traffic throttling policy of a domain name system layer;
sending the network request to a web server layer of the service cluster corresponding to the IP address;
determining whether the network request triggers a throttling policy of the web server layer;
in response to determining that the network request triggers a throttling policy of the web server layer, sending a rejection to the requesting party; and
in response to determining that the network request does not trigger a throttling policy of the web server layer, processing the network request, which involves:
determining that an internal service logic of the network request depends on other services;
sequentially verifying whether one or more service invocations relied upon by the internal service logic of the network request meets demotion policy requirements;
responsive to determining that a first service invocation relied upon by the internal service logic of the network request meets demotion policy requirements, demoting the first service invocation;
responsive to determining that the demoted first service invocation has service logic priority not higher than a predetermined threshold, directly completing the demoted first service invocation without additional processing; and
responsive to determining that the demoted first service invocation has service logic priority higher than the predetermined threshold, executing traffic throttling fallback logic for the demoted first service invocation, and completing the demoted first service invocation.
2. The method of claim 1 , wherein processing the network request further comprises:
responsive to determining that the network request does not trigger a throttling policy of a page application layer, and that an internal service logic of the network request does not rely on other services, continuing to execute page service logic, and returning a page requested by the network request.
3. The method of claim 1 , wherein determining the IP address of the service cluster further comprises:
responsive to determining that a traffic throttling threshold of a default service cluster is reached, returning an entry IP address of a service cluster other than the default service cluster according to priority settings; and
responsive to determining that the traffic throttling threshold of the default service cluster is not yet reached, returning the entry IP address of the default service cluster.
4. The method of claim 1 , wherein processing the network request further comprises:
determining that the network request triggers a throttling policy of a page application layer;
rejecting execution of the network request; and
notifying that traffic throttling is being performed for the network request.
5. The method of claim 1 , wherein after sequentially verifying whether the one or more service invocations relied upon by the internal service logic of the network request meets the demotion policy requirements, the method further comprises:
responsive to determining that a second service invocation relied upon by the internal service logic of the network request does not meet the demotion policy requirements, determining whether the second service invocation triggers a throttling policy of a service application layer;
responsive to determining that the second service invocation triggers the throttling policy of the service application layer, executing the throttling policy, and throttling the second service invocation; and
responsive to determining that the second service invocation does not trigger the throttling policy of the service application layer, executing an internal logic of the second service invocation.
6. The method of claim 1 , further comprising:
receiving a second network request, wherein the second network request is a crawler access request type.
7. The method of claim 1 , further comprising:
receiving a second network request, wherein the second network request is a is an invalid access request type.
8. The method of claim 1 , further comprising:
obtaining current information regarding access requests overall for a service cluster;
determining whether the access requests overall are greater than a cluster stability threshold; and
responsive to determining that the access requests overall are not greater than the cluster stability threshold, completing an adjustment of a throttling policy.
9. The method of claim 8 , further comprising:
responsive to determining that the access requests overall are greater than the cluster stability threshold, determining whether a particular network request for the service cluster may be redirected to another service cluster; and
responsive to determining that the particular network request for the service cluster may be redirected to another service cluster, redirecting the particular network request for the service cluster to another service cluster according to priority settings.
10. A computing system comprising:
one or more processors;
a memory; and
a non-transitory computer-readable medium coupled to the one or more processors storing instructions stored that, when executed by the one or more processors, cause the computing system to perform a method for network access request control, the method comprising:
receiving, from a requesting party, a network request to access a webpage;
determining whether a type of the network request is a user access request type;
in response to determining that the network request is a user access request type, determining an Internet protocol (IP) address of a service cluster for responding to the network request based on a traffic throttling policy of a domain name system layer;
sending the network request to a web server layer of the service cluster corresponding to the IP address;
determining whether the network request triggers a throttling policy of the web server layer;
in response to determining that the network request triggers a throttling policy of the web server layer, sending a rejection to the requesting party; and
in response to determining that the network request does not trigger a throttling policy of the web server layer, processing the network request, which involves:
determining that an internal service logic of the network request depends on other services;
sequentially verifying whether one or more service invocations relied upon by the internal service logic of the network request meets demotion policy requirements;
responsive to determining that a first service invocation relied upon by the internal service logic of the network request meets demotion policy requirements, demoting the first service invocation;
responsive to determining that the demoted first service invocation has service logic priority not higher than a predetermined threshold, directly completing the demoted first service invocation without additional processing; and
responsive to determining that the demoted first service invocation has service logic priority higher than the predetermined threshold, executing traffic throttling fallback logic for the demoted first service invocation, and completing the demoted first service invocation.
11. The computing system of claim 10 , wherein processing the network request further comprises:
responsive to determining that the network request does not trigger a throttling policy of a page application layer, and that an internal service logic of the network request does not rely on other services, continuing to execute page service logic, and returning a page requested by the network request.
12. The computing system of claim 10 , wherein determining the IP address of the service cluster further comprises:
responsive to determining that a traffic throttling threshold of a default service cluster is reached, returning an entry IP address of a service cluster other than the default service cluster according to priority settings; and
responsive to determining that the traffic throttling threshold of the default service cluster is not yet reached, returning the entry IP address of the default service cluster.
13. The computing system of claim 10 , wherein processing the network request further comprises:
determining that the network request triggers a throttling policy of a page application layer;
rejecting execution of the network request; and
notifying that traffic throttling is being performed for the network request.
14. The computing system of claim 10 , wherein after sequentially verifying whether the one or more service invocations relied upon by the internal service logic of the network request meets the demotion policy requirements, the method further comprises:
responsive to determining that a second service invocation relied upon by the internal service logic of the network request does not meet the demotion policy requirements, determining whether the second service invocation triggers a throttling policy of a service application layer;
responsive to determining that the second service invocation triggers the throttling policy of the service application layer, executing the throttling policy, and throttling the second service invocation; and
responsive to determining that the second service invocation does not trigger the throttling policy of the service application layer, executing an internal logic of the second service invocation.
15. The computing system of claim 10 , wherein the method further comprises:
obtaining current information regarding access requests overall for a service cluster;
determining whether the access requests overall are greater than a cluster stability threshold; and
responsive to determining that the access requests overall are not greater than the cluster stability threshold, completing an adjustment of a throttling policy.
16. A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for network access request control, the method comprising:
receiving, from a requesting party, a network request to access a webpage;
determining whether a type of the network request is a user access request type;
in response to determining that the network request is a user access request type, determining an Internet protocol (IP) address of a service cluster for responding to the network request based on a traffic throttling policy of a domain name system layer;
sending the network request to a web server layer of the service cluster corresponding to the IP address;
determining whether the network request triggers a throttling policy of the web server layer;
in response to determining that the network request triggers a throttling policy of the web server layer, sending a rejection to the requesting party; and
in response to determining that the network request does not trigger a throttling policy of the web server layer, processing the network request, which involves:
determining that an internal service logic of the network request depends on other services;
sequentially verifying whether one or more service invocations relied upon by the internal service logic of the network request meets demotion policy requirements;
responsive to determining that a first service invocation relied upon by the internal service logic of the network request meets demotion policy requirements, demoting the first service invocation;
responsive to determining that the demoted first service invocation has service logic priority not higher than a predetermined threshold, directly completing the demoted first service invocation without additional processing; and
responsive to determining that the demoted first service invocation has service logic priority higher than the predetermined threshold, executing traffic throttling fallback logic for the demoted first service invocation, and completing the demoted first service invocation.
17. The non-transitory storage medium of claim 16 , wherein after sequentially verifying whether the one or more service invocations relied upon by the internal service logic of the network request meets the demotion policy requirements, the method further comprises:
responsive to determining that a second service invocation relied upon by the internal service logic of the network request does not meet the demotion policy requirements, determining whether the second service invocation triggers a throttling policy of a service application layer;
responsive to determining that the second service invocation triggers the throttling policy of the service application layer, executing the throttling policy, and throttling the second service invocation; and
responsive to determining that the second service invocation does not trigger the throttling policy of the service application layer, executing an internal logic of the second service invocation.
18. The non-transitory storage medium of claim 16 , wherein the method further comprises:
obtaining current information regarding access requests overall for a service cluster;
determining whether the access requests overall are greater than a cluster stability threshold;
responsive to determining that the access requests overall are not greater than the cluster stability threshold, completing an adjustment of a throttling policy;
responsive to determining that the access requests overall are greater than the cluster stability threshold, determining whether a particular network request for the service cluster may be redirected another service cluster; and
responsive to determining that the particular network request for the service cluster may be redirected to another service cluster, redirecting the particular network request for the server cluster to another service cluster according to priority settings.