Selective website vulnerability and infection testing
In embodiments of the present invention improved capabilities are described for selective website vulnerability and infection testing and intelligently paced rigorous direct website testing. By providing robust website content integrity checking while only lightly loading the website hosting server, visitor bandwidth availability is maintained through selective testing and intelligently paced external website exercising. A modular pod-based computing architecture of interconnected severs configured with a sharded database facilitates selective website testing and intelligent direct website test pacing while providing scalability to support large numbers of website testing subscribers.
1. A method of selective website page vulnerability and infection testing, comprising:
identifying, based on a profile of a subscriber to a hosting plan for a website, a window in which selective vulnerability and infection testing in an invocation instance of the website is to be performed;
upon determining that the window for selective vulnerability and infection testing is open, distributing the testing over a period of discrete time frames to reduce testing bandwidth consumption by, for each time frame:
determining a maximum permissible number of website pages of a website to test for vulnerabilities and infection by analyzing the profile, wherein the profile includes the maximum permissible number of pages in the website to test;
determining a first subset of pages of the website to test based on the determined maximum permissible number, wherein a count of pages in the first subset of pages is less than the maximum permissible number of pages of the website to test;
selecting a second subset of pages of the website from the first subset based on a page-test-maximum threshold parameter of the website hosting subscriber profile wherein the page-test-maximum threshold is a minimum permissible number of pages of the website to test; and
applying selective vulnerability and infection testing in the invocation instance of website testing to a portion of the second subset.
2. The method of claim 1 , wherein the page-test-maximum threshold parameter value applies to a single invocation of infection and vulnerability testing of the website.
3. The method of claim 1 , wherein the page-test-maximum threshold value limits the number of website pages being tested independent of a count of invocations of infection and vulnerability testing of the website.
4. The method of claim 1 , wherein the second subset of pages of the website selected is based on analysis of links in pages in the first subset of pages of the website.
5. The method of claim 4 , wherein the analysis of links includes at least one of an infection status of a webpage that may be identified by a link, an analysis of historical data of the link, a length of URL associated with the link, similarity of the links, and a location of a link on the website page.
6. The method of claim 1 , wherein the second subset of pages is further limited based on a hosting architecture of a host system hosting the website.
7. The method of claim 1 , wherein the second subset of pages is further limited only for websites that are commonly hosted with other websites.
8. The method of claim 1 , further comprising configuring a pacing of the selective website vulnerability and infection testing based on the maximum permissible number of website pages allowed for testing.
9. The method of claim 1 , wherein the second subset of website pages is based on a links per page limit specified in the subscriber profile.
10. The method of claim 1 , wherein the second subset of website pages is further limited by a client direction.
11. The method of claim 10 , wherein the number of website pages in the second subset is increased with each scan invocation based on the client direction.
12. A system for selective website page vulnerability and infection testing, comprising:
a processor; and
a memory having programming instructions stored thereon, which, when executed by the processor, performs one or more operations comprising:
identifying, based on a profile of a subscriber to a hosting plan for a website, a window in which selective vulnerability and infection testing in an invocation instance of the website is to be performed; and
upon determining that the window for selective vulnerability and infection testing is open, distributing the testing over a period of discrete time frames to reduce testing bandwidth consumption by, for each time frame:
determining a maximum permissible number of website pages of a website to test for vulnerabilities and infection that is determined by analyzing the profile of the subscriber, wherein the profile includes a maximum permissible number of pages in the website;
determining a first subset of pages of the website to test based on the determined maximum permissible number, wherein a count of pages in the first subset of pages is less than the maximum permissible number of pages of the website to test;
selecting a second subset of pages of the website on a page-test-maximum threshold parameter of the website hosting subscriber profile, wherein the page-test-maximum threshold is a minimum permissible number of pages of the website to test; and
applying selective vulnerability and infection testing in the invocation instance of website testing to a portion of the subset based.
13. The system of claim 12 , wherein the system further comprises a sharded database that stores subscriber website testing information, including a description of the subset of website pages to test.
14. The system of claim 12 , wherein the second subset of website pages is substantially fewer than the maximum permissible number of pages to be scanned.
15. The system of claim 12 , wherein the page-test-maximum threshold parameter value applies to a single invocation of infection and vulnerability testing of the website.
16. The system of claim 12 , wherein the page-test-maximum threshold value limits the number of website pages being tested independent of a count of invocations of infection and vulnerability testing of the website.
17. The system of claim 12 , wherein the second subset of pages of the website selected is based on analysis of links in pages of the website.
18. The system of claim 17 , wherein the analysis of links includes at least one of an infection status of a webpage that may be identified by a link, an analysis of historical data of the link, a length of URL associated with the link, similarity of the links, and a location of a link on the website page.
19. The system of claim 12 , wherein the second subset of pages is further limited based on a hosting architecture of a host system hosting the website.
20. The system of claim 12 , wherein the second subset of pages is further limited only for websites that are commonly hosted with other websites.
21. The system of claim 12 , further comprising configuring a pacing of the selective website vulnerability and infection testing based on the maximum permissible number of website pages allowed for testing.
22. The system of claim 12 , wherein the second subset of website pages is based on a links per page limit specified in the subscriber profile.
23. The system of claim 12 , wherein the second subset of website pages is further limited by a client direction.
24. The system of claim 23 , wherein the number of website pages in the second subset is increased with each scan invocation based on the client direction.