IP Library Granted Patent US 9,792,365
Granted Patent B2
US 9,792,365 · App. 14/584,384 · Granted Oct 17, 2017

Method and system for tracking and gathering multivariate testing data

Inventor: Arik Yavilevich (Ashdod, IL)
Assignee: ClickTale Ltd.
G06F17/30864G06F17/3089G06F17/30867G06F17/30893H04L67/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,792,365
App. No.
14/584,384
Granted
Oct 17, 2017
Kind
B2
Abstract

A system and method for tracking and gathering data respective of multivariate testing on a plurality of webpages are provided. The method includes crawling through a plurality of servers hosting the plurality of webpages; for each uniform resource locator (URL) of a webpage of the plurality of webpages encountered during the crawling: sending a request to download the webpage identified by the URL; downloading at least one page view of the webpage; analyzing the at least one downloaded page view to identify data related to at least a multivariate test; and saving data identifying the at least a multivariate test performed in the plurality of webpages in a data store.

Claims (73)

1. A method for tracking and gathering data respective of multivariate testing on a plurality of webpages, comprising:

crawling through a plurality of servers hosting the plurality of webpages;

for each uniform resource locator (URL) of a webpage of the plurality of webpages encountered during the crawling:

sending a request to download the webpage identified by the URL;

downloading at least one page view of the webpage;

analyzing the at least one downloaded page view to identify data related to at least a multivariate test; and

saving data identifying the at least multivariate test performed in the plurality of webpages in a data store.

2. The method of claim 1 , further comprising:

filtering the URLs encountered during the crawling;

saving a set of filtered URLs; and

processing only the set of filtered URLs.

3. The method of claim 1 , wherein sending the request to download the webpage identified by the URL further comprises:

causing at least one virtual client to send the request, wherein each virtual client downloads a different page view of the webpage.

4. The method of claim 1 , wherein sending the request to download the webpage identified by the URL further comprises:

causing a single client to send the request at predefined time intervals to render different multiple page views at different timings.

5. The method of claim 1 , wherein analyzing the at least one downloaded page view further comprises:

scanning the at least one downloaded page view to detect changes among page views associated with webpages of the plurality of webpages, wherein the changes are related to at least one of: appearances over time, and content displayed in the page views.

6. The method of claim 5 , further comprising:

generating a unique sample for each page view by removing unique elements included in each page view;

checking if the unique samples are generated in a sequential order;

determining that the at least a multivariate test is not performed, when the unique samples are generated in a sequential order; and

computing a frequency of occurrence of each of the unique samples, when the at least a multivariate test is performed.

7. The method of claim 1 , wherein analyzing the at least one downloaded page view further comprises:

scanning the at least one downloaded page view to detect testing coded embedded by a testing service provider.

8. The method of claim 1 , further comprising:

sending a request to the testing service provider to receive a resource file respective of the URL;

capturing a response sent from the testing service provider; and

inspecting the response to detect data related to the at least a multivariate test, wherein the data included in the response specifies at least goals, tests, variations, and segments.

9. The method of claim 1 , wherein the data related to the at least a multivariate test includes at least one of: a test identifier (ID), a test start time, a testing service provider, a website under testing, tested variations, a test goal, a value of the test goal, a selected webpage variation, and attributes of the webpage variant.

10. The method of claim 9 , wherein the at least a multivariate test further includes any one of: A/B tests, and split tests.

11. The method of claim 1 , further comprising:

analyzing the data saved in the database to provide various analytical measures about users' preferences with respect to each of the plurality of websites.

12. A non-transitory computer readable medium having stored thereon instructions for causing one or more processing units to execute a process for tracking and gathering data respective of multivariate testing on a plurality of webpages, the process comprising:

crawling through a plurality of servers hosting the plurality of webpages;

for each uniform resource locator (URL) of a webpage of the plurality of webpages encountered during the crawling:

sending a request to download the webpage identified by the URL;

downloading at least one page view of the webpage;

analyzing the at least one downloaded page view to identify data related to at least a multivariate test; and

saving data identifying the at least multivariate test performed in the plurality of webpages in a data store.

13. A system for tracking and gathering data respective of multivariate testing on a plurality of webpages, comprising:

a processing system; and

a memory coupled to the processing system, the memory containing instructions that, when executed by the processor, configure the system to:

crawl through a plurality of servers hosting the plurality of webpages;

for each uniform resource locator (URL) of a webpage of the plurality of webpages encountered during the crawling:

send a request to download the webpage identified by the URL;

download at least one page view of the webpage;

analyze the at least one downloaded page view to identify data related to at least a multivariate test; and

save data identifying the at least multivariate test performed in the plurality of webpages in a data store.

14. The system of claim 13 , wherein the system is further configured to:

filter the URLs encountered during the crawling;

save a set of filtered URLs; and

process only the set of filtered URLs.

15. The system of claim 13 , wherein the system is further configured to:

cause at least one virtual client to send the request, wherein each virtual client downloads a different page view of the webpage.

16. The system of claim 13 , wherein the system is further configured to:

cause a single client to send the request at predefined time intervals to render different multiple page views at different timings.

17. The system of claim 13 , wherein the system is further configured to:

scan the downloaded page views to detect changes among the page views, wherein the changes are related to at least one of: appearances over time, and content displayed in the page views.

18. The system of claim 17 , wherein the system is further configured to:

generate a unique sample for each page view by removing unique elements included in each page view;

check if the unique samples are generated in a sequential order;

determine that the at least a multivariate test is not performed, when the unique samples are generated in a sequential order; and

compute a frequency of occurrence of each of the unique samples, when the at least a multivariate test is performed.

19. The system of claim 13 , wherein the system is further configured to:

scan the downloaded page views to detect testing coded embedded by a testing service provider.

20. The system of claim 13 , wherein the system is further configured to:

send a request to the testing service provider to receive a resource file respective of the URL;

capture a response sent from the testing service provider; and

inspect the response to detect data related to at least a multivariate test, wherein the data included in the response specifies at least goals, tests, variations, and segments.

21. The system of claim 13 , wherein the data related to the at least a multivariate test includes any of: a test identifier (ID), a test start time, a testing service provider, a website under testing, tested variations, a test goal, a value of the test goal, a selected webpage variation, and attributes of the webpage variant.

22. The system of claim 21 , wherein the at least a multivariate test further includes any one of: A/B tests, and split tests.

23. The system of claim 13 , wherein the system is further configured to:

analyze the data saved in the database to provide various analytical measures about users' preferences with respect to each of the plurality of websites.

Assignments (8)
CHANGE OF NAME Recorded Jan 26, 2021
From: CLICKTALE LTD.
To: CONTENT SQUARE ISRAEL LTD.
Reel/Frame 055118/0286 →
RELEASE OF SECURITY INTEREST Recorded Oct 26, 2020
From: BANK LEUMI LE-ISRAEL B.M.
To: CLICKTALE LTD.
Reel/Frame 054203/0248 →
RELEASE OF SECURITY INTEREST Recorded Feb 6, 2019
From: SILICON VALLEY BANK
To: CLICKTALE LTD.
Reel/Frame 048264/0432 →
SECURITY INTEREST Recorded Jun 28, 2018
From: CLICKTALE LTD.
To: KREOS CAPITAL V (EXPERT FUND) L.P.
Reel/Frame 046222/0581 →
SECURITY INTEREST Recorded Jun 26, 2018
From: CLICKTALE LTD.
To: BANK LEUMI LE-ISRAEL B.M.
Reel/Frame 046197/0698 →
SECURITY INTEREST Recorded Dec 7, 2016
From: CLICKTALE LTD.
To: SILICON VALLEY BANK
Reel/Frame 040588/0765 →
SECURITY AGREEMENT Recorded Apr 6, 2016
From: CLICKTALE LTD
To: SILICON VALLEY BANK
Reel/Frame 038372/0406 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2014
From: YAVILEVICH, ARIK
To: CLICKTALE LTD.
Reel/Frame 034594/0005 →
Continuity (2)
Provisional Application 61922342 · Dec 31, 2013
Related Publication 20150186521A1 · Jul 2, 2015