IP Library Granted Patent US 11,375,445
Granted Patent B2
US 11,375,445 · App. 16/914,729 · Granted Jun 28, 2022

Technologies for detecting and analyzing user interaction tests for network-accessible content

Inventors: Emilio Andres Glusman (Middletown, NJ); William Howard (Brooklyn, NY)
Assignee: Do What Works, LLC
H04W48/18G06V20/52H04L67/02H04N7/181H04W48/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,375,445
App. No.
16/914,729
Granted
Jun 28, 2022
Kind
B2
Abstract

Technologies for detecting and analyzing user interaction tests for network-accessible content include a compute device. The compute device includes circuitry configured to obtain samples of network-accessible content. The circuitry is additionally configured to determine, based on the obtained samples, whether multiple variants of the network-accessible content are present. Further, the circuitry is configured to monitor, in response to a determination that multiple variants are present, a statistical user interaction test associated with the variants, including detecting a final variant and discontinuation of other variants in the statistical user interaction test. Additionally, the circuitry is configured to provide data indicative of the detected final variant of the network-accessible content.

Claims (35)

1. A compute device comprising:

circuitry to:

obtain samples of network-accessible content;

determine, based on the obtained samples, whether multiple variants of the network-accessible content are present;

monitor, in response to a determination that multiple variants are present, a statistical user interaction test to measure an effectiveness of each variant of the network-accessible content in obtaining a predefined user response, including detecting a final variant and discontinuation of other variants in the statistical user interaction test; and

provide data indicative of the detected final variant of the network-accessible content.

2. The compute device of claim 1 , wherein the circuitry is further to provide data indicative of patterns among final variants from multiple statistical user interaction tests.

3. The compute device of claim 2 , wherein to provide the data indicative of patterns comprises to produce tag data indicative of a component of the network-accessible content that differs between variants and produce description data that describes a difference between the variants.

4. The compute device of claim 1 , wherein to obtain samples of the network-accessible content comprises to (i) redact, from source code of the network-accessible content, one or more components unrelated to the display of the content including a tracking script or tracking pixel or (ii) perform operations to obtain consistent samples, including removing, from source code of the network-accessible content, one or more elements that produce random output including pausing at least one animation or stopping a video at a first frame.

5. The compute device of claim 1 , wherein the circuitry is further to compare the samples to each other to determine whether variants are present.

6. The compute device of claim 5 , wherein to compare the samples comprises to:

compare rendered text in each sample; and

compare rendered source code with components unrelated to display of the network-accessible content removed.

7. The compute device of claim 6 , wherein the circuitry is further to store, in response to a determination that the rendered text and rendered source code are the same among the samples, data indicating that the samples are the same.

8. The compute device of claim 6 , wherein the circuitry is further to perform, in response to a determination that the rendered text or the rendered source code differs among the samples, a rendered image comparison of the samples.

9. The compute device of claim 8 , wherein to perform a rendered image comparison comprises to perform a pixel-by-pixel comparison and determine whether a predefined threshold number of pixels differ between the samples.

10. The compute device of claim 1 , wherein to obtain samples of the network-accessible content comprises to access the network-accessible content using a headless browser.

11. The compute device of claim 10 , wherein to obtain samples of the network-accessible content comprises to access the network-accessible content using a new headless browser session for each access.

12. The compute device of claim 10 , wherein to obtain samples of the network-accessible content comprises to access the network-accessible content from a range of source addresses.

13. The compute device of claim 1 , wherein to obtain the samples comprises to access the network-accessible content at a first frequency and wherein to monitor the statistical user interaction test comprises to access the network-accessible content at a second frequency that is greater than the first frequency.

14. One or more machine-readable storage media comprising a plurality of instructions stored thereon that, in response to being executed, cause a compute device to:

obtain samples of network-accessible content;

determine, based on the obtained samples, whether multiple variants of the network-accessible content are present;

monitor, in response to a determination that multiple variants are present, a statistical user interaction test to measure an effectiveness of each variant of the network-accessible content in obtaining a predefined user response, including detecting a final variant and discontinuation of other variants in the statistical user interaction test; and

provide data indicative of the detected final variant of the network-accessible content.

15. The one or more machine-readable storage media of claim 14 , wherein the instructions additionally cause the compute device to provide data indicative of patterns among final variants from multiple statistical user interaction tests.

16. The one or more machine-readable storage media of claim 15 , wherein to provide the data indicative of patterns comprises to produce tag data indicative of a component of the network-accessible content that differs between variants and produce description data that describes a difference between the variants.

17. The one or more machine-readable storage media of claim 14 , wherein to obtain samples of the network-accessible content comprises to (i) redact, from source code of the network-accessible content, one or more components unrelated to the display of the content including a tracking script or tracking pixel or (ii) perform operations to obtain consistent samples, including removing, from source code of the network-accessible content, one or more elements that produce random output including pausing at least one animation or stopping a video at a first frame.

18. The one or more machine-readable storage media of claim 14 , wherein the instructions additionally cause the compute device to compare the samples to each other to determine whether variants are present.

19. A method comprising:

obtaining, by a compute device, samples of network-accessible content;

determining, by the compute device and based on the obtained samples, whether multiple variants of the network-accessible content are present;

monitoring, by the compute device and in response to a determination that multiple variants are present, a statistical user interaction test to measure an effectiveness of each variant of the network-accessible content in obtaining a predefined user response, including detecting a final variant and discontinuation of other variants in the statistical user interaction test; and

providing, by the compute device, data indicative of the detected final variant of the network-accessible content.

20. The method of claim 19 , further comprising providing data indicative of patterns among final variants from multiple statistical user interaction tests.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2020
From: GLUSMAN, EMILIO ANDRES; HOWARD, WILLIAM
To: DO WHAT WORKS, LLC
Reel/Frame 053072/0025 →
Continuity (1)
Related Publication 20210410056A1 · Dec 30, 2021
Cited By (1)
US 12,321,414