IP Library › Granted Patent US 12,118,436
Granted Patent B2
US 12,118,436 · App. 17/156,069 · Granted Oct 15, 2024

Automated user application tracking and validation

Inventors: Dustin Stefan Hamerla (Kew Gardens, NY); Abrasham Chowdhury (North Babylon, NY); Christopher Adam Boyle (Wayne, NJ); Joseph H. I. Bird (Staten Island, NY); Melissa Ashley Moyer (New York, NY); Kyle Patrick Baker (Brooklyn, NY); Taylor C. Wells (New York, NY); Vaibhav Jajoo (Fremont, CA)
Assignee: Disney Enterprises, Inc.
G06N20/00G06F3/0481G06F11/3438G06F18/214G06F18/217
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,118,436
App. No.
17/156,069
Granted
Oct 15, 2024
Kind
B2
Abstract

A system includes a computing platform including a hardware processor and a system memory storing a software code. The hardware processor is configured to execute the software code to track interactions with a user application during use of the user application, generate, based on tracking the interactions, interaction data identifying multiple interaction events during the use, and perform a validity assessment of the interaction data. The hardware processor is further configured to execute the software code to identify, based on the validity assessment, one or more anomalies in the interaction data, and output, based on identifying the one or more anomalies in the interaction data, one or more of the interaction events corresponding respectively to the one or more anomalies.

Claims (44)

1. A system comprising:

a computing platform including a hardware processor and a system memory storing a software code;

the hardware processor configured to execute the software code to:

track interactions with a user application during a use of the user application;

generate, based on tracking the interactions, interaction data identifying a plurality of interaction events during the use, the interaction data including a plurality of states of the user application each corresponding to one of the plurality of interaction events, wherein each of the plurality of states of the user application is assigned at least one key that is included in the interaction data to link the plurality of states to recreate the interactions of the user;

perform a validity assessment of the interaction data;

identify, based on the validity assessment, one or more anomalies in the interaction data; and

output, based on identifying the one or more anomalies in the interaction data, one or more of the plurality of interaction events corresponding respectively to the one or more anomalies.

2. The system of claim 1 , wherein the hardware processor is configured to perform the validity assessment in response to the use of the user application by a user emulation bot, wherein the plurality of interactions are scripted interactions executed by the user emulation bot.

3. The system of claim 1 , wherein the user application is configured to provide a graphical user interface (GUI), and wherein the plurality of states include a display state of the GUI.

4. The system of claim 3 , wherein the at least one key includes a primary key and a foreign key assigned to the display state of the GUI.

5. The system of claim 1 , wherein the plurality of interaction events include at least one of a page view, a click-through, a scrolling input, a text entry, a menu selection, or a return-to-previous-page input.

6. The system of claim 1 , wherein the hardware processor is further configured to execute the software code to perform the validity assessment using a sequence of the plurality of interaction events, by:

generating an interaction vector corresponding to the sequence; and

determining a validity score for the interaction vector.

7. The system of claim 6 , wherein the hardware processor is further configured to execute the software code to perform the validity assessment by:

identifying an expected-value vector using a first interaction event of the sequence; and

comparing the interaction vector to the expected-value vector to determine the validity score for the interaction vector.

8. The system of claim 6 , wherein the validity score is determined by applying the interaction vector to an anomaly prediction model.

9. The system of claim 6 , wherein, for each interaction event of the plurality of interaction events of the sequence, the interaction vector encodes a first instance of the each interaction event in the sequence and a cumulative sum of instances of the each interaction event in the sequence.

10. The system of claim 1 , wherein the hardware processor is further configured to execute the software code to:

train an anomaly prediction machine learning model, using the one or more of the plurality of interaction events corresponding respectively to the one or more anomalies;

wherein the validity assessment of the interaction data is performed using the anomaly prediction machine learning model.

11. A method for use by a system including a computing platform having a hardware processor and a system memory storing a software code, the method comprising:

tracking, by the software code executed by the hardware processor, interactions with a user application during a use of the user application;

generating, by the software code executed by the hardware processor and based on tracking the interactions, interaction data identifying a plurality of interaction events during the use, the interaction data including a plurality of states of the user application each corresponding to one of the plurality of interaction events, wherein each of the plurality of states of the user application is assigned at least one key that is included in the interaction data to link the plurality of states to recreate the interactions of the user;

performing, by the software code executed by the hardware processor and using the validation subsystem, a validity assessment of the interaction data;

identifying, by the software code executed by the hardware processor and based on the validity assessment, one or more anomalies in the interaction data; and

outputting, by the software code executed by the hardware processor and based on identifying the one or more anomalies in the interaction data, one or more of the interaction events corresponding respectively to the one or more anomalies.

12. The method of claim 11 , wherein the hardware processor is configured to perform the validity assessment in response to the use of the user application by a user emulation bot, wherein the plurality of interactions are scripted interactions executed by the user emulation bot.

13. The method of claim 11 , wherein the user application is configured to provide a graphical user interface (GUI), and wherein the plurality of states include a display state of the GUI.

14. The method of claim 13 , wherein the at least one key includes a primary key and a foreign key assigned to the display state of the GUI.

15. The method of claim 11 , wherein the plurality of interaction events include at least one of a page view, a click-through, a scrolling input, a text entry, a menu selection, or a return-to-previous-page input.

16. The method of claim 11 , wherein the validity assessment is performed using a sequence of the plurality of interaction events, by:

generating, by the software code executed by the hardware processor, an interaction vector corresponding to the sequence; and

determining, by the software code executed by the hardware processor, a validity score for the interaction vector.

17. The method of claim 16 , wherein the validity assessment is further performed by:

identifying, by the software code executed by the hardware processor, an expected-value vector using a first interaction event of the sequence; and

comparing, by the software code executed by the hardware processor, the interaction vector to the expected-value vector to determine the validity score for the interaction vector.

18. The method of claim 16 , wherein the validity score is determined by applying the interaction vector to an anomaly prediction model.

19. The method of claim 16 , wherein, for each interaction event of the plurality of interaction events of the sequence, the interaction vector encodes a first instance of the each interaction event in the sequence and a cumulative sum of instances of the each interaction event in the sequence.

20. The method of claim 11 , further comprising:

training an anomaly prediction machine learning model, using the one or more of the plurality of interaction events corresponding respectively to the one or more anomalies;

wherein performing the validity assessment of the interaction data uses the anomaly prediction machine learning model.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2021
From: WELLS, TAYLOR C.; JAJOO, VAIBHAV
To: DISNEY ENTERPRISES, INC.
Reel/Frame 055638/0931 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2021
From: HAMERLA, DUSTIN STEFAN; CHOWDHURY, ABRASHAM; BOYLE, CHRISTOPHER ADAM; BIRD, JOSEPH H. I.; MOYER, MELISSA ASHLEY; BAKER, KYLE PATRICK
To: DISNEY ENTERPRISES, INC.
Reel/Frame 055004/0249 →
Continuity (1)
Related Publication 20220237501A1 · Jul 28, 2022