Granted Patent B1

US 12,321,764 · App. 19/080,333 · Granted Jun 3, 2025

Inventors: George Peter Nychis (Somerville, MA); Abdul Qadir (Bangalore, IN); Aakash Hasija (Delhi, IN); Rohan Narayana Murty (Bangalore, IN); Arjun Narayanaswamy (Bangalore, IN); Kirby Scott Files (Milton, MA)

Assignee: Soroco India Private Limited

G06F9/453

Abstract

Claims (38)

1. A method of generating and displaying visualizations of actions that were performed by a user of a computing device, the computing device having one or more software applications and separate monitoring software installed thereon, the method comprising:

receiving, by the computing device, a user indication to start recording an instance of a process;

configuring the computing device to start recording the instance of the process in response to receiving the user indication;

capturing, by the monitoring software when recording, first information corresponding to a first stream of events captured by the computing device during performance of a first plurality of actions by the user when interacting with the one or more software applications to perform the process, the first information indicating clicks and keystrokes performed by the user in the first plurality of actions and, for each indicated click or keystroke, indicating a software application in which the click or the keystroke was performed;

generating, using the first information, a first visualization of at least some of the first plurality of actions, the first visualization including a flow diagram having nodes representing the at least some of the first plurality of actions and directed edges representing transitions between the at least some of the first plurality of actions; and

displaying the first visualization on a graphical user interface (GUI).

2. The method of claim 1 , wherein the first visualization includes a plurality of screenshots indicating a sequence of the at least some of the first plurality of actions.

3. The method of claim 1 , wherein the first visualization includes an amount of time that it took the user to complete performance of the process.

4. The method of claim 1 , wherein the first plurality of actions performed by the user include a first set of actions performed at a first time and a second set of actions performed at a second time after the first time.

5. The method of claim 4 , further comprising:

for each instance of a plurality of instances of the process:

capturing, by the monitoring software when recording, respective first information during performance of a respective first plurality of actions by the user when interacting with the one or more software applications to perform the process.

6. A system comprising:

a computing device; and

at least one non-transitory computer-readable storage medium having stored thereon instructions which, when executed by the computing device, cause the computing device to perform a method of generating and displaying visualizations of actions that were performed by a user of the computing device, the computing device having one or more software applications and separate monitoring software installed thereon, the method comprising:

receiving, by the computing device, a user indication to start recording an instance of a process;

configuring the computing device to start recording the instance of the process in response to receiving the user indication;

capturing, by the monitoring software when recording, first information corresponding to a first stream of events captured by the computing device during performance of a first plurality of actions by the user when interacting with the one or more software applications to perform the process, the first information indicating clicks and keystrokes performed by the user in the first plurality of actions and, for each indicated click or keystroke, indicating a software application in which the click or the keystroke was performed;

generating, using the first information, a first visualization of at least some of the first plurality of actions, the first visualization including a flow diagram having nodes representing the at least some of the first plurality of actions and directed edges representing transitions between the at least some of the first plurality of actions; and

displaying the first visualization on a graphical user interface (GUI).

7. The system of claim 6 , wherein the first visualization includes a plurality of screenshots indicating a sequence of the at least some of the first plurality of actions.

8. The system of claim 6 , wherein the first visualization includes an amount of time that it took the user to complete performance of the process.

9. The system of claim 6 , wherein the first plurality of actions performed by the user include a first set of actions performed at a first time and a second set of actions performed at a second time after the first time.

10. The system of claim 6 , wherein the method further comprises:

for each instance of a plurality of instances of the process:

capturing, by the monitoring software when recording, respective first information during performance of a respective first plurality of actions by the user when interacting with the one or more software applications to perform the process.

11. At least one non-transitory computer-readable storage medium having stored thereon instructions which, when executed by a computing device, cause the computing device to perform a method of generating and displaying visualizations of actions that were performed by a user of the computing device, the computing device having one or more software applications and separate monitoring software installed thereon, the method comprising:

receiving, by the computing device, a user indication to start recording an instance of a process;

configuring the computing device to start recording the instance of the process in response to receiving the user indication;

capturing, by the monitoring software when recording, first information corresponding to a first stream of events captured by the computing device during performance of a first plurality of actions by the user when interacting with the one or more software applications to perform the process, the first information indicating clicks and keystrokes performed by the user in the first plurality of actions and, for each indicated click or keystroke, indicating a software application in which the click or the keystroke was performed;

generating, using the first information, a first visualization of at least some of the first plurality of actions, the first visualization including a flow diagram having nodes representing the at least some of the first plurality of actions and directed edges representing transitions between the at least some of the first plurality of actions; and

displaying the first visualization on a graphical user interface (GUI).

12. The at least one non-transitory computer-readable storage medium of claim 11 , wherein the first visualization includes a plurality of screenshots indicating a sequence of the at least some of the first plurality of actions.

13. The at least one non-transitory computer-readable storage medium of claim 11 , wherein the first visualization includes an amount of time that it took the user to complete performance of the process.

14. The at least one non-transitory computer-readable storage medium of claim 11 , wherein the first plurality of actions performed by the user include a first set of actions performed at a first time and a second set of actions performed at a second time after the first time.

15. The at least one non-transitory computer-readable storage medium of claim 11 , wherein the method further comprises:

for each instance of a plurality of instances of the process:

capturing, by the monitoring software when recording, respective first information during performance of a respective first plurality of actions by the user when interacting with the one or more software applications to perform the process.

Assignments (7)

Continuity (3)

References Cited (94)

Cited By (2)

US 12,455,888 US 12,743,254