Granted Patent B2

US 12,400,165 · App. 18/345,687 · Granted Aug 26, 2025

Inventors: Matthew Richard James Thornhill (London, GB); David Jon Griffin (Reigate, GB); Keith Jeremy Posner (London, GB)

Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION

G06Q10/0633G06Q10/0637

Abstract

Claims (52)

1. A computer-implemented method comprising:

tracking computerized interactions of a plurality of users interacting via user interfaces with one or more systems;

identifying, from the computerized interactions, a plurality of user flows, each user flow of the plurality of user flows being a sequence of one or more of the tracked computerized interactions;

determining a collection of user flows of the plurality of user flows, each user flow of the collection of user flows being associated with a respective measured beneficial impact to an organization, wherein the determining the collection of user flows comprises:

determining first user flows, each first user flow of the first user flows providing its associated respective measured beneficial impact by way of at least one computerized interaction of that first user flow; and

determining second user flows, each second user flow having a threshold correlation to one or more of the first user flows that occur sequentially after that second user flow;

assigning impact metrics to the collection of user flows, wherein each user flow of the collection of user flows is assigned a respective impact metric commensurate with the respective measured beneficial impact associated with that user flow;

based on the assigned impact metrics, selecting a collection of synthetic tests of a plurality of common flows represented by the collection of user flows and a prioritization of the collection of synthetic tests, wherein each synthetic test simulates a sequence of user interactions to progress through a respective common flow of the plurality of common flows; and

aggregating, for each common flow of the plurality of common flows, the impact metrics of user flows, of the collection of user flows, grouped into that common flow to provide a respective aggregated impact for that common flow, wherein the selecting the collection of synthetic tests an prioritization is based on a ranking of the common flows of the plurality of common flows based on their aggregated impacts.

2. The method of claim 1 , wherein the determining the first user flows comprises determining, based on the tracking, which user flows of the plurality of user flows comprise at least one computerized interaction providing a direct beneficial impact, and wherein the determining the second user flows comprises determining which user flows of the plurality of user flows predict occurrence of at least one of the first user flows.

3. The method of claim 2 , wherein the assigning the impact metrics comprises assigning a weighted impact metric to a second user flow based on a strength by which the second user flow predicts occurrence of a subsequently occurring first user flow.

4. The method of claim 2 , wherein the tracking the computerized interactions comprises storing metadata for each computerized interaction of the computerized interactions, the metadata for a computerized interaction comprises:

(i) a unique identifier of a user performing the computerized interaction;

(ii) an identifier of a current session of the user;

(iii) an identifier of an element with which the user interacted; and

(iv) an originating identifier.

5. The method of claim 4 , wherein for each of the first user flows, the metadata stored further comprises a measurement of the beneficial impact.

6. The method of claim 4 , wherein the identifying the plurality of user flows comprises analyzing the stored metadata and determining, as a user flow of the plurality of user flows, sequential user interactions of a single user in a single session.

7. The method of claim 1 , wherein the prioritization is based on a specified capacity allotted for monitoring the plurality of common flows.

8. The method of claim 1 , further comprising executing the collection of synthetic tests according to the prioritization.

9. The method of claim 8 , further comprising, based on a failure during execution of a synthetic test, of the collection of synthetic tests, of a common flow, of the plurality of common flows, raising an event with a priority set based on a predicted impact of failure of the common flow, the predicted impact of failure of the common flow being a function of the aggregated impact for that common flow.

10. A computer system comprising:

a memory; and

a processor in communication with the memory, wherein the computer system is configured to perform a method comprising:

tracking computerized interactions of a plurality of users interacting via user interfaces with one or more systems;

identifying, from the computerized interactions, a plurality of user flows, each user flow of the plurality of user flows being a sequence of one or more of the tracked computerized interactions;

determining a collection of user flows of the plurality of user flows, each user flow of the collection of user flows being associated with a respective measured beneficial impact to an organization, wherein the determining the collection of user flows comprises:

determining first user flows, each first user flow of the first user flows providing its associated respective measured beneficial impact by way of at least one computerized interaction of that first user flow; and

determining second user flows, each second user flow having a threshold correlation to one or more of the first user flows that occur sequentially after that second user flow;

assigning impact metrics to the collection of user flows, wherein each user flow of the collection of user flows is assigned a respective impact metric commensurate with the respective measured beneficial impact associated with that user flow;

based on the assigned impact metrics, selecting a collection of synthetic tests of a plurality of common flows represented by the collection of user flows and a prioritization of the collection of synthetic tests, wherein each synthetic test simulates a sequence of user interactions to progress through a respective common flow of the plurality of common flows, and

aggregating, for each common flow of the plurality of common flows, the impact metrics of user flows, of the collection of user flows, grouped into that common flow to provide a respective aggregated impact for that common flow, wherein the selecting the collection of synthetic tests and the prioritization is based on a ranking of the common flows of the plurality of common flows based on their aggregated impacts.

11. The computer system of claim 10 , wherein the determining the first user flows comprises determining, based on the tracking, which user flows of the plurality of user flows comprise at least one computerized interaction providing a direct beneficial impact, and wherein the determining the second user flows comprises determining which user flows of the plurality of user flows predict occurrence of at least one of the first user flows.

12. The computer system of claim 11 , wherein the assigning the impact metrics comprises assigning a weighted impact metric to a second user flow based on a strength by which the second user flow predicts occurrence of a subsequently occurring first user flow.

13. The computer system of claim 10 , wherein the method further comprises:

executing the collection of synthetic tests according to the prioritization; and

based on a failure during execution of a synthetic test, of the collection of synthetic tests, of a common flow, of the plurality of common flows, raising an event with a priority set based on a predicted impact of failure of the common flow, the predicted impact of failure of the common flow being a function of the aggregated impact for that common flow.

14. A computer program product comprising:

a computer readable storage medium readable by a processing circuit and storing instructions for execution by the processing circuit to:

tracking computerized interactions of a plurality of users interacting via user interfaces with one or more systems;

identifying, from the computerized interactions, a plurality of user flows, each user flow of the plurality of user flows being a sequence of one or more of the tracked computerized interactions;

determining a collection of user flows of the plurality of user flows, each user flow of the collection of user flows being associated with a respective measured beneficial impact to an organization, wherein the determining the collection of user flows comprises:

determining first user flows, each first user flow of the first user flows providing its associated respective measured beneficial impact by way of at least one computerized interaction of that first user flow; and

determining second user flows, each second user flow having a threshold correlation to one or more of the first user flows that occur sequentially after that second user flow;

assigning impact metrics to the collection of user flows, wherein each user flow of the collection of user flows is assigned a respective impact metric commensurate with the respective measured beneficial impact associated with that user flow; and

based on the assigned impact metrics, selecting a collection of synthetic tests of a plurality of common flows represented by the collection of user flows and a prioritization of the collection of synthetic tests, wherein each synthetic test simulates a sequence of user interactions to progress through a respective common flow of the plurality of common flows; and

aggregating for each common flow of the plurality of common flows, the impact metrics of user flows, of the collection of user flows, grouped into that common flow to provide a respective aggregated impact for that common flow, wherein the selecting the collection of synthetic tests and the prioritization is based on a ranking of the common flows of the plurality of common flows based on their aggregated impacts.

15. The computer program product of claim 14 , wherein the determining the first user flows comprises determining, based on the tracking, which user flows of the plurality of user flows comprise at least one computerized interaction providing a direct beneficial impact, and wherein the determining the second user flows comprises determining which user flows of the plurality of user flows predict occurrence of at least one of the first user flows.

16. The computer program product of claim 15 , wherein the assigning the impact metrics comprises assigning a weighted impact metric to a second user flow based on a strength by which the second user flow predicts occurrence of a subsequently occurring first user flow.

17. The computer program product of claim 14 , wherein the method further comprises:

executing the collection of synthetic tests according to the prioritization; and

based on a failure during execution of a synthetic test, of the collection of synthetic tests, of a common flow, of the plurality of common flows, raising an event with a priority set based on a predicted impact of failure of the common flow, the predicted impact of failure of the common flow being a function of the aggregated impact for that common flow.

Assignments (1)

Continuity (1)

References Cited (14)