IP Library Granted Patent US 11,243,872
Granted Patent B2
US 11,243,872 · App. 16/917,516 · Granted Feb 8, 2022

Generating and aggregating test result data of a distributed system of devices into a test case result for facilitating access of the test case result via a single iterator

Inventors: Matthew Bryan (Olympia, WA); Henry Courtlandt Van Voorhis, II (Seattle, WA)
Assignee: EMC IP HOLDING COMPANY LLC
G06F11/3684G06F11/3082G06F11/328G06F11/3688G06F11/3692
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,243,872
App. No.
16/917,516
Granted
Feb 8, 2022
Kind
B2
Abstract

Generating and aggregating test result data of a distributed system of devices into a test case result for facilitating access of the test case result via a single iterator is presented herein. A coordinator component of the distributed system of devices creates respective context identifiers for each unique phase of a test case of the distributed system of devices, and sends messages including the respective context identifiers to a producer component of the distributed system of devices. In this regard, the producer component includes producers having respective services executing processes corresponding to an execution of the test case. The messages instruct the respective services to associate the respective context identifiers with events representing result data of the processes, and the respective context identifiers facilitate respective accesses of the events representing the result data of the processes.

Claims (46)

1. A system, comprising:

a processor; and

a memory that stores executable components that, when executed by the processor, facilitate performance of operations by the system, the operations comprising:

creating respective context identifiers for each unique phase of a test case of the system; and

sending messages comprising the respective context identifiers to respective services comprising processes corresponding to an execution of the test case, wherein the messages instruct the respective services to associate the respective context identifiers with events representing result data of the processes, and wherein the respective context identifiers facilitate respective accesses of the events representing the result data of the processes.

2. The system of claim 1 , wherein the unique phase of the test case comprises at least one of a set up phase or a tear down phase.

3. The system of claim 1 , wherein the operations further comprise:

nesting context identifiers to obtain nested context identifiers representing respective subtests of the unique phase of the test case to facilitate respective accesses of respective groups of events of the events comprising respective portions of the result data for the respective subtests of the unique phase of the test case.

4. The system of claim 1 , wherein the operations further comprise:

assigning defined event types to the events, wherein a defined event type of the defined event types comprises a metadata record comprising a context identifier (ID) of the respective context identifiers corresponding to a portion of the result data, a timestamp representing when a unit of the portion of the result data has been produced via a process of the processes, and information representing the unit of the portion of the result data.

5. The system of claim 4 , wherein the information representing the unit comprises text representing whether the test case has passed or failed.

6. The system of claim 4 , wherein the unit comprises unstructured data that has been generated via a failure corresponding to at least one of the system, the service, or the process.

7. The system of claim 6 , wherein the information representing the unit comprises a uniform resource indicator referencing the unstructured data.

8. The system of claim 6 , wherein the unstructured data comprises a core dump.

9. The system of claim 4 , wherein the operations further comprise:

based on the unit of the portion of the result data, generating a modified unit of result data.

10. The system of claim 9 , wherein the operations further comprise:

displaying, using hypertext markup language via a display device of the system, the modified result data.

11. The system of claim 9 , wherein the modified result data comprises a javascript object notation encoded array of dictionaries or extensible markup language.

12. The system of claim 4 , wherein the operations further comprise:

aggregating, in chronological order, a group of events of the events comprising the context ID into an aggregated event stream representing portions of the result data corresponding to the unique phase of the test case.

13. A method, comprising:

assigning, by a system comprising a processor, respective contextual information comprising respective global test identifications to distinct test phases of a test run;

initiating, by the system, an execution of the distinct test phases across a group of devices of the system; and

in response to initiating the execution of the distinct test phases across the group of devices, generating, by the system based on the respective contextual information via the group of devices, a group of events representing test results of the test run to facilitate, using the respective global test identifications, respective accesses of the group of events representing the test results of the test run.

14. The method of claim 13 , wherein initiating the execution of the distinct test phases comprises:

based on respective application programming interface calls that comprise the respective contextual information and that initiate execution of the distinct test phases, performing, by the system based on the respective contextual information, the execution of the distinct test phases across the group of devices.

15. The method of claim 13 , wherein generating the events comprises:

based on the respective context information, assigning respective event types to the events, wherein an event type of the respective event types that has been assigned to an event of the events corresponding to a test case of the distinct test phases comprises a global test identification of the respective global test identifications, a timestamp representing when a unit of the test results corresponding to the test case has been produced, and information representing the unit of the test results.

16. The method of claim 15 , further comprising:

generating, by the system based on the unit, a modified unit of test results.

17. The method of claim 13 , further comprising:

displaying, by the system via a display device, at least one of:

a core dump corresponding to test results,

a system log corresponding to the test results, or

text corresponding to the test results.

18. The method of claim 13 , further comprising:

selecting, by the system, events of the group of events comprising a global test identification of the global test identifications corresponding to a test case of the distinct test phases of the test run;

sorting, by the system, the events in chronological order to obtain an ordered stream of events of the test case; and

storing, by the system, the stream of events in a storage device of the system to facilitate, based on the global test identification, a display of the ordered stream of events of the test case.

19. A non-transitory machine-readable medium comprising instructions that, in response to execution, cause a system comprising a processor to perform operations, comprising:

assigning respective context identifiers to respective phases of a test case of the system;

sending messages comprising the respective context identifiers to respective services corresponding to processes for execution of the test case, wherein the messages direct the respective services to associate the respective context identifiers with events representing result data of the processes, and wherein the respective context identifiers facilitate respective accesses of the events representing the result data of the processes; and

storing the events in a storage device of the system to facilitate, using the respective context identifiers, the respective accesses of the events.

20. The non-transitory machine-readable medium of claim 19 , wherein the operations further comprise:

in response to selecting, from the events, a group of events comprising a context identifier of the respective context identifiers that has been assigned to a phase of the respective phases of the test case, generating an event stream comprising the group of events to facilitate a display of the event stream via a display device of the system.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053574/0221) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060333/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053578/0183) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060332/0864 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053573/0535) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060333/0106 →
RELEASE OF SECURITY INTEREST AT REEL 053531 FRAME 0108 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0371 →
SECURITY INTEREST Recorded Aug 21, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 053578/0183 →
SECURITY INTEREST Recorded Aug 21, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 053573/0535 →
SECURITY INTEREST Recorded Aug 21, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 053574/0221 →
SECURITY AGREEMENT Recorded Aug 18, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 053531/0108 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2020
From: BRYAN, MATTHEW; VAN VOORHIS II, HENRY COURTLANDT
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 053093/0033 →