IP Library Granted Patent US 10,956,918
Granted Patent B1
US 10,956,918 · App. 15/800,593 · Granted Mar 23, 2021

Analytically generated micro-service consumer-driven contracts and automated tests

Inventors: Sean Creedon (Ballincollig, IE); Ian Gerard Roche (Glanmire, IE)
Assignee: EMC IP Holding Company LLC
G06Q30/0201G06F16/285G06Q10/067G06Q10/10G06N5/022G06N5/047G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,956,918
App. No.
15/800,593
Granted
Mar 23, 2021
Kind
B1
Abstract

Techniques are provided for analytically generating micro-service Consumer- Driven Contracts and automated tests. One method comprises obtaining a plurality of usage data records for consumers of a service from a run-time environment; extracting data features from the usage data records; applying a clustering algorithm to the usage data records to assign the usage data records to a given usage pattern cluster of a plurality of usage pattern clusters based on the extracted data features, wherein each of the plurality of usage pattern clusters comprises usage data records; and performing the following steps when the clustering algorithm creates a new usage pattern cluster: creating a new Consumer-Driven Contract that defines consumer expectations of the service, with respect to the new usage pattern associated with the new usage pattern cluster; and generating automated Consumer-Driven Contract tests to test the new Consumer-Driven Contract.

Claims (46)

1. A method, comprising:

obtaining a plurality of usage data records for a plurality of consumers of a micro-service from a gateway of a run-time environment, wherein the plurality of usage data records comprises real-time function call information for said micro-service;

extracting one or more data features from each of the usage data records, the one or more data features comprising: a plurality of service function call names associated with said real-time function call information and one or more service function parameters of each of said plurality of service function call names;

applying, using at least one processing device, a clustering algorithm to said usage data records to assign said usage data records to one of a plurality of usage pattern clusters based on said one or more extracted data features, wherein each of said plurality of usage pattern clusters comprises usage data records, and wherein said plurality of usage pattern clusters comprises:

at least one existing usage pattern cluster associated with one or more existing Consumer-Driven Contracts that define consumer expectations of the micro-service, with respect to an existing usage pattern associated with the existing usage pattern cluster, and

a new usage pattern cluster not associated with said one or more existing Consumer-Driven Contracts;

performing the following steps when the clustering algorithm creates said new usage pattern cluster:

creating a new Consumer-Driven Contract that defines consumer expectations of the micro-service, with respect to a new usage pattern associated with the new usage pattern cluster, wherein the new Consumer-Driven Contract is indicative of one or more data structure formats of responses provided from said micro-service in response to corresponding consumer requests; and

generating one or more automated Consumer-Driven Contract tests to verify whether responses sent from said micro-service conform to the data structure format in the new Consumer-Driven Contract.

2. The method of claim 1 , further comprising the step of storing one or more of said new Consumer-Driven Contract, said automated Consumer-Driven Contract tests and results of said automated Consumer-Driven Contract tests in a data store.

3. The method of claim 1 , wherein said obtaining step further comprises obtaining run-time operations data from the run-time environment, wherein said steps of creating and generating are based at least in part on said run-time operations data.

4. The method of claim 1 , wherein the following steps further comprise the step of generating anonymous data to validate the new usage pattern.

5. The method of claim 1 , wherein the new usage pattern is validated using anonymous data in a closed system loop without human access.

6. The method of claim 1 , wherein the applying step is performed at a plurality of states of a software development life cycle of the micro-service.

7. The method of claim 1 , wherein the applying step further comprises the step of applying one or more of a machine learning algorithm and an anomaly detection algorithm to the usage data records to identify one or more patterns in the usage data records.

8. The method of claim 1 , further comprising the step of applying a Supervised Machine Learning Classification/Clustering technique to labeled usage data records to train an analytical model.

9. A system, comprising:

a memory; and

at least one processing device, coupled to the memory, operative to implement the following steps:

obtaining a plurality of usage data records for a plurality of consumers of a micro-service from a gateway of a run-time environment, wherein the plurality of usage data records comprises real-time function call information for said micro-service;

extracting one or more data features from each of the usage data records, the one or more data features comprising: a plurality of service function call names associated with said real-time function call information and one or more service function parameters of each of said plurality of service function call names;

applying, using at least one processing device, a clustering algorithm to said usage data records to assign said usage data records to one of a plurality of usage pattern clusters based on said one or more extracted data features, wherein each of said plurality of usage pattern clusters comprises usage data records, and wherein said plurality of usage pattern clusters comprises:

at least one existing usage pattern cluster associated with one or more existing Consumer-Driven Contracts that define consumer expectations of the micro-service, with respect to an existing usage pattern associated with the existing usage pattern cluster, and

a new usage pattern cluster not associated with said one or more existing Consumer-Driven Contracts;

performing the following steps when the clustering algorithm creates said new usage pattern cluster:

creating a new Consumer-Driven Contract that defines consumer expectations of the micro-service, with respect to a new usage pattern associated with the new usage pattern cluster, wherein the new Consumer-Driven Contract is indicative of one or more data structure formats of responses provided from said micro-service in response to corresponding consumer requests; and

generating one or more automated Consumer-Driven Contract tests to verify whether responses sent from said micro-service conform to the data structure format in new Consumer-Driven Contract.

10. The system of claim 9 , further comprising the step of storing one or more of said new Consumer-Driven Contract, said automated Consumer-Driven Contract tests and results of said automated Consumer-Driven Contract tests in a data store.

11. The system of claim 9 , wherein said obtaining step further comprises obtaining run-time operations data from the run-time environment, wherein said steps of creating and generating is based at least in part on said run-time operations data.

12. The system of claim 9 , wherein the following steps further comprise the step of generating anonymous data to validate the new usage pattern.

13. The system of claim 9 , wherein the new usage pattern is validated using anonymous data in a closed system loop without human access.

14. The system of claim 9 , wherein the applying step is performed at a plurality of states of a software development life cycle of the micro-service.

15. The system of claim 9 , wherein the applying step further comprises the step of applying one or more of a machine learning algorithm and an anomaly detection algorithm to the usage data records to identify one or more patterns in the usage data records.

16. The system of claim 9 , further comprising the step of applying a Supervised Machine Learning Classification/Clustering technique to labeled usage data records to train an analytical model.

17. A computer program product, comprising a non-transitory machine-readable storage medium having encoded therein executable code of one or more software programs, wherein the one or more software programs when executed by at least one processing device perform the following steps:

obtaining a plurality of usage data records for a plurality of consumers of a micro-service from a gateway of a run-time environment, wherein the plurality of usage data records comprises real-time function call information for said micro-service;

extracting one or more data features from each of the usage data records, the one or more data features comprising: a plurality of service function call names associated with said real-time function call information and one or more service function parameters of each of said plurality of service function call names;

applying, using at least one processing device, a clustering algorithm to said usage data records to assign said usage data records to one of a plurality of usage pattern clusters based on said one or more extracted data features, wherein each of said plurality of usage pattern clusters comprises usage data records, and wherein said plurality of usage pattern clusters comprises:

at least one existing usage pattern cluster associated with one or more existing Consumer-Driven Contracts that define consumer expectations of the micro-service, with respect to an existing usage pattern associated with the existing usage pattern cluster, and

a new usage pattern cluster not associated with said one or more existing Consumer-Driven Contracts;

performing the following steps when the clustering algorithm creates said new usage pattern cluster:

creating a new Consumer-Driven Contract that defines consumer expectations of the micro-service, with respect to a new usage pattern associated with the new usage pattern cluster, wherein the new Consumer-Driven Contract is indicative of one or more data structure formats of responses provided from said micro-service in response to corresponding consumer requests; and

generating one or more automated Consumer-Driven Contract tests to verify whether responses sent from said micro-service conform to the data structure format in new Consumer-Driven Contract.

18. The computer program product of claim 17 , wherein said obtaining step further comprises obtaining run-time operations data from the run-time environment, wherein said steps of creating and generating is based at least in part on said run-time operations data.

19. The computer program product of claim 17 , wherein the following steps further comprise the step of generating anonymous data to validate the new usage pattern.

20. The computer program product of claim 17 , wherein the new usage pattern is validated using anonymous data in a closed system loop without human access.

Assignments (8)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (044535/0109) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO WYSE TECHNOLOGY L.L.C.)
Reel/Frame 060753/0414 →
RELEASE OF SECURITY INTEREST AT REEL 044535 FRAME 0001 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058298/0475 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Nov 29, 2017
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 044535/0109 →
PATENT SECURITY AGREEMENT (CREDIT) Recorded Nov 29, 2017
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 044535/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2017
From: CREEDON, SEAN; ROCHE, IAN GERARD
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 044007/0487 →