IP Library Granted Patent US 11,838,191
Granted Patent B2
US 11,838,191 · App. 17/960,882 · Granted Dec 5, 2023

Automatically managing performance of software in a distributed computing environment

Inventors: Huamin Chen (Newton, MA); Roland Huss (Pegnitz, DE)
Assignee: RED HAT, INC.
H04L41/5048G06F8/60G06F9/44594G06F9/5027G06N20/00H04L41/5009H04L67/10G06F2209/506
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,838,191
App. No.
17/960,882
Granted
Dec 5, 2023
Kind
B2
Abstract

Software performance can be automatically managed in a distributed computing environment. In one example, a system that can receive metrics information describing resource usage by a first instance of a service in a distributed computing environment. The system can also determine a quality-of-service (QoS) constraint for the service. The system can then modify a definition file based on the metrics information and the QoS constraint, the definition file being configured for deploying instances of the service in the distributed computing environment. The system can deploy a second instance of the service in the distributed computing environment using the modified definition file. As a result, the second instance can more closely satisfy the QoS constraint than the first instance.

Claims (50)

1. A system comprising:

one or more processors; and

one or more memories including instructions that are executable by the one or more processors for causing the one or more processors to:

deploy an instance of a service in a distributed computing environment using a definition file configured for deploying instances of the service;

receive metrics information describing resource usage by the service in the distributed computing environment;

determine a quality-of-service (QoS) constraint for the service by obtaining the QoS constraint from the definition file; and

subsequent to receiving the metrics information and determining the QoS constraint, automatically modify the definition file based on the metrics information and the QoS constraint.

2. The system of claim 1 , wherein the metrics information includes resource-usage metrics indicating memory usage, disk usage, processor usage, or network usage associated with the service.

3. The system of claim 1 , wherein the metrics information includes QoS metrics indicating a latency, a responsiveness, an availability, or a reliability of the service.

4. The system of claim 1 , wherein the QoS constraint is predefined in the definition file by a user.

5. The system of claim 1 , wherein the one or more memories further include instructions that are executable by the one or more processors for causing the one or more processors to:

provide the metrics information and the QoS constraint as input to a trained machine-learning model for receiving tuning information as output from the trained machine-learning model, the tuning information indicating an adjustment to a portion of the definition file for the service; and

modify the portion of the definition file based on the tuning information.

6. The system of claim 5 , wherein the portion of the definition file is a resource specification indicating how computing resources are to be allocated to the service.

7. The system of claim 1 , wherein the one or more memories further include instructions that are executable by the one or more processors for causing the one or more processors to iteratively perform a tuning process associated with the service, wherein each iteration of the tuning process involves:

receiving respective metrics information corresponding to the service; and

modifying one or more aspects of the definition file based on the respective metrics information and the QoS constraint.

8. The system of claim 1 , wherein the one or more memories further include instructions that are executable by the one or more processors for causing the one or more processors to:

deploy the service at a physical edge of the distributed computing environment, and wherein the service includes a serverless function.

9. A method comprising:

deploying, by one or more processors, an instance of a service in a distributed computing environment using a definition file configured for deploying instances of the service;

receiving, by the one or more processors, metrics information at a first time, the metrics information describing resource usage by the service in the distributed computing environment;

determining, by the one or more processors, a quality-of-service (QoS) constraint for the service; and

subsequent to receiving the metrics information and determining the QoS constraint:

determining, by the one or more processors, a modification to apply to the definition file, wherein the modification is determined based on the metrics information and the QoS constraint, and wherein the modification is configured to cause one or more instances of the service to more closely satisfy the QoS constraint at a subsequent time after the first time; and

automatically applying, by the one or more processors, the modification to the definition file.

10. The method of claim 9 , wherein the metrics information includes resource-usage metrics indicating memory usage, disk usage, processor usage, or network usage associated with the service.

11. The method of claim 9 , wherein the metrics information includes QoS metrics indicating a latency, a responsiveness, an availability, or a reliability of the service.

12. The method of claim 9 , further comprising determining the QoS constraint by obtaining the QoS constraint from the definition file.

13. The method of claim 12 , wherein the QoS constraint is predefined in the definition file by a user.

14. The method of claim 9 , further comprising:

providing the metrics information and the QoS constraint as input to a trained machine-learning model for receiving tuning information as output from the trained machine-learning model, the tuning information indicating an adjustment to a portion of the definition file for the service; and

modifying the portion of the definition file based on the tuning information.

15. The method of claim 14 , wherein the portion of the definition file is a resource specification indicating how computing resources are to be allocated to the service.

16. The method of claim 9 , further comprising iteratively performing a tuning process, wherein each iteration of the tuning process involves:

receiving respective metrics information corresponding to the service; and

modifying one or more aspects of the definition file based on the respective metrics information and the QoS constraint.

17. The method of claim 9 , further comprising deploying the service at a physical edge of the distributed computing environment, and wherein the service includes a serverless function.

18. A non-transitory computer-readable medium comprising program code that is executable by one or more processors for causing the one or more processors to:

deploy an instance of a service in a distributed computing environment using a definition file configured for deploying instances of the service;

receive metrics information at a first time, the metrics information describing resource usage by the service in the distributed computing environment;

determine a quality-of-service (QoS) constraint for the service; and

subsequent to receiving the metrics information and determining the QoS constraint:

determine a modification to apply to the definition file, wherein the modification is determined based on the metrics information and the QoS constraint, and wherein the modification is configured to cause one or more instances of the service to more closely satisfy the QoS constraint at a second time after the first time; and

automatically apply the modification to the definition file.

19. The non-transitory computer-readable medium of claim 18 , further comprising program code that is executable by the one or more processors for causing the one or more processors to:

determine the QoS constraint by obtaining the QoS constraint from the definition file.

20. The non-transitory computer-readable medium of claim 18 , further comprising program code that is executable by the one or more processors for causing the one or more processors to iteratively perform a tuning process associated with the service, wherein each iteration of the tuning process involves:

receiving respective metrics information corresponding to the service; and

applying a respective modification to one or more aspects of the definition file, the respective modification being determined based on the respective metrics information and the QoS constraint, wherein the respective modification is configured to cause the service to more closely satisfy the QoS constraint in a subsequent iteration of the tuning process than in a current iteration of the tuning process.

Assignments (2)
CHANGE OF NAME Recorded Mar 3, 2026
From: RED HAT, INC.
To: RED HAT, LLC
Reel/Frame 074913/0759 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 6, 2022
From: CHEN, HUAMIN; HUSS, ROLAND
To: RED HAT, INC.
Reel/Frame 061329/0987 →
Continuity (2)
Continuation 16903828 · Jun 17, 2020
Related Publication 20230024965A1 · Jan 26, 2023