Horizontally scalable system for managing container clusters

Inventors: Mayank Kumar (San Francisco, CA); Xiao Li (Santa Clara, CA); Andy Chen (Daly City, CA)

Assignee: Salesforce, Inc.

G06F9/4881 G06F9/5072 G06F2209/505

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 12705093
App. No.: 18/141,572
Granted: Aug 11, 2026
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

Systems, devices, and techniques are disclosed for a horizontally scalable system for managing container clusters. A monolithic management system may perform a first task on a first level of a cloud computing server system. The monolithic management system may perform a second task on a second level of a cloud computing server system. The monolithic management system may invoke instances of a container manager on a level of the cloud computing server system below the second level. The instances of the container manager may update container clusters of the cloud computing server system. The instances of the container manager may be associated with container clusters and the instances of the container manager update their associated container clusters.

Claims (41)

1 . A computer-implemented method comprising:

performing, by a monolithic management system, at least a first task on a first level of a cloud computing server system, wherein the first level of the cloud computing server system comprises two or more regions into which the physical computational resources of the cloud computing server system are divided and wherein the first task comprises configuration of one of the two or more regions;

performing, by the monolithic management system, at least a second task on a second level of a cloud computing server system, wherein the second level of the cloud computing system comprises instances into which regions of the two or more regions are divided, wherein the second task comprises configuration of one of the instances wherein the one of the instances is an instance of the one of the two or more regions configured by the first task;

invoking, by the monolithic management system, one or more instances of a container manager on a level of the cloud computing server system below the second level, wherein the one or more instances of the container manager are in the one of the instances that is configured by the second task and is an instance of the of the one of the two or more regions configured by the first task; and

updating, with the one or more instances of the container manager, one or more container clusters of the cloud computing server system that are in the one of the instances that is configured by the second task by updating containerized applications within the one or more container clusters, updating settings and configuration of the one or more container clusters, or adding or removing containerized applications from the one or more container clusters, wherein the one or more instances of the container manager are each associated with separate container clusters of the one or more container clusters and the one or more instances of the container manager update their associated container clusters.

2 . The computer-implemented method of claim 1 , further comprising:

adding one or more additional container clusters to the cloud computing server system; and

adding one or more additional instances of the container manager to the cloud computing server system, wherein the one or more additional instances of the container manager are associated with the one or more additional container clusters.

3 . The computer-implemented method of claim 2 , wherein invoking, by the monolithic management system, the one or more instances of the container manager on the level of the cloud computing server system below the second level further comprises invoking the one or more additional instances of the container manager.

4 . The computer-implemented method of claim 2 , wherein adding the one or more additional instances of the container manager further comprises replicating at least one of the one or more instances of the container manager.

5 . The computer-implemented method of claim 1 , wherein the one or more instances of the container manager update their associated container clusters by assuming security roles associated with accounts associated with their associated container clusters.

6 . The computer-implemented method of claim 1 , further comprising receiving, at one of the one or more instances of the container manager, a communication invoking the one of the one or more instances of the container manager from a computing device separate from any task of the monolithic management system.

7 . The computer-implemented method of claim 1 , wherein the monolithic management system comprises at least one pipeline comprising tasks to be performed by the monolithic management system on the cloud computing server system, and wherein one or more of the tasks of the pipeline comprise the invoking, by the monolithic management system, of the one or more instances of the container manager.

8 . A computer-implemented system comprising:

a storage; and

one or more processors that perform, with a monolithic management system, at least a first task on a first level of a cloud computing server system, wherein the first level of the cloud computing server system comprises two or more regions into which the physical computational resources of the cloud computing server system are divided and wherein the first task comprises configuration of one of the two or more regions,

perform, with the monolithic management system, at least a second task on a second level of a cloud computing server system, wherein the second level of the cloud computing system comprises instances into which regions of the two or more regions are divided, wherein the second task comprises configuration of one of the instances wherein the one of the instances is an instance of the one of the two or more regions configured by the first task;

invoke, with the monolithic management system, one or more instances of a container manager on a level of the cloud computing server system below the second level, wherein the one or more instances of the container manager are in the one of the instances that is configured by the second task and is an instance of the of the one of the two or more regions configured by the first task, and

update, with the one or more instances of the container manager, one or more container clusters of the cloud computing server system that are in the one of the instances that is configured by the second task by updating containerized applications within the one or more container clusters, updating settings and configuration of the one or more container clusters, or adding or removing containerized applications from the one or more container clusters, wherein the one or more instances of the container manager are each associated with separate container clusters of the one or more container clusters and the one or more instances of the container manager update their associated container clusters.

9 . The computer-implemented system of claim 8 , wherein the one or more processors further add one or more additional container clusters to the cloud computing server system, and

add one or more additional instances of the container manager to the cloud computing server system, wherein the one or more additional instances of the container manager are associated with the one or more additional container clusters.

10 . The computer-implemented system of claim 9 , wherein the one or more processors further invoke the one or more additional instances of the container manager when the one or more processors invoke, with the monolithic management system, the one or more instances of the container manager on the level of the cloud computing server system below the second level.

11 . The computer-implemented system of claim 9 , wherein the one or more processors add the one or more additional instances of the container manager by replicating at least one of the one or more instances of the container manager.

12 . The computer-implemented system of claim 8 , wherein the one or more processors update, with the one or more instances of the container manager, the one or more of the container clusters associated with the one or more instances of the container manager by assuming, with the one or more instances of the container manager, security roles associated with accounts associated with the one or more of the container clusters.

13 . The computer-implemented system of claim 8 , wherein the one or more processors further receive, at one of the one or more instances of the container manager, a communication invoking the one of the one or more instances of the container manager from a computing device separate from any task of the monolithic management system.

14 . The computer-implemented system of claim 8 , wherein the monolithic management system comprises at least one pipeline comprising tasks to be performed by the monolithic management system on the cloud computing server system, and wherein one or more of the tasks of the pipeline comprise the invoking, by the monolithic management system, of the one or more instances of the container manager.

15 . A system comprising: one or more computers and one or more non-transitory storage devices storing instructions which are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:

16 . The system of claim 15 , wherein the one or more computers and one or more non-transitory storage devices further store instructions which are operable, when executed by the one or more computers, to cause the one or more computers to further perform operations comprising:

when invoking, by the monolithic management system, the one or more instances of the container manager on the level of the cloud computing server system below the second level further comprises invoking the one or more additional instances of the container manager.

17 . The system of claim 16 wherein the one or more computers and one or more non-transitory storage devices further store instructions which are operable, when executed by the one or more computers, to cause the one or more computers to further perform operations comprising:

invoking the one or more additional instances of the container manager when invoking, by the monolithic management system, the one or more instances of the container manager on the level of the cloud computing server system below the second level.

18 . The system of claim 16 , wherein the one or more computers and one or more non-transitory storage devices further store instructions which are operable, when executed by the one or more computers, to cause the one or more computers to further perform operations comprising:

replicating at least one of the one or more instances of the container manager when adding the one or more additional instances of the container manager.

19 . The system of claim 15 , wherein the one or more computers and one or more non-transitory storage devices further store instructions which are operable, when executed by the one or more computers, to cause the one or more computers to further perform operations comprising:

assuming, by the one or more instances of the container manager, security roles associated with accounts associated with their associated container clusters when the one or more instances of the container manager update their associated container clusters.

20 . The system of claim 15 , wherein the one or more computers and one or more non-transitory storage devices further store instructions which are operable, when executed by the one or more computers, to cause the one or more computers to further perform operations comprising:

receiving, at one of the one or more instances of the container manager, a communication invoking the one of the one or more instances of the container manager from a computing device separate from any task of the monolithic management system.