IP Library › Granted Patent US 11,811,885
Granted Patent B2
US 11,811,885 · App. 17/327,876 · Granted Nov 7, 2023

Apparatus and methods for dynamic scaling and orchestration

Inventor: Mani Shankar (Princeton, NJ)
Assignee: Bank of America Corporation
H04L67/51G06F9/45558H04L12/66H04L41/0816H04L63/08H04L67/1001G06F2009/45595
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,811,885
App. No.
17/327,876
Granted
Nov 7, 2023
Kind
B2
Abstract

Apparatus and methods to dynamically scale and orchestrate services over a network are provided. The apparatus and methods may include two or more computers forming a network cluster. Each computer may have an agent and user service. One or more computers may include a gateway service, authorization service, a pool of network services, and a director service. A user may request access to a network service, and the gateway and director services may grant access to the network service or create a new instance of the network service on any computer in the cluster and then grant access to the network service to the user.

Claims (38)

1. An apparatus for automatically and without user intervention providing dynamic scaling and orchestrating network services over a network without using the cloud or Internet connections, the network being contained within an internal intranet, the apparatus comprising:

(i) two or more computers, within the network, forming a network cluster, each computer assigned to a user and comprising:

(a) a communication link configured to access the network cluster and communicate between each computer in the network cluster;

(b) a non-transitory memory configured to store at least:

a plurality of network services; and

an operating system;

(c) an agent service comprising executable code configured to interface with one or more gateway services;

(d) at least one processor core coupled to the memory and configured to:

operate the agent service and the operating system;

operate a user service providing an interface for each user;

operate the communication link; and

operate at least one of the plurality of network services within the memory;

(ii) a pool of network services comprised of the plurality of network services in each memory;

(iii) two or more director services, within the network, wherein:

(a) each director service is configured to run on a single computer in the network cluster and to manage the network cluster;

(b) each director service is synced with each other director service, said syncing enabling one director service to manage the network cluster if another director service fails or is taken offline such that at least one director service is running while the network cluster is operable;

(c) each director service is configured to enable the user to add to the plurality of network services on the computer assigned to the user, from the pool of network services, and remove network services from the plurality of network services while the network cluster is operating;

(d) each director service is configured to expand or contract the pool of network services in part based on an artificial intelligence algorithm configured to predict the network services required by the user; and

(e) each director service is configured to enable the user to add and remove computers from the cluster while the network cluster is operating;

(iv) a data store, within the network, installed on at least one of the computers, the data store storing a plurality of configurations comprising:

(a) one or more network cluster configurations associated with the network cluster;

(b) one or more computer configurations associated with the two or more computers;

(c) one or more agent service configurations associated with the agent services of the two or more computers; and

(d) one or more commands for network cluster startup and shutdown;

wherein the data store is configured respond to requests from the director services, the agent services, and the gateway services to enable management and orchestration of the network services based on the stored configurations;

(v) the one or more gateway services, within the network, configured to interface between each agent service and the two or more director services, wherein a number of gateway services in the network cluster is less than the number of computers in the network cluster;

(vi) an authorization service, within the network, configured to authenticate user services of the network cluster; and

wherein:

each agent service is configured to interface between each computer in the cluster and the cluster through the one or more gateway services and the two or more director services; and

each of the one or more gateway services is configured to:

interface between each agent service and the cluster through the two or more director services; and

schedule and direct requests from each agent service through a fair scheduler algorithm.

2. The apparatus of claim 1 wherein the user accesses the user service through a browser.

3. The apparatus of claim 1 wherein the user accesses the user service through a client application.

4. The apparatus of claim 1 wherein the data store further comprises configurations of each network service of the plurality of network services.

5. The apparatus of claim 1 wherein each computer on the network cluster further comprises a unique IP address.

6. The apparatus of claim 1 wherein one or more computers in the network cluster comprises a virtual machine.

7. The apparatus of claim 1 further comprising a load balancer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2021
From: SHANKAR, MANI
To: BANK OF AMERICA CORPORATION
Reel/Frame 056324/0791 →
Continuity (1)
Related Publication 20220377146A1 · Nov 24, 2022
Cited By (1)
US 12,737,241