IP Library Granted Patent US 12671662
Granted Patent B2
US 12671662 · App. 18/372,622 · Granted Jun 30, 2026

Load adaptation architecture framework for orchestrating and managing services in a cloud computing system

Inventors: Anisa Parikh (Holmdel, NJ); Siroos K. Afshar (Englishtown, NJ); Paritosh Bajpay (Edison, NJ); Pradeep Khowash (Dallas, TX); Reuben Klein (East Brunswick, NJ)
Assignee: Shopify Inc.
H04L47/762H04L43/0811H04L43/20H04L47/125H04L47/76H04L47/78H04L47/782H04L47/788H04L47/828H04L43/0876
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12671662
App. No.
18/372,622
Granted
Jun 30, 2026
Kind
B2
Abstract

According to one aspect of the concepts and technologies disclosed herein, a cloud computing system can include a load adaptation architecture framework that performs operations for orchestrating and managing one or more services that may operate within at least one of layers 4 through 7 of the Open Systems Interconnection (“OSP”) communication model. The cloud computing system also can include a virtual resource layer. The virtual resource layer can include a virtual network function that provides, at least in part, a service. The cloud computing system also can include a hardware resource layer. The hardware resource layer can include a hardware resource that is controlled by a virtualization layer. The virtualization layer can cause the virtual network function to be instantiated on the hardware resource so that the virtual network function can be used to support the service.

Claims (39)

1 . A computer-implemented method comprising:

detecting that connections to a service at least meet a threshold corresponding to a number of concurrent connections;

determining that a scale-in or scale-out operation should be performed to adapt to load attributable to the connections to the service; and

triggering the scale-in or scale-out operation.

2 . The computer-implemented method of claim 1 , wherein a monitored region comprises a virtual resource.

3 . The computer-implemented method of claim 2 , wherein the service is provided, at least in part, by the virtual resource.

4 . The computer-implemented method of claim 2 , wherein the determination that the scale-in or scale-out operation should be performed to adapt to the load attributable to the connections to the service is based, at least in part, on utilization of the virtual resource.

5 . The computer-implemented method of claim 2 , wherein the virtual resource is or includes at least one of a virtual network function or a virtual machine.

6 . The computer-implemented method of claim 1 , wherein the threshold corresponding to the number of concurrent connections is a threshold for shrinking or growing the service.

7 . The computer-implemented method of claim 1 , wherein the threshold corresponding to the number of concurrent connections is a threshold number of incoming connections.

8 . The computer-implemented method of claim 1 , wherein the scale-in or scale-out operation includes a scale-out operation and wherein the scale-out operation includes instantiating a new virtual resource in a monitored region.

9 . The computer-implemented method of claim 8 , wherein the new virtual resource is or includes at least one of a new virtual network function or a new virtual machine.

10 . The computer-implemented method of claim 1 , wherein the determination that the scale-in or scale-out operation should be performed to adapt to the load attributable to the connections to the service is based, at least in part, on utilization of one or more resources.

11 . A cloud computing system operable to:

detect that connections to a service at least meet a threshold corresponding to a number of concurrent connections;

determine that a scale-in or scale-out operation should be performed to adapt to load attributable to the connections to the service; and

trigger the scale-in or scale-out operation.

12 . The cloud computing system of claim 11 , wherein a monitored region comprises a virtual resource.

13 . The cloud computing system of claim 12 , wherein the service is provided, at least in part, by the virtual resource.

14 . The cloud computing system of claim 12 , wherein the determination that the scale-in or scale-out operation should be performed to adapt to the load attributable to the connections to the service is based, at least in part, on utilization of the virtual resource.

15 . The cloud computing system of claim 12 , wherein the virtual resource is or includes at least one of a virtual network function or a virtual machine.

16 . The cloud computing system of claim 11 , wherein the threshold corresponding to the number of concurrent connections is a threshold for shrinking or growing the service.

17 . The cloud computing system of claim 11 , wherein the threshold corresponding to the number of concurrent connections is a threshold number of incoming connections.

18 . The cloud computing system of claim 11 , wherein the scale-in or scale-out operation includes a scale-out operation and wherein the scale-out operation includes instantiating a new virtual resource in a monitored region.

19 . The cloud computing system of claim 18 , wherein the new virtual resource is or includes at least one of a new virtual network function or a new virtual machine.

20 . The cloud computing system of claim 11 , wherein the determination that the scale-in or scale-out operation should be performed to adapt to the load attributable to the connections to the service is based, at least in part, on utilization of one or more resources.

21 . A non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by a cloud computing system, cause the cloud computing system to:

detect that connections to a service at least meet a threshold corresponding to a number of concurrent connections;

determine that a scale-in or scale-out operation should be performed to adapt to load attributable to the connections to the service; and

trigger the scale-in or scale-out operation.

22 . The non-transitory computer-readable storage medium of claim 21 , wherein a monitored region comprises a virtual resource.

23 . The non-transitory computer-readable storage medium of claim 22 , wherein the service is provided, at least in part, by the virtual resource.

24 . The non-transitory computer-readable storage medium of claim 22 , wherein the determination that the scale-in or scale-out operation should be performed to adapt to the load attributable to the connections to the service is based, at least in part, on utilization of the virtual resource.

25 . The non-transitory computer-readable storage medium of claim 22 , wherein the virtual resource is or includes at least one of a virtual network function or a virtual machine.

26 . The non-transitory computer-readable storage medium of claim 21 , wherein the threshold corresponding to the number of concurrent connections is a threshold for shrinking or growing the service.

27 . The non-transitory computer-readable storage medium of claim 21 , wherein the threshold corresponding to the number of concurrent connections is a threshold number of incoming connections.

28 . The non-transitory computer-readable storage medium of claim 21 , wherein the scale-in or scale-out operation includes a scale-out operation and wherein the scale-out operation includes instantiating a new virtual resource in a monitored region.

29 . The non-transitory computer-readable storage medium of claim 28 , wherein the new virtual resource is or includes at least one of a new virtual network function or a new virtual machine.

30 . The non-transitory computer-readable storage medium of claim 21 , wherein the determination that the scale-in or scale-out operation should be performed to adapt to the load attributable to the connections to the service is based, at least in part, on utilization of one or more resources.