IP Library › Granted Patent US 12,250,161
Granted Patent B2
US 12,250,161 · App. 17/986,681 · Granted Mar 11, 2025

Load adaptation architecture framework for orchestrating and managing services in a cloud computing system

Inventors: Anisa Parikh (Holmdel, NJ); Siroos K. Afshar (Englishtown, NJ); Paritosh Bajpay (Edison, NJ); Pradeep Khowash (Dallas, TX); Reuben Klein (East Brunswick, NJ)
Assignee: Shopify Inc.
H04L47/762H04L43/0811H04L43/20H04L47/125H04L47/76H04L47/78H04L47/782H04L47/788H04L47/828H04L43/0876
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,250,161
App. No.
17/986,681
Granted
Mar 11, 2025
Kind
B2
Abstract

According to one aspect of the concepts and technologies disclosed herein, a cloud computing system can include a load adaptation architecture framework that performs operations for orchestrating and managing one or more services that may operate within at least one of layers 4 through 7 of the Open Systems Interconnection (“OSP”) communication model. The cloud computing system also can include a virtual resource layer. The virtual resource layer can include a virtual network function that provides, at least in part, a service. The cloud computing system also can include a hardware resource layer. The hardware resource layer can include a hardware resource that is controlled by a virtualization layer. The virtualization layer can cause the virtual network function to be instantiated on the hardware resource so that the virtual network function can be used to support the service.

Claims (28)

1. A cloud computing system that performs operations comprising:

detecting, in a monitored region comprising one or more virtual machines, that connections to a service at least meet a threshold;

determining that a new virtual machine should be instantiated to adapt to load attributable to the connections; and

triggering adding the new virtual machine in the monitored region to adapt to the load.

2. The cloud computing system of claim 1 , wherein triggering adding the new virtual machine in the monitored region to adapt to the load includes instantiating the new virtual machine in the monitored region.

3. The cloud computing system of claim 2 , wherein the operations further comprise:

obtaining a template specifying attributes for the new virtual machine, wherein the new virtual machine is instantiated in accordance with the template.

4. The cloud computing system of claim 1 , wherein the load created by the connections includes additional load created by new connections.

5. The cloud computing system of claim 1 , wherein the service is provided, at least in part, by the one or more virtual machines.

6. The cloud computing system of claim 1 , wherein the one or more virtual machines form or are included in a virtual network function of the monitored region.

7. A method comprising:

detecting, in a monitored region comprising one or more virtual machines, that connections to a service at least meet a threshold;

determining that a new virtual machine should be instantiated to adapt to load attributable to the connections to the service; and

triggering adding the new virtual machine in the monitored region to adapt to the load.

8. The method of claim 7 , wherein triggering adding the new virtual machine in the monitored region to adapt to the load includes instantiating the new virtual machine in the monitored region.

9. The method of claim 7 , wherein the service is provided, at least in part, by the one or more virtual machines.

10. The method of claim 7 , wherein the load created by the connections includes additional load created by the new connections.

11. The method of claim 7 , wherein the one or more virtual machines form or are included in a virtual network function of the monitored region.

12. A non-transitory computer-readable storage medium comprising computer-executable instructions that, when executed by a cloud computing system, cause the cloud computing system to perform operations comprising:

detecting, in a monitored region comprising one or more virtual machines, that connections to a service at least meet a threshold;

determining that a new virtual network machine should be instantiated to adapt to load attributable to the connections; and

triggering adding the new virtual machine in the monitored region to adapt to the load.

13. The computer-readable storage medium of claim 12 , wherein triggering adding the new virtual machine in the monitored region to adapt to the load includes instantiating the new virtual machine in the monitored region.

14. The computer-readable storage medium of claim 13 , the operations further comprising:

obtaining a template specifying attributes for the new virtual machine, wherein the new virtual machine is instantiated in accordance with the template.

15. The computer-readable storage medium of claim 12 , wherein the load created by the connections includes additional load created by new connections.

16. The computer-readable storage medium of claim 12 , wherein the service is provided, at least in part, by the one or more virtual machines.

17. The computer-readable storage medium of claim 12 , wherein the one or more virtual machines form or are included in a virtual network function of the monitored region.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2022
From: PARIKH, ANISA; AFSHAR, SIROOS K.; BAJPAY, PARITOSH; KHOWASH, PRADEEP; KLEIN, REUBEN
To: AT&T INTELLECTUAL PROPERTY I, L.P.
Reel/Frame 061763/0656 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2022
From: AT&T INTELLECTUAL PROPERTY I, L.P.
To: SHOPIFY INC.
Reel/Frame 061763/0692 →
Continuity (4)
Continuation 16459078 · Jul 1, 2019
Continuation 15681498 · Aug 21, 2017
Continuation 14464212 · Aug 20, 2014
Related Publication 20230080360A1 · Mar 16, 2023
References Cited (197)
US 7466710B1 · Clemm et al. · 2008 [cited by applicant]
US 7574496B2 · McCrory et al. · 2009 [cited by applicant]
US 7603671B2 · Liu · 2009 [cited by applicant]
US 7818002B2 · Bajko et al. · 2010 [cited by applicant]
US 7869364B2 · Griffith et al. · 2011 [cited by applicant]
US 8032413B2 · Carlson · 2011 [cited by applicant]
US 8190740B2 · Stienhans et al. · 2012 [cited by applicant]
US 8209415B2 · Wei · 2012 [cited by applicant]
US 8218557B2 · Kean et al. · 2012 [cited by applicant]
US 8244559B2 · Horvitz et al. · 2012 [cited by applicant]
US 8250215B2 · Stienhans et al. · 2012 [cited by applicant]
US 8271653B2 · Dehaan · 2012 [cited by applicant]
US 8276140B1 · Beda et al. · 2012 [cited by applicant]
US 8433802B2 · Head et al. · 2013 [cited by applicant]
US 8514868B2 · Hill · 2013 [cited by applicant]
US 8515433B2 · Vaswani et al. · 2013 [cited by applicant]
US 8572612B2 · Kern · 2013 [cited by applicant]
US 8606878B2 · Ferris · 2013 [cited by applicant]
US 8615745B2 · Blainey et al. · 2013 [cited by applicant]
US 8615746B2 · Blainey et al. · 2013 [cited by applicant]
US 8656019B2 · Chikando et al. · 2014 [cited by applicant]
US 8700946B2 · Reddy et al. · 2014 [cited by applicant]
US 8724620B2 · Ku et al. · 2014 [cited by applicant]
US 8739157B2 · Ho et al. · 2014 [cited by applicant]
US 8832669B2 · Blainey et al. · 2014 [cited by applicant]
US 8959484B2 · Pinnix · 2015 [cited by applicant]
US 9621428B1 · Lev et al. · 2017 [cited by applicant]
US 9742690B2 · Parikh et al. · 2017 [cited by applicant]
US 10120714B1 · Cabrera et al. · 2018 [cited by applicant]
US 10374971B2 · Parikh et al. · 2019 [cited by applicant]
US 20050027870A1 · Trebes · 2005 [cited by applicant]
US 20050028164A1 · Neuwald · 2005 [cited by examiner]
US 20050176428A1 · Gabor et al. · 2005 [cited by applicant]
US 20060146792A1 · Ramachandran et al. · 2006 [cited by applicant]
US 20070036151A1 · Baeder · 2007 [cited by applicant]
US 20070106769A1 · Liu · 2007 [cited by applicant]
US 20080025221A1 · Lipps et al. · 2008 [cited by applicant]
US 20080209007A1 · Gurecki et al. · 2008 [cited by applicant]
US 20080215736A1 · Astrom et al. · 2008 [cited by applicant]
US 20080254795A1 · Ratcliffe et al. · 2008 [cited by applicant]
US 20090067409A1 · Ku et al. · 2009 [cited by applicant]
US 20090070462A1 · Chong · 2009 [cited by examiner]
US 20090097398A1 · Belinchon Vergara et al. · 2009 [cited by applicant]
US 20090116505A1 · Bhatia et al. · 2009 [cited by applicant]
US 20090300210A1 · Ferris · 2009 [cited by applicant]
US 20100136970A1 · Mui et al. · 2010 [cited by applicant]
US 20100274680A1 · Carlson et al. · 2010 [cited by applicant]
US 20100296443A1 · Hirano et al. · 2010 [cited by applicant]
US 20110093584A1 · Qiu et al. · 2011 [cited by applicant]
US 20110117888A1 · Klein et al. · 2011 [cited by applicant]
US 20110119312A1 · Chopra et al. · 2011 [cited by applicant]
US 20110119729A1 · Bergeson et al. · 2011 [cited by applicant]
US 20110126168A1 · Ilyayev · 2011 [cited by applicant]
US 20110145836A1 · Wheeler et al. · 2011 [cited by applicant]
US 20110149737A1 · Muthiah · 2011 [cited by examiner]
US 20110252420A1 · Tung et al. · 2011 [cited by applicant]
US 20110295996A1 · Qiu et al. · 2011 [cited by applicant]
US 20110307886A1 · Thanga et al. · 2011 [cited by applicant]
US 20120011077A1 · Bhagat · 2012 [cited by applicant]
US 20120030331A1 · Karampatsis · 2012 [cited by applicant]
US 20120072581A1 · Tung et al. · 2012 [cited by applicant]
US 20120096045A1 · Moore et al. · 2012 [cited by applicant]
US 20120102183A1 · Murakami et al. · 2012 [cited by applicant]
US 20120124211A1 · Kampas et al. · 2012 [cited by applicant]
US 20120131591A1 · Moorthi et al. · 2012 [cited by applicant]
US 20120158921A1 · Asveren · 2012 [cited by applicant]
US 20120203823A1 · Manglik et al. · 2012 [cited by applicant]
US 20120281706A1 · Agarwal et al. · 2012 [cited by applicant]
US 20120297059A1 · Bross · 2012 [cited by applicant]
US 20120300615A1 · Kempf et al. · 2012 [cited by applicant]
US 20120303835A1 · Kempf et al. · 2012 [cited by applicant]
US 20120311154A1 · Morgan · 2012 [cited by applicant]
US 20130031550A1 · Choudhury et al. · 2013 [cited by applicant]
US 20130054670A1 · Keyes et al. · 2013 [cited by applicant]
US 20130088989A1 · Noel et al. · 2013 [cited by applicant]
US 20130091284A1 · Rothschild · 2013 [cited by applicant]
US 20130091285A1 · Devarakonda et al. · 2013 [cited by applicant]
US 20130124401A1 · Del Real · 2013 [cited by applicant]
US 20130124712A1 · Parker · 2013 [cited by applicant]
US 20130132594A1 · Boeszoermenyi et al. · 2013 [cited by applicant]
US 20130145367A1 · Moss et al. · 2013 [cited by applicant]
US 20130182702A1 · Ku · 2013 [cited by applicant]
US 20130188489A1 · Sato · 2013 [cited by applicant]
US 20130227673A1 · Yoon · 2013 [cited by applicant]
US 20130268913A1 · Anderson et al. · 2013 [cited by applicant]
US 20130286861A1 · Smith et al. · 2013 [cited by applicant]
US 20130291052A1 · Hadar et al. · 2013 [cited by applicant]
US 20130303114A1 · Ahmad et al. · 2013 [cited by applicant]
US 20130304904A1 · Mouline et al. · 2013 [cited by applicant]
US 20130311778A1 · Cherukuri et al. · 2013 [cited by applicant]
US 20130326036A1 · Heumesser et al. · 2013 [cited by applicant]
US 20130344897A1 · Pierce et al. · 2013 [cited by applicant]
US 20140010084A1 · Kavunder et al. · 2014 [cited by applicant]
US 20140025777A1 · Spencer · 2014 [cited by examiner]
US 20140032850A1 · Phelan et al. · 2014 [cited by applicant]
US 20140033268A1 · Julisch et al. · 2014 [cited by applicant]
US 20140059226A1 · Messerli et al. · 2014 [cited by applicant]
US 20140068611A1 · Mcgrath et al. · 2014 [cited by applicant]
US 20140068703A1 · Balus et al. · 2014 [cited by applicant]
US 20140074973A1 · Kumar et al. · 2014 [cited by applicant]
US 20140082699A1 · Eicken et al. · 2014 [cited by applicant]
US 20140086177A1 · Adjakple et al. · 2014 [cited by applicant]
US 20140109188A1 · Pavlov et al. · 2014 [cited by applicant]
US 20140112139A1 · Allan et al. · 2014 [cited by applicant]
US 20140115578A1 · Cooper et al. · 2014 [cited by applicant]
US 20140115583A1 · Lee et al. · 2014 [cited by applicant]
US 20140123129A1 · Risbood et al. · 2014 [cited by applicant]
US 20140130038A1 · Lucovsky et al. · 2014 [cited by applicant]
US 20140146673A1 · Parker · 2014 [cited by applicant]
US 20140149485A1 · Sharma et al. · 2014 [cited by applicant]
US 20140149492A1 · Ananthanarayanan et al. · 2014 [cited by applicant]
US 20140156850A1 · Hunt · 2014 [cited by applicant]
US 20140189109A1 · Jang · 2014 [cited by applicant]
US 20140201374A1 · Ashwood-Smith et al. · 2014 [cited by applicant]
US 20140279201A1 · Iyoob et al. · 2014 [cited by applicant]
US 20140280848A1 · Modh et al. · 2014 [cited by applicant]
US 20140280918A1 · Grandhe et al. · 2014 [cited by applicant]
US 20140280964A1 · Farooq et al. · 2014 [cited by applicant]
US 20140280966A1 · Sapuram et al. · 2014 [cited by applicant]
US 20140282037A1 · Narasimhan et al. · 2014 [cited by applicant]
US 20140282525A1 · Sapuram et al. · 2014 [cited by applicant]
US 20140282536A1 · Dave et al. · 2014 [cited by applicant]
US 20140317166A1 · Iyoob et al. · 2014 [cited by applicant]
US 20140317293A1 · Shatzkamer · 2014 [cited by applicant]
US 20150007169A1 · Li et al. · 2015 [cited by applicant]
US 20150033365A1 · Mellor et al. · 2015 [cited by applicant]
US 20150063166A1 · Sif et al. · 2015 [cited by applicant]
US 20150066929A1 · Satzke · 2015 [cited by examiner]
US 20150120890A1 · Ghai · 2015 [cited by applicant]
US 20150142958A1 · Tamura et al. · 2015 [cited by applicant]
US 20150149611A1 · Lissack · 2015 [cited by examiner]
US 20150180730A1 · Felstaine et al. · 2015 [cited by applicant]
US 20150180948A1 · Shao · 2015 [cited by applicant]
US 20150295750A1 · Blanco et al. · 2015 [cited by applicant]
US 20150326535A1 · Rao et al. · 2015 [cited by applicant]
US 20150347264A1 · Mohammed · 2015 [cited by examiner]
US 20150347759A1 · Cabrera · 2015 [cited by examiner]
US 20150358248A1 · Saha et al. · 2015 [cited by applicant]
US 20150363423A1 · Utgikar · 2015 [cited by examiner]
US 20150378703A1 · Govindaraju et al. · 2015 [cited by applicant]
US 20160013985A1 · Reddy et al. · 2016 [cited by applicant]
US 20160028434A1 · Kerpez et al. · 2016 [cited by applicant]
US 20160036835A1 · Lietz · 2016 [cited by examiner]
US 20160036983A1 · Korolev et al. · 2016 [cited by applicant]
US 20160047566A1 · Haga et al. · 2016 [cited by applicant]
US 20160057075A1 · Parikh et al. · 2016 [cited by applicant]
US 20160080496A1 · Falanga et al. · 2016 [cited by applicant]
US 20160112875A1 · Kasravi et al. · 2016 [cited by applicant]
US 20160188877A1 · Simha et al. · 2016 [cited by applicant]
US 20160216994A1 · Sefidcon et al. · 2016 [cited by applicant]
US 20160241446A1 · Gupte · 2016 [cited by examiner]
US 20160344587A1 · Hoffmann · 2016 [cited by examiner]
US 20170063598A1 · Zhu et al. · 2017 [cited by applicant]
US 20170093749A1 · Hoffmann · 2017 [cited by examiner]
US 20170324612A1 · Perez · 2017 [cited by examiner]
US 20170373986A1 · Parikh et al. · 2017 [cited by applicant]
Network Functions Virtualisation (NFV); Use Cases, ETSI, Oct. 2013, 50 pages. [cited by applicant]
The Real-Time Cloud, Ericsson While Paper, Feb. 2014, 11 pages. [cited by applicant]
The Role of Layer 4-7 Services in Scaling Applications for the Cloud-Computing Data Center, Cisco, 2011, 21 pages. [cited by applicant]
Virtualizing network services—the lelecom cloud, Ericsson Review, Ericsson, Mar. 28, 2014, 10 pages. [cited by applicant]
U.S. Appl. No. 14/464,212, “U.S. Appl. No. 14/464,212 Notice of Allowance mailed Apr. 3, 2017”, 7 pages. [cited by applicant]
U.S. Appl. No. 14/464,212, “U.S. Appl. No. 14/464,212, Non Final Office Action mailed Oct. 20, 2016”, 14 pages. [cited by applicant]
U.S. Appl. No. 14/464,222, “U.S. Appl. No. 14/464,222, Final Office Action mailed Nov. 17, 2017”, 12 pages. [cited by applicant]
U.S. Appl. No. 14/464,222, “U.S. Appl. No. 14/464,222, Final Office Action mailed Nov. 2, 2016”, 11 Pages. [cited by applicant]
U.S. Appl. No. 14/464,222, “U.S. Appl. No. 14/464,222, Non Final Office Action mailed Apr. 13, 2018”, 12 pages. [cited by applicant]
U.S. Appl. No. 14/464,222, “U.S. Appl. No. 14/464,222, Non Final Office Action mailed Apr. 20, 2017”, 12 pages. [cited by applicant]
U.S. Appl. No. 14/464,222, “U.S. Appl. No. 14/464,222, Non Final Office Action mailed Apr. 6, 2016”, 17 Pages. [cited by applicant]
U.S. Appl. No. 14/464,241, “U.S. Appl. No. 14/464,241, Non Final Office Action mailed Feb. 18, 2016”, 23 pages. [cited by applicant]
U.S. Appl. No. 14/464,254, “U.S. Appl. No. 14/464,254, Non Final Office Action mailed Oct. 20, 2016”, 15 pages. [cited by applicant]
U.S. Appl. No. 14/464,261, “U.S. Appl. No. 14/464,261, Final Office Action mailed Jan. 12, 2017”, 37 pages. [cited by applicant]
U.S. Appl. No. 14/464,261, “U.S. Appl. No. 14/464,261, Final Office Action mailed Feb. 16, 2018”, 34 pages. [cited by applicant]
U.S. Appl. No. 14/464,261, “U.S. Appl. No. 14/464,261, Non Final Office Action mailed May 18, 2016”, 35 Pages. [cited by applicant]
U.S. Appl. No. 14/464,283, “U.S. Appl. No. 14/464,283 Final Office Action mailed Aug. 12, 2015”, 26 Pages. [cited by applicant]
U.S. Appl. No. 14/464,283, “U.S. Appl. No. 14/464,283, Final Office Action mailed Jul. 12, 2016”, 28 Pages. [cited by applicant]
U.S. Appl. No. 14/464,283, “U.S. Appl. No. 14/464,283, Interview Summary mailed Jun. 2, 2017”, 1 Page. [cited by applicant]
U.S. Appl. No. 14/464,283, “U.S. Appl. No. 14/464,283, Non Final Office Action mailed Oct. 31, 2016”, 32 Pages. [cited by applicant]
U.S. Appl. No. 14/464,283, “U.S. Appl. No. 14/464,283, Non Final Office Action mailed Dec. 17, 2015”, 25 Pages. [cited by applicant]
U.S. Appl. No. 14/464,283, “U.S. Appl. No. 14/464,283, Non Final Office Action mailed Apr. 10, 2015”, 28 Pages. [cited by applicant]
U.S. Appl. No. 14/464,283, “U.S. Appl. No. 14/464,283, Notice of Allowance mailed Jun. 2, 2017”, 26 Pages. [cited by applicant]
U.S. Appl. No. 15/295,193, “U.S. Appl. No. 15/295,193 Non Final Office Action mailed Jun. 27, 2018”, 34 pages. [cited by applicant]
U.S. Appl. No. 15/295,193, “U.S. Appl. No. 15/295,193, Final Office Action mailed Nov. 27, 2018”, 26 pages. [cited by applicant]
Basilier, et al., “Virtualizing network services—the telecom cloud”, Ericsson Review, Ericsson, Mar. 28, 2014, 10 pages. [cited by applicant]
Binz, et al., “Portable Cloud Services Using TOSCA”, IEEE Internet Computing 16.3, 2012, pp. 80-85. [cited by applicant]
Harmer, et al., “An application-centric model for cloud management”, Services (Services1), 2010 6th World Congress on. IEEE, 2010, 8 pages. [cited by applicant]
Kachele, et al., “Beyond IaaS and PaaS: An Extended Cloud Taxonomy for Computation, Storage and Networking”, Proceedings of the 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing. IEEE Computer So… [cited by applicant]
Kim, et al., “SipCloud: Dynamically Scalable SIP proxies in the Cloud”, Proceedings of the 5th International Conference on Principles, Systems and Applications of IP Telecommunications. ACM, 2011, 6 pages. [cited by applicant]
Manzalini, et al., “Clouds of Virtual Machines in Edge Networks”, IEEE Communications Magazine, IEEE 51.7, Jul. 2013, pp. 63-70. [cited by applicant]
Manzalini, et al., “Software Networks at the Edge: A shift of paradigm”, Future Networks and Services (SDN4FNS), IEEE, 2013, 6 pages. [cited by applicant]
Nair, et al., “Software Defined Network and Network Functions Virtualization”, Aricent, 2014, 16 pages. [cited by applicant]
Onug Board of Directors, “Open Networking Challenges and Opportunities”, White paper, Open Networking User Group, Jul. 2014, 8 pages. [cited by applicant]
Ravindran, et al., “Towards Software Defined ICN based Edge-Cloud Services”, Cloud Networking (CloudNet), 2013 IEEE 2nd International Conference on. IEEE, 2013, 9 pages. [cited by applicant]
Rochwerger, et al., “Reservoir—When one cloud is not enough”, IEEE computer 44.3, 2011, 7 pages. [cited by applicant]
Scholler, et al., “Resilient deployment of virtual network functions”, Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT), 2013 5th International Congress on. IEEE, 2013, 7 pages. [cited by applicant]
Somorovsky, et al., “All Your Clouds are Belong to us: Security Analysis of Cloud Management Interfaces”, Proceedings of the 3rd ACM workshop on Cloud computing security workshop, ACM, 2011, 12 pages. [cited by applicant]
Sotomayor, et al., “An Open Source Solution for Virtual Infrastructure Management in Private and Hybrid Clouds”, Internet Computing, IEEE 13.5, 2009, pp. 14-22. [cited by applicant]
Stanek, et al., “Characteristics of Real Open SIP-Server Traffic”, Passive and Active Measurement. Springer Berlin Heidelberg, 2013, pp. 187-197. [cited by applicant]
Xu, et al., “URL: A Unified Reinforcement Learning Approach for Autonomic Cloud Management”, Journal of Parallel and Distributed Computing 72.2, 2012, pp. 95-105. [cited by applicant]
Cited By (1)
US 12,671,662