System and method for deploying, scaling and managing network endpoint groups in cloud computing environments
Grouping virtualized computing instances in cloud environments can be achieved utilizing groups of network endpoints, such as hardware devices, virtualized computing instances, etc. The network endpoint group (NEG) provides a logical grouping for providers of backend services that may be arranged on the network endpoints, and may be organized based on the backend service to be provided by the computing environments that operate as network endpoints. For example, the NEGs may be implemented for load balancing applications. The network endpoint groups, and the network endpoints included therein, may be managed using a framework of tools, libraries and application programming interfaces.
1 . A computer-implemented method, comprising:
generating at least one network endpoint in a cloud computing environment, wherein:
the at least one network endpoint is configured to execute instances of an application;
allocating the at least one network endpoint to a network endpoint group (NEG) from among a plurality of NEGs, wherein each NEG among the plurality of NEGs is implemented with a different endpoint configuration;
adjusting a quantity of network endpoints associated with the NEG based on a number of instances of the application configured to be executed;
associating the at least one network endpoint with at least one IP address; and
enabling, based on one or more rules that allow data requests to reach the at least one network endpoint, communication between one or more processors and the at least one network endpoint.
2 . The computer-implemented method of claim 1 , wherein the at least one network endpoint is a virtual or physical computing device.
3 . The computer-implemented method of claim 1 , wherein the at least one network endpoint is a container or a virtual computing instance.
4 . The computer-implemented method of claim 1 , further comprising receiving a data request to communicate with the application executed by the at least one network endpoint.
5 . The computer-implemented method of claim 4 , wherein:
the at least one network endpoint is a first network endpoint of a first network endpoint group of a plurality of network endpoint groups,
the plurality of network endpoint groups further comprises a second network endpoint group comprising one or more second network endpoints executing instances of the application; and
the method further comprises:
determining that the one or more second endpoints cannot receive the data request, and that the first network endpoint can receive the data request; and
in response to the determining, forwarding the data request to the first network endpoint group.
6 . The computer-implemented method of claim 4 , wherein:
the data request is of a first type of a plurality of types of data requests, and
the method further comprises identifying, from a plurality of network endpoint groups, one or more network endpoint groups comprising applications mapped to the first type of data request, wherein the one or more network endpoint groups comprises a first network endpoint group.
7 . The computer-implemented method of claim 1 , wherein the one or more processors are a NEG controller.
8 . A system, comprising:
one or more processors, the one or more processors configured to:
generate at least one network endpoint in a cloud computing environment, wherein:
the at least one network endpoint is configured to execute instances of an application;
allocate the at least one network endpoint to a network endpoint group (NEG) from among a plurality of NEGs, wherein each NEG among the plurality of NEGs is implemented with a different endpoint configuration;
adjust a quantity of network endpoints associated with the NEG based on a number of instances of the application configured to be executed;
associate the at least one network endpoint with at least one IP address; and
enable, based on one or more rules that allow data requests to reach the at least one network endpoint, communication between the one or more processors and the at least one network endpoint.
9 . The system of claim 8 , wherein the at least one network endpoint is a virtual or physical computing device.
10 . The system of claim 8 , wherein the at least one network endpoint is a container or a virtual computing instance.
11 . The system of claim 8 , wherein the one or more processors are further configured to receive a data request to communicate with the application executed by the at least one network endpoint.
12 . The system of claim 11 , wherein:
the at least one network endpoint is a first network endpoint of a first network endpoint group of a plurality of network endpoint groups,
the plurality of network endpoint groups further comprises a second network endpoint group comprising one or more second network endpoints executing instances of the application; and
the one or more processors are further configured to:
determine that the one or more second endpoints cannot receive the data request, and that the first network endpoint can receive the data request; and
in response to the determining, forward the data request to the first network endpoint group.
13 . The system of claim 11 , wherein:
the data request is of a first type of a plurality of types of data requests, and
the one or more processors are further configured to identify, from a plurality of network endpoint groups, one or more network endpoint groups comprising applications mapped to the first type of data request, wherein the one or more network endpoint groups comprises a first network endpoint group.
14 . The system of claim 8 , wherein the one or more processors are a NEG controller.
15 . One or more non-transitory computer-readable storage media comprising instructions that when performed by one or more processors, causes the one or more processors to perform operations comprising:
generating at least one network endpoint in a cloud computing environment, wherein:
the at least one network endpoint is configured to execute instances of an application, and
allocating the at least one network endpoint to a network endpoint group (NEG) from among a plurality of NEGs, wherein each NEG among the plurality of NEGs is implemented with a different endpoint configuration;
adjusting a quantity of network endpoints associated with the NEG based on a number of instances of the application configured to be executed;
associating the at least one network endpoint with at least one IP address; and
enabling, based on one or more rules that allow data requests to reach the at least one network endpoint, communication between one or more processors and the at least one network endpoint.
16 . The computer-readable storage media of claim 15 , wherein the at least one network endpoint is a virtual or physical computing device.
17 . The computer-readable storage media of claim 15 , wherein the at least one network endpoint is a container or a virtual computing instance.
18 . The computer-readable storage media of claim 15 , the operations further comprising receiving a data request to communicate with the application executed by the at least one network endpoint.
19 . The computer-readable storage media of claim 18 , wherein:
the at least one network endpoint is a first network endpoint of a first network endpoint group of a plurality of network endpoint groups,
the plurality of network endpoint groups further comprises a second network endpoint group comprising one or more second network endpoints executing instances of the application; and
the operations further comprising:
determining that the one or more second endpoints cannot receive the data request, and that the first network endpoint can receive the data request; and
in response to the determining, forwarding the data request to the first network endpoint group.
20 . The computer-readable storage media of claim 18 , wherein:
the data request is of a first type of a plurality of types of data requests, and
the operations further comprise identifying, from a plurality of network endpoint groups, one or more network endpoint groups comprising applications mapped to the first type of data request, wherein the one or more network endpoint groups comprises a first network endpoint group.