Techniques for building data centers in cloud regions
Techniques are described for performing an automated region build. An orchestration service (e.g., a Multi-Flock Orchestrator) may managing bootstrapping efforts for any suitable number of services within a region corresponding to one or more data centers. Each service can be associated with a respective set of resources (e.g., infrastructure components, software artifacts, etc.). The orchestration service can identify dependencies between services based on corresponding configuration files associated with the services. The orchestration service can determine, based on the identified dependencies, an order by which operations for bootstrapping the services are to be performed. The orchestration service can incrementally instruct other system components (e.g., a provisioning and deployment manager) to perform operations for bootstrapping the plurality of services in accordance with determined order.
1 . A computer-implemented method, comprising:
obtaining, by an orchestration service of a cloud-computing environment, a plurality of configuration files corresponding to a plurality of services to be bootstrapped within a region corresponding to one or more data centers, each of the plurality of services being associated with a respective set of resources comprising at least one of an infrastructure component or a corresponding software artifact;
identifying, by the orchestration service, one or more dependencies between the plurality of services based at least in part on performing a static flock analysis of the plurality of configuration files;
generating, by the orchestration service, a build dependency graph that indicates an order by which operations for bootstrapping the plurality of services are to be executed, the order being determined based at least in part on the one or more dependencies that were identified from performing the static flock analysis of the plurality of configuration files;
in accordance with traversing to a first node of the build dependency graph, instructing, by the orchestration service, a provisioning and deployment service of a control plane to bootstrap a first set of resources corresponding to a first service of the plurality of services, the provisioning and deployment service transmitting first desired state data to a declarative infrastructure provisioner causing the declarative infrastructure provisioner to perform within the region a first set of bootstrapping tasks corresponding to the first service; and
in accordance with traversing to a second node of the build dependency graph, instructing, by the orchestration service, the provisioning and deployment manager of the control plane to bootstrap a second set of resources corresponding to a second service of the plurality of services, the provisioning and deployment manager transmitting second desired state data to the declarative infrastructure provisioner causing the declarative infrastructure provisioner to perform within the region a second set of bootstrapping tasks corresponding to the second service.
2 . The computer-implemented method of claim 1 , further comprising:
identifying, by the orchestration service from the build dependency graph, that the second service has a corresponding dependency on a capability of the first service being available;
identifying that the capability of the first service is unavailable; and
transmitting data to a capabilities service indicating a request to be notified when the capability of the first service becomes available.
3 . The computer-implemented method of claim 2 , wherein identifying the capability of the first service is unavailable comprises determining that a notification indicating that the capability of the first service is available has yet to be received from the capabilities service of the cloud-computing environment.
4 . The computer-implemented method of claim 3 , further comprising:
receiving, by the orchestration service from the capabilities service, a corresponding notification indicating that the capability of the first service is available, wherein the orchestration service instructs the provisioning and deployment manager to bootstrap the second set of resources corresponding to the second service in response to receiving the notification that the capability of the first service is available.
5 . The computer-implemented method of claim 3 , wherein instructing the provisioning and deployment manager to bootstrap the first service of the plurality of services causes the declarative infrastructure provisioner to provision at least one infrastructure component or deploy one or more artifacts within the region.
6 . The computer-implemented method of claim 3 , wherein the static flock analysis comprises executing one or more parses of the plurality of configuration files.
7 . The computer-implemented method of claim 1 , wherein the plurality of configuration files are identified from a predefined version set.
8 . A cloud-computing system comprising:
one or more processors; and
one or more memories storing computer-executable instructions that, when executed by the one or more processors, cause an orchestration service of the cloud-computing system to:
obtain a plurality of configuration files corresponding to a plurality of services to be bootstrapped within a region corresponding to one or more data centers, each of the plurality of services being associated with a respective set of resources comprising an infrastructure component and a corresponding software artifact;
identify one or more dependencies between the plurality of services based at least in part on performing a static flock analysis of the plurality of configuration files;
generate a build dependency graph that indicates an order by which operations for bootstrapping the plurality of services are to be executed, the order being determined based at least in part on the one or more dependencies that were identified from performing the static flock analysis of the plurality of configuration files;
in accordance with traversing to a first node of the build dependency graph, instruct a provisioning and deployment service of a control plane to bootstrap a first set of resources corresponding to a first service of the plurality of services, the provisioning and deployment service transmitting first desired state data to a declarative infrastructure provisioner causing the declarative infrastructure provisioner to perform within the region a first set of bootstrapping tasks corresponding to the first service; and
in accordance with traversing to a second node of the build dependency graph, instruct the provisioning and deployment manager of the control plane to bootstrap a second set of resources corresponding to a second service of the plurality of services, the provisioning and deployment manager transmitting second desired state data to the declarative infrastructure provisioner causing the declarative infrastructure provisioner to perform within the region a second set of bootstrapping tasks corresponding to the second service.
9 . The cloud-computing system of claim 8 , wherein executing the computer-executable instructions further causes the orchestration service to:
identify, from the build dependency graph, that the second service has a corresponding dependency on a capability of the first service being available;
identify that the capability of the first service is unavailable; and
transmit data to a capabilities service indicating a request to be notified when the capability of the first service becomes available.
10 . The cloud-computing system of claim 9 , wherein executing the computer-executable instructions that cause the orchestration service to identify that the capability of the first service is unavailable comprises determining that a notification indicating that the capability of the first service is available has yet to be received from the capabilities service of the cloud-computing system.
11 . The cloud-computing system of claim 10 , wherein executing the computer-executable instructions to instruct the provisioning and deployment manager further causes the orchestration service to:
receive, from the capabilities service, a corresponding notification indicating that the capability of the first service is available, wherein executing the computer-executable instructions that cause the orchestration service to instruct the provisioning and deployment manager to bootstrap the second set of resources corresponding to the second service are executed in response to receiving the notification that the capability of the first service is available.
12 . The cloud-computing system of claim 8 , wherein executing the computer-executable instructions to instruct the provisioning and deployment manager to bootstrap the first service of the plurality of services causes the declarative infrastructure provisioner to provision at least one infrastructure component or deploy one or more artifacts within the region.
13 . The cloud-computing system of claim 8 , wherein the static flock analysis comprises executing one or more parses of the plurality of configuration files.
14 . The cloud-computing system of claim 8 , wherein the plurality of configuration files are identified from a predefined version set.
15 . A non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by one or more processors corresponding to an orchestration service of a cloud-computing system, cause the orchestration service to:
obtain a plurality of configuration files corresponding to a plurality of services to be bootstrapped within a region corresponding to one or more data centers, each of the plurality of services being associated with a respective set of resources comprising an infrastructure component and a corresponding software artifact;
identify one or more dependencies between the plurality of services based at least in part on performing a static flock analysis of the plurality of configuration files;
generate a build dependency graph that indicates an order by which operations for bootstrapping the plurality of services are to be executed, the order being determined based at least in part on the one or more dependencies that were identified from performing the static flock analysis of the plurality of configuration files;
in accordance with traversing to a first node of the build dependency graph, instruct a provisioning and deployment service of a control plane to bootstrap a first set of resources corresponding to a first service of the plurality of services, the provisioning and deployment service transmitting first desired state data to a declarative infrastructure provisioner causing the declarative infrastructure provisioner to perform within the region a first set of bootstrapping tasks corresponding to the first service; and
in accordance with traversing to a second node of the build dependency graph, instruct the provisioning and deployment manager of the control plane to bootstrap a second set of resources corresponding to a second service of the plurality of services, the provisioning and deployment manager transmitting second desired state data to the declarative infrastructure provisioner causing the declarative infrastructure provisioner to perform within the region a second set of bootstrapping tasks corresponding to the second service.
16 . The non-transitory computer-readable storage medium of claim 15 , wherein executing the computer-executable instructions further causes the orchestration service to:
identify, from the build dependency graph, that the second service has a corresponding dependency on a capability of the first service being available;
identify that the capability of the first service is unavailable; and
transmit data to a capabilities service indicating a request to be notified when the capability of the first service becomes available.
17 . The non-transitory computer-readable storage medium of claim 16 , wherein executing the computer-executable instructions that cause the orchestration service to identify that the capability of the first service is unavailable comprises determining that a notification indicating that the capability of the first service is available has yet to be received from the capabilities service of the cloud-computing system.
18 . The non-transitory computer-readable storage medium of claim 17 , wherein executing the computer-executable instructions to instruct the provisioning and deployment manager further causes the orchestration service to:
receive, from the capabilities service, a corresponding notification indicating that the capability of the first service is available, wherein executing the computer-executable instructions that cause the orchestration service to instruct the provisioning and deployment manager to bootstrap the second set of resources corresponding to the second service are executed in response to receiving the notification that the capability of the first service is available.
19 . The non-transitory computer-readable storage medium of claim 15 , wherein executing the computer-executable instructions to instruct the provisioning and deployment manager to bootstrap the first service of the plurality of services causes the declarative infrastructure provisioner to provision at least one infrastructure component or deploy one or more artifacts within the region.
20 . The non-transitory computer-readable storage medium of claim 15 , wherein the plurality of configuration files are identified from a predefined version set.