Cloud data lake platform and SaaS orchestration
A method for rapid deployment by a service provider of a data lake in association with a cloud computing service. In response to a request to provision the data lake, a new cloud account is created. Within the new cloud account, a service provider access role and associated permissions are created. The new cloud account is then associated, by cross-trust, with an account in the cloud computing service that is one of: a service provider deployment account, and a customer account. A private data cloud is then associated with the service provider deployment account or the customer account, as the case may be. The private data cloud is uniquely associated with the new cloud account and the data lake. A firewall service enabling secure access between the data lake and an external enterprise network is provisioned. The data lake is then provisioned in the private data cloud to complete the rapid deployment.
1. A method for rapid deployment by a service provider of a data lake in association with a cloud computing service, comprising:
responsive to receipt of a request to provision the data lake, creating a new cloud account;
within the new cloud account, creating a service provider access role and associated permissions;
associating, by cross-trust, the new cloud account with an account in the cloud computing service that is one of: a service provider deployment account, and a customer account;
associating a private data cloud with the service provider deployment account or the customer account, the private data cloud being uniquely associated with the new cloud account and the data lake;
provisioning a firewall service in association with the private data cloud, the firewall service enabling secure access between the data lake and an external enterprise network; and
provisioning the data lake in the private data cloud to complete the rapid deployment; wherein the method is carried out in an automated manner in software executing on hardware.
2. The method as described in claim 1 further including provisioning one or more virtual private cloud endpoints to provide one or more services to the private data cloud.
3. The method as described in claim 2 wherein the one or more services include one of: a domain name service (DNS), a data integration service for analytics, machine learning and application development, a data storage service, a secrets manager, and a key management service.
4. The method as described in claim 1 wherein the private data cloud comprising a set of subnets.
5. The method as described in claim 4 wherein a given subnet of the set of subnets hosts one or more services associated with the service provider.
6. The method as described in claim 4 wherein a given subnet of the set of subnets hosts a big data platform that supports one or more data lake engines.
7. The method as described in claim 1 wherein the data lake is provisioned at a time scale measured in minutes.
8. The method as described in claim 1 wherein the data lake is a single tenant operating environment accessible via the firewall service from the external enterprise network.
9. The method as described in claim 1 further including receiving a request to instantiate an analytics engine in the data lake, the request to instantiate initiated at a network-accessible console.
10. The method as described in claim 1 further including configuring a monitoring service in association with the data lake, the monitoring service being associated with one of: Developer/IT operations (DevOps) and Security/IT operations (SecOps).
11. A software-as-a-service computing platform, comprising:
computing hardware;
computer software executing on the computing hardware, the computer software comprising program code executed on the computing hardware and configured to provide rapid deployment by a service provider of a data lake in association with a cloud computing service by:
responsive to receipt of a request to provision the data lake, creating a new cloud account;
within the new cloud account, creating a service provider access role and associated permissions;
associating, by cross-trust, the new cloud account with an account in the cloud computing service that is one of: a service provider deployment account, and a customer account;
associating a private data cloud with the service provider deployment account or the customer account, the private data cloud being uniquely associated with the new cloud account and the data lake;
provisioning a firewall service in association with the private data cloud, the firewall service enabling secure access between the data lake and an external enterprise network; and
provisioning the data lake in the private data cloud to complete the rapid deployment.
12. The computing platform as described in claim 11 wherein the program code is further configured to provision one or more virtual private cloud endpoints to provide one or more services to the private data cloud.
13. The computing platform as described in claim 12 wherein the one or more services include one of: a domain name service (DNS), a data integration service for analytics, machine learning and application development, a data storage service, a secrets manager, and a key management service.
14. The computing platform as described in claim 11 wherein the private data cloud comprises a set of subnets.
15. The computing platform as described in claim 14 wherein a given subnet of the set of subnets hosts one or more services associated with the service provider.
16. The computing platform as described in claim 14 wherein a given subnet of the set of subnets hosts a big data platform that supports one or more data lake analytics engines.
17. The computing platform as described in claim 14 wherein the data lake is provisioned at a time scale measured in minutes.
18. The computing platform as described in claim 11 wherein the data lake is a single tenant operating environment accessible via the firewall service from the external enterprise network.
19. The computing platform as described in claim 11 wherein the program code is further configured to receive a request to instantiate an analytics engine in the data lake, the request to instantiate initiated at a network-accessible console.
20. The computing platform as described in claim 11 further including configuring a monitoring service in association with the data lake, the monitoring service being associated with one of: Developer/IT operations (DevOps) and Security/IT operations (SecOps).