Method for automatic management capacity and placement for global services

1. A computer-implemented method for providing web service instances to support traffic demands for a particular web service in a large-scale distributed system, the method comprising:

determining a peak historical service load for the web service;

determining service load capacity for each existing web service instance;

determining a sum of the service load capacities of the existing web service instances;

calculating a remaining service load after subtracting the sum of the service load capacities of the existing web service instances from the peak historical service load for the web service;

determining a number of additional web service instances based on the remaining service load;

determining locations for the additional web service instances; and

creating the additional web service instances at the determined locations of the large-scale distributed system.

2. The computer-implemented method of claim 1 , wherein the peak historical service load includes queries per second.

3. The computer-implemented method of claim 1 , wherein

creating the additional web service instances further comprises creating the additional web services instances to accommodate the remaining service load when the remaining service load is greater than zero.

4. The computer-implemented method of claim 1 further comprising

removing web service instances to remove excess service load capacity when the remaining service load is less than zero.

5. The computer-implemented method of claim 4 further comprising shutting down the number of web service instances to be removed from the large-scale distributed system.

6. A computer-implemented method for determining locations of web service instances for a particular web service in a large-scale distributed system, the method comprising:

analyzing historical service load to determine physical origins of web service traffic and a total service load for the web service, wherein the web service is provided from assigned web service instance locations, each assigned web service instance location having a service load capacity;

determining a sum of the service load capacities of the assigned web service instance locations;

determining whether a remaining total service load to be assigned to a web service instance location is greater than the sum of the existing service load capacities of the assigned web service instance locations; and

when a remaining total service load to be assigned to a web service instance location is greater than the sum of the existing service load capacities of the assigned web service instance locations:

assigning a potential web service instance location within the large-scale distributed system a location score calculated by multiplying a service load to be handled at each potential location by a decreasing function of network distance to the determined physical origin of service load traffic;

selecting a web service instance location from the potential web service instance locations by determining the potential web service instance location based on the location score; and

subtracting the service load handled by the selected web service instance location from the total service load to be handled for the web service; and

creating the web service instances in the selected web service instance locations.

7. A system for providing web service instances to support traffic demands for a particular web service in a large-scale distributed system, the system comprising:

one or more processing devices and

one or more storage devices storing instructions that, when executed by the one or more processing devices cause the one or more processing devices to:

determine a peak historical service load for the web service;

determine a service load capacity for each existing web service instance;

determine a sum of the service load capacities of the existing web service instances;

calculate a remaining service load after subtracting the sum of the service load capacities of the existing web service instances from the peak historical service load for the web service;

determine a number of additional web service instances based on the remaining service load;

determine locations for the additional web service instances; and

create the additional web service instances at the determined locations of the large-scale distributed system.

8. The system of claim 7 , wherein the peak historical service load includes queries per second.

9. The system of claim 7 , wherein

creating the additional web service instances further comprises creating the additional web service instances to accommodate the remaining service load when the remaining service load is greater than zero.

10. The system of claim 7 further comprising

removing web service instances to remove excess service load capacity when the remaining service load is less than zero.

11. The system of claim 10 further comprising shutting down the number of web service instances to be removed from the large-scale distributed system.