Method of increasing capacity to process operational data
A first-system has a plurality of interconnected computers which receive operational data from remote data sources. The first-system has a software application for processing the operational data received from remote data sources and the operational data characterizes performance of one or more software applications running on the remote data sources. A load capacity “L” for the first-system is determined; wherein L is the number of remote data sources that can be processed before the system becomes overloaded. The first-system is repeatedly monitors remote data sources to determine their number. When the number of remote data sources exceeds a predetermined fraction of L the first-system is replicated and replications are installed. When a client requests data from one of the systems, using a time stamp the data is automatically provided. The first-system is replicated as more processing power is required conditional upon the load capacity of the system.
1. A method of increasing capacity of a first system to process operational data, wherein the first system has a plurality of interconnected computers connected to receive the operational data from remote data sources, wherein the first system has a software application for processing the operational data received from remote data sources, wherein the operational data characterizes an aspect of performance of one or more software applications running on the remote data sources,
the method comprising:
a) determining a load capacity “L” for the first system to be expanded, wherein L>100 and wherein L is the number of remote data sources that can be processed before the system becomes overloaded;
b) while the first system is processing data, repeatedly monitoring incoming remote data sources to determine their number;
c) in dependence upon the number of remote data sources exceeding a predetermined fraction of L greater than 0.5 L and <L, repeatedly replicating the first system to form a plurality of replicated first systems and installing the replicated first systems to increase overall capacity to process data from the remote data sources while the first system is processing data;
d) upon request from a client, retrieving from the first system or one of the replicated systems, data related to a particular requested software application, by using a time stamp or a time series, in the absence of information related to which of the first and replicated systems the data resides in.
2. A method as defined in claim 1 wherein the step of determining load capacity L comprises adding remote data sources while monitoring the first system for an overload condition.
3. A method as defined in claim 2 wherein the step of monitoring includes identifying an IP address host name and time of initial connection of each remote data source.
4. A method as defined in claim 1 wherein the step of replication includes provisioning a copy of the first system wherein the hardware and software are replicated while the first system continues to process operational data.
5. A method as defined in claim 2 wherein the process of installing a replicated system includes modifying a configuration of a collection mechanism on a plurality of remote data sources so that data will be sent to a replicated system.
6. A method as defined in claim 1 wherein the step of retrieving includes accessing a global database to the first system and the replicated systems and providing the time stamp and an identity of the particular software application and receiving the location a system data resides in.
7. A method as defined in claim 6 wherein the step of monitoring incoming remote data sources includes tracking both the number of servers and number of executing processes on each of those servers.