Systems and methods for monitoring globally distributed remote storage devices
Methods and systems are described for remotely monitoring a plurality of distributed remote storage devices. An example computer implemented method includes locally collecting monitoring data for one of the plurality of distributed remote storage devices, and periodically sending at least one of an aggregate of the locally recorded monitoring data and a summary of the locally recorded monitoring data to a remote location. The remote location includes at least one of another one of the plurality of distributed remote storage devices, at least one central server, and a set of the plurality of distributed remote storage devices.
1. A computer implemented method for remotely monitoring a plurality of distributed remote storage devices at a first server, comprising:
receiving a summary of recorded monitoring data from a first distributed remote storage device;
locally collecting monitoring data;
locally storing the locally collected monitoring data and the received summary of recorded monitoring data;
transmitting the locally collected monitoring data and the received summary of the recorded monitoring data periodically to at least one of a second distributed remote storage device and a second server;
determining that a number of transmissions of the locally collected monitoring data and the received summary of the recorded monitoring data satisfies a threshold based at least in part on the transmitting; and
deleting the locally collected monitoring data and the received summary of the recorded monitoring data based at least in part on the determining.
2. The method of claim 1 , further comprising:
transmitting a request for further information to the first distributed remote storage device.
3. The method of claim 2 , wherein transmitting the request for further information comprises transmitting a request to re-transmit the summary of the recorded monitoring data.
4. The method of claim 2 , wherein transmitting the request for further information comprises transmitting a request to request to re-format the recorded monitoring data.
5. The method of claim 2 , wherein transmitting the request for further information comprises transmitting a request for at least another type of monitoring data recorded at the first distributed remote storage device.
6. The method of claim 2 , wherein transmitting the request for further information comprises transmitting a request to request for at least a second frequency for sending the recorded monitoring data.
7. The method of claim 2 , further comprising:
determining a transmission failure associated with the summary of the recorded monitoring data, wherein transmitting the request for further information is based at least in part on the determined transmission failure.
8. The method of claim 1 , wherein the transmission failure associated with the summary of the recorded monitoring data is based at least in part on at least one of bandwidth restrictions, hardware failures and lost data.
9. The method of claim 1 , wherein the monitoring data includes at least one of processor utilization, disk space utilization, input/output load, and network traffic statistics.
10. The method of claim 1 , wherein the monitoring data includes at least one of counts of method invocations, timing data about execution paths, and error and success path counts.
11. The method of claim 1 , further comprising:
receiving at least one of a summary and an aggregate of recorded monitoring data from at least another remote storage device from the plurality of remote storage devices.
12. An apparatus for remotely monitoring a plurality of distributed remote storage devices, comprising:
a processor;
a memory in electronic communication with the processor; and
instructions stored in the memory, the instructions being executable by the processor to:
receive a summary of recorded monitoring data from a first distributed remote storage device;
locally collect monitoring data;
locally store the locally collected monitoring data and the received summary of recorded monitoring data;
transmit the locally collected monitoring data and the received summary of the recorded monitoring data periodically to at least one of a second distributed remote storage device and a central server;
determine that a number of transmissions of the locally collected monitoring data and the received summary of the recorded monitoring data satisfies a threshold based at least in part on the transmitting; and
delete the locally collected monitoring data and the received summary of the recorded monitoring data based at least in part on the determining.
13. The apparatus of claim 12 , wherein the instructions are executable by the processor to:
transmit a request for further information to the first distributed remote storage device.
14. The apparatus of claim 13 , wherein transmitting the request for further information comprises transmitting a request to re-transmit the summary of the recorded monitoring data.
15. The apparatus of claim 13 , wherein transmitting the request for further information comprises transmitting a request to request to re-format the recorded monitoring data.
16. The apparatus of claim 13 , wherein transmitting the request for further information comprises transmitting a request for at least another type of monitoring data recorded at the first distributed remote storage device.
17. The apparatus of claim 13 , wherein transmitting the request for further information comprises transmitting a request to request for at least a second frequency for sending the recorded monitoring data.
18. A computer-program product for remotely monitoring a plurality of distributed remote storage devices, the computer-program product comprising a non-transitory computer-readable medium storing instructions executable by a processor to:
receive a summary of recorded monitoring data from a first distributed remote storage device;
locally collect monitoring data;
locally store the locally collected monitoring data and the received summary of recorded monitoring data;
transmit the locally collected monitoring data and the received summary of the recorded monitoring data periodically to at least one of a second distributed remote storage device and a central server;
determine that a number of transmissions of the locally collected monitoring data and the received summary of the recorded monitoring data satisfies a threshold based at least in part on the transmitting; and
delete the locally collected monitoring data and the received summary of the recorded monitoring data based at least in part on the determining.
19. The computer-program product of claim 18 , wherein the instructions are executable by the processor to:
transmit a request for further information to the first distributed remote storage device.
20. The computer-program product of claim 19 , wherein transmitting the request for further information comprises transmitting a request to re-transmit the summary of the recorded monitoring data.