SYSTEMS AND METHODS FOR REAL-TIME BILLING AND METRICS REPORTING
Systems and methods provide real-time reporting for a data storage volume by sampling one or more storage metrics on the volume on a periodic basis; packaging the metrics into one or more messages; queuing the messages at one or more message queuing servers; and delivering to predetermined receiving agents that store the messages in a database holding aggregate metrics for the volume and correlated by customer.
1 . A method for real-time reporting for a data storage volume, comprising:
sampling one or more storage metrics on the volume on a periodic basis;
packaging the metrics into one or more messages;
queuing the messages at one or more message queuing servers; and
delivering to predetermined receiving agents that store the messages in a database holding aggregate metrics for the volume and correlated by customer.
2 . The method of claim 1 , comprising periodically rolling up data to reduce data granularity.
3 . The method of claim 2 , wherein the rolling-up comprises querying the database for a specified roll up interval, receiving the data, calculating an average and generating a rollup entry in the database.
4 . The method of claim 3 , comprising removing old data points from the database.
5 . The method of claim 2 , comprising using rolled-up metrics to replace an interval of sampled data and determining averages of larger time periods.
6 . The method of claim 2 , comprising using rolled-up metrics for a graphical display of time series metrics.
7 . The method of claim 1 , comprising packaging each sample in a format including a volume identifier, a timestamp and one or more collected metrics.
8 . The method of claim 1 , comprising displaying an arbitrary set of metrics for user review.
9 . The method of claim 1 , comprising providing a zoom view to show more data to the user.
10 . The method of claim 1 , comprising executing billing agents that aggregate monthly metrics into a monthly bill based on average or maximum storage for a month, and average, actual, or maximum bandwidth for the month.
11 . A system, comprising:
a plurality of customer computers to be backed-up, each customer computer running a client software to transfer back-up data files and to provide real-time billing and metrics reporting by sampling one or more storage metrics on the volume on a periodic basis; packaging the metrics into one or more messages; queuing the messages at one or more message queuing servers; and delivering to predetermined receiving agents that store the messages in a database holding aggregate metrics for the volume and correlated by customer;
a system management platform coupled to the client software over the Internet, the system management platform receiving inputs from a web user portal to control operations of the client software and the system management platform to back up the customer computer; and
two or more data storage silos, each including
a plurality of storage directors communicating with the client software; and
a clustered data storage array.
12 . The system of claim 11 , wherein the client software communicates using Web-based Distributed Authoring and Versioning to collaborative updating and management of files on remote web servers and wherein the client software selects the number of threads, and wherein the client software comprises a configurable parallelism selection for multi-processor efficiency and high latency connections, or for backing up NAS/SAN or RAID arrays with multiple disks.
13 . The system of claim 11 , wherein the data storage silos comprises a pair of head nodes and a plurality of storage nodes, wherein each storage node comprises a computer with disks and an on-disk encryptor to generate clear text and sent over an Internet Small Computer System Interface (iSCSI), wherein iSCSI traffic is load balanced and fails over network links and connected to a plurality of switches and wherein iSCSI data comprise whole disk mappings and wherein the head nodes create RAID stripes across the storage nodes.
14 . The system of claim 11 , comprising means for periodically rolling up data to reduce data granularity.
15 . The system of claim 14 , wherein the rolling-up comprises means for querying the database for a specified roll up interval, receiving the data, calculating an average and generating a rollup entry in the database.
16 . The system of claim 15 , comprising means for removing old data points from the database.
17 . The system of claim 14 , comprising means for using rolled-up metrics to replace an interval of sampled data and determining averages of larger time periods.
18 . The system of claim 11 , comprising means for using rolled-up metrics for a graphical display of time series metrics.
19 . The system of claim 11 , comprising means for packaging each sample in a format including a volume identifier, a timestamp and one or more collected metrics.
20 . The system of claim 11 , comprising one or more billing agents that aggregate monthly metrics into a monthly bill based on average or maximum storage for a month, and average, actual, or maximum bandwidth for the month.