Systems and methods for on-line backup and disaster recovery
A data recovery system includes a plurality of customer computers to be backed-up, each customer computer running a client software to communicate back-up data files; a system management platform coupled to the client software over the Internet, the system management platform receiving inputs from a web user portal to control operations of the client software and the system management platform to back up the customer computer; and two or more data storage silos, each including: a plurality of storage directors communicating with the client software; and a clustered data storage array.
1. A data recovery system, comprising:
a plurality of customer computers to be backed-up, each customer computer running a client software to communicate back-up data files including generating a first sub-file signature for one or more segments of a changed file; and subsequently generating another sub-file signature for each file segment and comparing them to detect insertions, removals, or rearrangements of data in the file and storing a plurality of signatures for each file locally on the computer representing the latest state of each file uploaded to a server; and transmitting one more changed segment(s) in the file, writing a manifest file reflecting the new target state as an incremental backup; compressing, encrypting and transmitting the changed segment through a Web-based Distributed Authoring and Versioning application program interface; expanding one or more patch sets and saving the patch sets with the file system to provide an incremental backup while generating a full backup; taking a snapshot after a full backup providing for a version history; mapping the file data and meta data to an arbitrary file system; and saving one or more snapshots of the meta data on the distributed meta data store for a subsequent reconstructing of files for the arbitrary file system;
a system management platform coupled to the client software over the Internet, the system management platform receiving inputs from a web user portal to control operations of the client software and the system management platform to back up the customer computer; and
two or more data storage silos, each including:
a plurality of storage directors communicating with the client software; and
a clustered data storage array,
wherein the data storage array comprises Redundant Array of Independent Nodes (RAIN) 6 storage nodes that ensures that even if two storage nodes go down that data is still available and RAIN protects a node, or server, cluster from failure.
2. The system of claim 1 , comprising a backend monitoring system.
3. The system of claim 1 , comprising a metrics and billing system.
4. The system of claim 1 , wherein the storage director comprises routers, load proxy units coupled to the routers, and servers coupled to the load proxy units.
5. The system of claim 1 , wherein each data storage silo comprises a shared-nothing geographically dispersed data center.
6. The system of claim 1 , wherein the client software communicates using Web-based Distributed Authoring and Versioning to collaborative updating and management of files on remote web servers and wherein the client software selects the number of threads.
7. The system of claim 1 , wherein the client software comprises a configurable parallelism selection for multi-processor efficiency and high latency connections, or for backing up NAS/SAN or RAID arrays with multiple disks.
8. The system of claim 1 , wherein the data storage silos comprises a pair of head nodes and a plurality of storage nodes.
9. The system of claim 8 , wherein each storage node comprises a computer with an open sourced operating system and one or more data storage devices.
10. The system of claim 8 , comprising an on-disk encryptor to generate clear text and sent over an Internet Small Computer System Interface (iSCSI).
11. The system of claim 10 , wherein iSCSI traffic is load balanced and fails over network links and connected to a plurality of switches.
12. The system of claim 10 , wherein iSCSI data comprise whole disk mappings and wherein the head nodes create RAID stripes across the storage nodes.
13. The system of claim 10 , wherein one head node is a standby head that, upon failure of the other head node, imports all iSCSI targets, takes over a file system and virtual IP addresses and resumes operation in a fail-safe manner.
14. The system of claim 1 , comprising a user interface to restore files through a group consisting of: the client software, a web based file browser replicating a look and feel of a native file explorer, and a remote data drive at the data storage silo acting as a local drive and mounted by a user.
15. The system of claim 1 , wherein the web user portal includes modules to manage, configure, recover and report on data protection jobs.
16. The system of claim 1 , comprising a database backup connector that automatically checkpoints a database, writes a current copy, detects and uploads sub file changes and allows for a local copy to be saved on a direct attached or network attached file system.
17. The system of claim 1 , comprising a module to create and replicate NetApp snapshots and recreate the snapshots identically on (Original) The system backend service.
18. The system of claim 1 , comprising a local drive synchronized with the data storage silo to maintain a local copy of back-up data.