System for automatically shadowing data and file directory structures for a plurality of network-connected computers using a network-attached memory
View Patent ↗The Networked Data Shadowing System comprises a memory module that is connected to a plurality of monitored computer systems via an existing communication medium to store the shadowed data. The memory module includes one or more memory devices for data storage as well as software, including a control software component that is automatically installed on the monitored computer systems when the monitored computer system is first connected to the memory module, as well as associated module software for maintaining a record of the data stored on the memory devices and controlling the operation of the memory devices. The Networked Data Shadowing System operates autonomously and achieves a significant amount of data storage efficiency by implementing a “data de-duplication” process to avoid storing multiple copies of the same files.
1. A data shadowing system, connected to a plurality of monitored computer systems, for the automatic backup storage of data into the data shadowing system that is written in the memories of a plurality of monitored computer systems and the selective retrieval of said data from the data shadowing system for restoration to said memories of said monitored computer systems, said data shadowing system comprising:
data shadow copy module, connected to a plurality of monitored computer systems via a communication medium, for storing a shadow copy of the data which is written in the memories of the plurality of monitored computer systems; and
customer data file manager, resident in each of said plurality of monitored computer systems, for autonomously transmitting customer data files, resident on said monitored computer system, to said data shadow copy module, comprising:
customer data file hash generator for processing each of said customer data files to generate an associated hash value of each of said customer data files,
customer data file storage manager for storing each of said customer data files and said associated hash value, received from each of said plurality of monitored computer systems via said communication medium, in said data shadow copy module, and
customer data file map generator for autonomously mapping file directory structures associated with each of customer data files that are written in the memory of the monitored computer system into file tree information which identifies original names of customer data files and a location of each customer data file as stored on said monitored computer system, and a corresponding location in said data shadow copy module which stores a copy of these customer data files to enable both memory-level and file-level restoration of data to replicate the disk image on the memory of the monitored computer system;
wherein said data shadow copy module further comprises:
duplication eliminator, responsive to a plurality of said customer data files received from said plurality of monitored computer systems, having the same hash value, for storing a single instance of said customer data file in said data shadow copy module; and
wherein said customer data file storage manager additionally stores said file tree information for each of said plurality of customer data files having the same hash value in said data shadow copy module.
2. The data shadowing system of claim 1 , further comprising:
system file manager for automatically mapping system files written in the memory of the monitored computer system into system file tree information which identifies original names of system files as stored on said monitored computer system, and a location in said data shadow copy module which stores said system files.
3. The data shadowing system of claim 2 wherein said system files comprise:
computer files, exclusive of customer provided data, including at least one of: master boot record, partition table, and programs.
4. The data shadowing system of claim 2 , further comprising:
system file hash generator for processing each of said system files to generate an associated hash value of each of said system files;
wherein said data shadow copy module further comprises:
system file storage manager for storing each of said system files and said associated hash value in said data shadow copy module; and
wherein said system file manager stores said hash value of each of said customer data files in said database.
5. The data shadowing system of claim 4 wherein said duplication eliminator is responsive to a plurality of said system files, received from said plurality of monitored computer systems, having the same hash value, for storing a single instance of said system file in said data shadow copy module.
6. The data shadowing system of claim 5 wherein said system file storage manager additionally stores said system file tree information for each of said plurality of system files having the same hash value and said associated hash value with said single instance of said system file in said data shadow copy module.
7. The data shadowing system of claim 1 wherein said customer data file manager further comprises:
change journal for automatically tracking changes to said customer data files, including: customer data file creation, customer data file movement, customer data file content changes, and customer data file renaming.
8. The data shadowing system of claim 7 wherein said customer data file manager further comprises:
file history, responsive to a modification of a customer data file, for generating file change data indicative of a difference between said customer data file and said modified customer data file; and
wherein said customer data file manager stores said file change data in said data shadow copy module and substitutes said modified customer data file for said customer data file in said data shadow copy module.
9. A method for the automatic backup storage of network data that is written in the memories of a plurality of monitored computer systems and the selective retrieval of said data for restoration to said memories, comprising:
storing, in a data shadow copy module which is connected to a plurality of monitored computer systems via a communication medium, a shadow copy of the data which is written in the memories of the plurality of monitored computer systems; and
managing customer data files, resident in each of said plurality of monitored computer systems, for autonomously transmitting customer data files, resident on said monitored computer system, to said data shadow copy module, comprising:
processing each of said customer data files to generate an associated hash value of each of said customer data files,
storing each of said customer data files and said associated hash value, received from each of said plurality of monitored computer systems via said communication medium, in said data shadow copy module, and
autonomously mapping file directory structures associated each of customer data files that are written in the memory of the monitored computer system into file tree information which identifies original names of customer data files and a location of each customer data file as stored on said monitored computer system, and a corresponding location in said data shadow copy module which stores a copy of these customer data files to enable both memory-level and file-level restoration of data to replicate the disk image on the memory of the monitored computer system;
wherein said step of storing in a data shadow copy module further comprises:
eliminating duplication, in response to a plurality of said customer data files received from said plurality of monitored computer systems, having the same hash value, by storing a single instance of said customer data file in said data shadow copy module; and
wherein said step of storing each of said customer data files additionally stores said file tree information for each of said plurality of customer data files having the same hash value in said data shadow copy module.
10. The method for the automatic backup storage of network data of claim 9 , further comprising:
automatically mapping system files written in the memory of the monitored computer system into file tree information which identifies original names of system files as stored on said monitored computer system and a location in said data shadow copy module which stores said system files.
11. The method for the automatic backup storage of network data of claim 10 wherein said system files comprise:
computer files, exclusive of customer provided data, including at least one of: master boot record, partition table, and programs.
12. The method for the automatic backup storage of network data of claim 10 , further comprising:
processing each of said system files to generate an associated hash value of each of said system files;
wherein said step of storing a shadow copy of data further comprises:
storing each of said system files and said associated hash value in said data shadow copy module; and
wherein said step of storing a shadow copy of data stores said hash value of each of said customer data files in said database.
13. The method for the automatic backup storage of network data of claim 12 , further comprising:
storing, in response to a plurality of said system files having the same hash value, a single instance of said system file in said data shadow copy module.
14. The method for the automatic backup storage of network data of claim 13 wherein said step of storing system files additionally stores said file tree information for each of said plurality of system files having the same hash value and said associated hash value with said single instance of said system file in said memory module.
15. The method for the automatic backup storage of network data of claim 9 wherein said step of managing customer data files comprises:
automatically tracking changes to said customer data files, including: customer data file creation, customer data file movement, customer data file content changes, and customer data file renaming.
16. The method for the automatic backup storage of network data of claim 15 wherein said step of managing customer data files further comprises:
generating, in response to a modification of a customer data file, file change data indicative of a difference between said customer data file and said modified customer data file; and
wherein said step of storing a shadow copy of data stores said file change data in said memory module and substitutes said modified customer data file for said customer data file in said memory module.