Creating a self-contained portable output file
View Patent ↗Various embodiments provide for creating a self-contained portable output file that includes a de-duplicated version of data. According to one embodiment, data, which includes a selected group of files, is partitioned into subblocks. A de-duplicated version of the data is created by eliminating a second subblock from the data and using a first subblock to represent the second subblock, if the second subblock is a duplicate of the first subblock. A self-contained portable output file, which includes the de-duplicated version of the data, is created.
1. A method of creating a self-contained portable output file, comprising:
accessing a selected group of files associated with a first computer, where the selected group of files are formatted in an original format;
accessing a pool of unique subblocks associated with the selected group of files, where the pool of unique subblocks is the product of a data de-duplication process and where the pool of unique subblocks contains sufficient data to recreate the selected group of files in the original format;
accessing a first data structure associated with the pool of unique subblock, where the first data structure stores a mapping that relates a subblock in the pool of unique subblocks to a member of the selected group of files;
accessing a second data structure associated with the pool of unique sub-blocks, where the second data structure stores a mapping that relates a hash value to a subblock in the pool of unique subblocks;
instantiating an output file;
adding file identification data to the output file, where the file identification data identifies one or more members of the selected group of files;
adding one or more subblocks to the output file, where the one or more subblocks are copied from the pool of unique subblocks and where the one or more subblocks are sufficient to recreate the one or more members of the selected group of files identified by the file identification data;
adding a first derived data structure to the output file, where the first derived data structure includes one or more members of the first data structure; and
adding a second derived data structure to the output file, where the second derived data structure includes one or more members of the second data structure;
where the output file contains sufficient data related to the files identified by the file identification data to facilitate a second computer different from the computer to recreate the files identified by the file identification data without accessing the selected group of files in their original format when the computer communicates the output file to the second computer.
2. The method of claim 1 , where the file identification data includes a namespace for the selected group of files.
3. The method of claim 1 , comprising adding a utility to the output file, where the utility facilitates viewing the group of selected files without accessing the selected group of files in their original format.
4. The method of claim 1 , comprising adding a utility to the output file, where the utility facilitates the output file self-extracting the file identification data, one or more subblocks, the first derived data structure, and the second derived data structure.
5. The method of claim 1 , comprising selectively updating the output file when a file is added to the selected group of files and when a file is removed from the selected group of files.
6. The method of claim 5 , where selectively updating the output file includes adding a subblock to the output file when a file is added to the selected group of files.
7. The method of claim 5 , where selectively updating the output file includes removing a subblock from the output file when a file is removed from the selected group of files.
8. The method of claim 1 , comprising controlling a first computer that performs the method to communicate the output file to a second computer that did not perform the method data.
9. A non-transitory computer-readable medium storing computer executable instructions that when executed by a computer cause the computer to perform a method, the method comprising:
accessing a selected group of files available to the computer;
accessing a pool of unique subblocks associated with the selected group of files, where the pool of unique subblocks is the product of a data de-duplication performed by the computer;
accessing a first data structure associated with the pool of unique subblocks, where the first data structure stores a mapping that relates a subblock in the pool of unique subblocks to a member of the selected group of files;
accessing a second data structure associated with the pool of unique sub-blocks, where the second data structure stores a mapping that relates a hash value to a subblock in the pool of unique subblocks, where the hash value was produced as part of the data de-duplication performed by the computer;
creating an empty output file;
adding file identification data to the output file, where the file identification data identifies one or more members of the selected group of files;
adding one or more subblocks to the output file, where the one or more subblocks are copied from the pool of unique subblocks and where the one or more subblocks are sufficient to recreate the members of the selected group of files identified by the file identification data;
adding a first derived data structure to the output file, where the first derived data structure includes one or more members of the first data structure; and
adding a second derived data structure to the output file, where the second derived data structure includes one or more members of the second data structure;
where the output file contains sufficient data related to the files identified by the file identification data to facilitate a second computer different from the computer to recreate the files identified by the file identification data without accessing the selected group of files in their original format when the computer communicates the output file to the second computer.