Object synthesis
Apparatus, methods, and other embodiments associated with object synthesis are described. One example apparatus includes logic for identifying a block in a data de-duplication repository and for identifying a reference to the block. The apparatus also includes logic for representing a source object using a first named, organized collection of references to blocks in the data de-duplication repository and logic for representing a target object using a second named, organized collection of references. The apparatus is configured to synthesize the target object from the source object. Since synthesis may be complicated by edge cases, the apparatus is configured to account for conditions including a block in the target object needing less than all the data in a source object block, data to be used to synthesize the target object residing in a sparse hole in a data stream, and the target object needing data not present in the source object.
1. A non-transitory computer-readable storage device storing computer executable instructions that when executed by a computer control the computer to perform a method, the method comprising:
representing a source object using a first named, organized collection of references to blocks in a data de-duplication repository;
representing a target object using a second named, organized collection of references to blocks in the data de-duplication repository;
synthesizing the target object from the source object by manipulating the second named, organized collection of references based, at least in part, on data available through the first named, organized collection of references;
determining if the target object cannot be synthesized completely from data associated with the source object; and
selectively manipulating a parse context associated with a de-duplication process in response to determining that the target object cannot be synthesized completely from the data associated with the source object, where the parse context comprises a current position in an incident data stream, a rolling hash value, a pre-determined condition being evaluated by the de-duplication process, a pattern being sought by the de-duplication process, or progress towards the pattern being sought.
2. The non-transitory computer-readable storage device of claim 1 , where the blocks were processed by a de-duplication process.
3. The non-transitory computer-readable storage device of claim 2 , where the de-duplication process is a post-processing de-duplication process, a storage layout aware data de-duplication process, a storage layout aware cloning process, a storage layout aware replication process, a snapshot/replay process, or a de-duplication defragmentation process.
4. The non-transitory computer-readable storage device of claim 3 , where manipulating the second named, organized collection of references includes copying a member of the first named, organized collection of references to blocks to the second named, organized collection of references.
5. The non-transitory computer-readable storage device of claim 4 , where synthesizing the target object further comprises:
establishing the second named, organized collection of references by adding to the second named, organized collection of references zero or more references not found in the first named, organized collection of references;
establishing the second named, organized collection of references by adding to the second named, organized collection of references at least one reference not found in the first named, organized collection of references; or
logically adding to the second named, organized collection of references a block not referred to by the first named, organized collection of references.
6. The non-transitory computer-readable storage device of claim 5 , where synthesizing the target object further comprises accounting for a plurality of conditions.
7. The non-transitory computer-readable storage device of claim 6 , where the plurality of conditions includes a condition where a block associated with the target object needs less than all the data in a block associated with the source object, a condition where data to be used to synthesize the target object resides in a sparse hole in a data stream, and a condition where data to be used to synthesize the target object is not present in the source object.
8. The non-transitory computer-readable storage device of claim 1 , the method further comprising:
upon determining that the source object referred to by a reference to be copied from the first named, organized collection of references to the second named, organized collection of references includes data that is not needed in the target object:
controlling the computer to create a new block from just the data needed from the source object to synthesize the target object;
controlling the computer to provide a reference to the new block for use in synthesizing the target object; and
selectively controlling the computer to reparse just the data needed from the source object to synthesize the target object, or controlling the computer to physically mask or logically mask the data that is not needed.