Method and system for providing instant access of backup data
According to one embodiment, a restore module of a storage system receives a request from a client device over a network for restoring a data stream stored in the storage system. In response to the request, the restore module identifies a sparse disk file stored in the storage system, where the sparse disk file represents the requested data stream. The sparse disk file includes payload blocks sparsely located and intertwined with metadata of the sparse disk file. A converter executed in a memory by a processor of the storage system converts the sparse disk file into a native disk file based on the payload blocks of the sparse disk file, using a fast-copy method without having physically copying data content of the payload blocks. A block-based accessing interface is provided to the client to allow the client accessing the native disk file. Each block of content represented by the native disk is accessed based on a block identifier and an offset indicating a location of the block within the native disk file.
1. A computer-implemented method for restoring backup data, the method comprising:
receiving, by a restore module loaded in a memory and executed by a processor of a storage system, a request from a client device over a network for restoring a data stream stored in the storage system;
in response to the request, identifying by the restore module a sparse disk file stored in the storage system, the sparse disk file representing the requested data stream, wherein the sparse disk file includes a plurality of payload blocks sparsely located and intertwined with metadata of the sparse disk file, wherein the sparse disk file includes a block allocation table (BAT) having a plurality of block entries, each block entry corresponding to one of a plurality of data blocks within the payload blocks of the sparse disk file;
converting, by a converter executed in the memory by the processor of the storage system, the sparse disk file into a native disk file based on the payload blocks of the sparse disk file, wherein creating the native disk file includes locating, within the sparse disk file, a payload block corresponding to each of the plurality of block entries based on an offset of the block entry, and performing a fast-copy and rebase operation from the corresponding payload block to a new data block in the native disk file, wherein the native disk file has a size equal to a disk size specified by the sparse disk file; and
providing a block-based accessing interface to the client to allow the client accessing the native disk file, wherein each block of content represented by the native disk file is accessed based on a block identifier and an offset indicating a location of the block within the native disk file.
2. The method of claim 1 , wherein the sparse disk file is a virtual hard disk (VHD) compatible file.
3. The method of claim 1 , wherein the block-based accessing interface is one of a small computer system interface (SCSI) and Fibre channel interface.
4. The method of claim 1 , wherein converting the sparse disk file into a native disk file comprises:
parsing the sparse disk file to identify the block allocation table within the sparse disk file; and
for each of the block entries of the block allocation table, retrieving an offset from the block entry,
accessing a corresponding data block from the payload blocks of the sparse disk file based on the retrieved offset, and
determining a pointer of the corresponding data block, wherein the pointer of the data block is used to represent the data block without having to physically copy content of the data block.
5. The method of claim 4 , further comprising:
prior to parsing the sparse disk file, creating the native disk file as a place holder; and
for each of the block entries of the block allocation table of the sparse disk file, writing the pointer of the corresponding data block in a disk and volume content segment of the native disk file.
6. The method of claim 5 , further comprising writing a master boot record and a partition table of the native disk file based on the disk and volume content segment.
7. The method of claim 5 , wherein a pointer of a data block links to one of a plurality of payload blocks of the sparse disk file, without physically copying a corresponding payload block.
8. A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations for restoring backup data, the operations comprising:
receiving, by a restore module loaded into a memory and executed by a processor of a storage system, a request from a client device over a network for restoring a data stream stored in the storage system;
in response to the request, identifying by the restore module a sparse disk file stored in the storage system, the sparse disk file representing the requested data stream, wherein the sparse disk file includes a plurality of payload blocks sparsely located and intertwined with metadata of the sparse disk file, wherein the sparse disk file includes a block allocation table (BAT) having a plurality of block entries, each block entry corresponding to one of a plurality of data blocks within the payload blocks of the sparse disk file;
converting, by a converter executed in the memory by the processor of the storage system, the sparse disk file into a native disk file based on the payload blocks of the sparse disk file, wherein creating the native disk file includes locating, within the sparse disk file, a payload block corresponding to each of the plurality of block entries based on an offset of the block entry, and performing a fast-copy and rebase operation from the corresponding payload block to a new data block in the native disk file, wherein the native disk file has a size equal to a disk size specified by the sparse disk file; and
providing a block-based accessing interface to the client to allow the client accessing the native disk file, wherein each block of content represented by the native disk file is accessed based on a block identifier and an offset indicating a location of the block within the native disk file.
9. The non-transitory machine-readable medium of claim 8 , wherein the sparse disk file is a virtual hard disk (VHD) compatible file.
10. The non-transitory machine-readable medium of claim 8 , wherein the block-based accessing interface is one of a small computer system interface (SCSI) and Fibre channel interface.
11. The non-transitory machine-readable medium of claim 8 , wherein converting the sparse disk file into a native disk file comprises:
parsing the sparse disk file to identify the block allocation table within the sparse disk file; and
for each of the block entries of the block allocation table,
retrieving an offset from the block entry,
accessing a corresponding data block from the payload blocks of the sparse disk file based on the retrieved offset, and
determining a pointer of the corresponding data block, wherein the pointer of the data block is used to represent the data block without having to physically copy content of the data block.
12. The non-transitory machine-readable medium of claim 11 , wherein the operations further comprise:
prior to parsing the sparse disk file, creating the native disk file as a place holder; and
for each of the block entries of the block allocation table of the sparse disk file, writing the pointer of the corresponding data block in a disk and volume content segment of the native disk file.
13. The non-transitory machine-readable medium of claim 12 , wherein the operations further comprise writing a master boot record and a partition table of the native disk file based on the disk and volume content segment.
14. The non-transitory machine-readable medium of claim 12 , wherein a pointer of a data block links to one of a plurality of payload blocks of the sparse disk file, without physically copying a corresponding payload block.
15. A storage system, comprising:
a processor;
a memory;
a restore module executed in the memory by the processor to receive a request from a client device over a network for restoring a data stream stored in the storage system, and in response to the request, to identify a sparse disk file stored in the storage system, the sparse disk file representing the requested data stream, wherein the sparse disk file includes a plurality of payload blocks sparsely located and intertwined with metadata of the sparse disk file, wherein the sparse disk file includes a block allocation table (BAT) having a plurality of block entries, each block entry corresponding to one of a plurality of data blocks within the payload blocks of the sparse disk file;
a converter executed in the memory by the processor to convert the sparse disk file into a native disk file based on the payload blocks of the sparse disk file, wherein creating the native disk file includes locating, within the sparse disk file, a payload block corresponding to each of the plurality of block entries based on an offset of the block entry, and performing a fast-cop and rebase operation from the corresponding payload block to a new data block in the native disk file, wherein the native disk file has a size equal to a disk size specified by the sparse disk file; and
a block-based accessing interface to allow a client accessing the native disk file, wherein each block of content represented by the native disk file is accessed based on a block identifier and an offset indicating a location of the block within the native disk file.
16. The system of claim 15 , wherein the sparse disk file is a virtual hard disk (VHD) compatible file.
17. The system of claim 15 , wherein the block-based accessing interface is one of a small computer system interface (SCSI) and Fibre channel interface.
18. The system of claim 15 , wherein the converter is adapted to
parse the sparse disk file to identify the block allocation table within the sparse disk file, and
for each of the block entries of the block allocation table,
retrieve an offset from the block entry,
access a corresponding data block from the payload blocks of the sparse disk file based on the retrieved offset, and
determine a pointer of the corresponding data block, wherein the pointer of the data block is used to represent the data block without having to physically copy content of the data block.
19. The system of claim 18 , wherein the converter is adapted to prior to parsing the sparse disk file, create the native disk file as a place holder, and for each of the block entries of the block allocation table of the sparse disk file, write the pointer of the corresponding data block in a disk and volume content segment of the native disk file.
20. The system of claim 19 , wherein the converter is further to write a master boot record and a partition table of the native disk file based on the disk and volume content segment.
21. The system of claim 19 , wherein a pointer of a data block links to one of a plurality of payload blocks of the sparse disk file, without physically copying a corresponding payload block.