Emulated storage system
View Patent ↗Systems and methods for efficient storage of data are provided. For instance, a method that includes acts of receiving a data stream to be stored on a first storage system, the data stream comprising a data object and metadata that describes attributes of the data object, extracting the metadata from the data stream, storing the data object on the first storage system and storing the extracted metadata, separately from the data object, on a computer-readable medium is disclosed. Additionally, a storage system is disclosed that includes a first storage medium, an interface configured to receive a data stream including a data object to be stored on the first storage medium and a controller. The controller may be configured to extract metadata from the data stream, the metadata being descriptive of attributes of the data object, and to direct the extracted metadata to be stored on a computer-readable medium.
1. A storage system comprising:
a first storage medium;
an interface configured to receive a data stream including a data object to be stored on the first storage medium; and
a controller configured to:
extract metadata from the data stream, the metadata being descriptive of attributes of the data object, comprising creating metadata that links a portion of the data object to a corresponding virtual cartridge, wherein the one or more corresponding virtual cartridges emulate physical tape cartridges; and
direct the extracted metadata to be stored on a computer-readable medium as a system file including:
(i) a header comprising the metadata, the header including a tape directory that contains the metadata that links the portion of the data object to its corresponding virtual cartridge; and
(ii) data including the portion of the data object.
2. The storage system according to claim 1 , wherein the computer-readable medium includes a cache of memory.
3. The storage system according to claim 1 , wherein the computer-readable medium includes the first storage medium.
4. The storage system according to claim 1 , wherein the computer-readable medium includes a second storage medium.
5. The system according to claim 1 , wherein the controller is further configured to arrange extracted metadata into a searchable cache.
6. The system according to claim 5 , wherein the searchable cache comprises a database and at least one file referenced in the database.
7. A non-transitory computer-readable medium comprising instructions that, as a result of being executed by a processor, instruct the processor to perform a method, the method comprising:
receiving a data stream to be stored on a first storage system, the data stream comprising a data object and metadata that describes attributes of the data object;
extracting the metadata from the data stream, comprising creating metadata that links a portion of the data object to a corresponding virtual cartridge, wherein the one or more corresponding virtual cartridges emulate physical tape cartridges;
storing the data object on the first storage system as a system file including:
(i) a header comprising the extracted metadata, the header including a tape directory that contains the metadata that links the portion of the data object to its corresponding virtual cartridge; and
(ii) data including the portion of the data object.
8. A computer-implemented method comprising:
receiving, by a computer, a data stream including objects to be stored on a backup storage system;
acquiring, by the computer, metadata descriptive of attributes of the objects, comprising creating metadata that links a portion of the data object to a corresponding virtual cartridge, wherein the one or more corresponding virtual cartridges emulate physical tape cartridges; and
storing, by the computer, the acquired metadata on the backup storage system as a system file including:
(i) a header comprising the metadata, the header including a tape directory that contains the metadata that links the portion of the data object to its corresponding virtual cartridge; and
(ii) data including the portion of the data object.
9. A computer-implemented method comprising:
receiving, by a computer, a data stream to be stored on a first storage system, the data stream comprising a data object and metadata that describes attributes of the data object;
extracting, by the computer, the metadata from the data stream, comprising creating metadata that links a portion of the data object to a corresponding virtual cartridge, wherein the one or more corresponding virtual cartridges emulate physical tape cartridges;
storing, by the computer, the data object on the first storage system as a system file including:
(i) a header comprising the metadata, the header including a tape directory that contains the metadata that links the portion of the data object to its corresponding virtual cartridge; and
(ii) data including the portion of the data object.
10. The method according to claim 9 , wherein receiving a data stream comprises receiving a data stream to be stored on a backup storage system.
11. The method according to claim 9 , wherein storing the extracted metadata comprises storing the extracted metadata in a searchable cache.
12. The method according to claim 11 , wherein storing the extracted metadata in a searchable cache comprises storing the extracted metadata in a database.
13. The method according to claim 9 , wherein extracting the metadata from the data stream comprises extracting the metadata from the data stream during the step of receiving the data stream.
14. The method according to claim 9 , wherein storing the extracted metadata comprises storing the extracted metadata in a cache of memory.
15. The method according to claim 9 , wherein storing the extracted metadata comprises storing the extracted metadata on the first storage system.
16. The method according to claim 9 , wherein storing the extracted metadata comprises storing the extracted metadata on a second storage system.
17. The method according to claim 9 , wherein receiving the data stream comprises receiving the data stream from a primary storage system via any one of a backup/restore application, an archiving application or a data migration application.
18. The method according to claim 9 , wherein extracting the metadata comprises extracting a modification history of the data object.
19. The method according to claim 9 , wherein extracting the metadata comprises extracting security data associated with the data object.
20. The method according to claim 19 , wherein extracting the security data comprises extracting at least one identifier of a user authorized to access the data object associated with the security data.
21. The method according to claim 9 , wherein extracting the metadata comprises extracting a storage location on a primary storage system of the data object.
22. The method according to claim 9 , wherein extracting the metadata comprises extracting a backup volume associated with the data object.
23. The method according to claim 9 , wherein extracting the metadata comprises extracting a size of the data object.
24. The method according to claim 9 , wherein extracting the metadata comprises extracting an identifier of a software application associated with the data object.
25. The method according to claim 9 , wherein extracting the metadata comprises extracting a file name.
26. The method according to claim 9 , wherein extracting the metadata comprises extracting a host server name.
27. The method according to claim 9 , wherein extracting the metadata comprises extracting metadata created by an application transmitting the data stream.
28. The method according to claim 9 , wherein storing the data object comprises storing a file.
29. The method according to claim 9 , wherein storing the data object comprises storing a block of data.
30. The method of claim 9 , wherein the tape directory comprises one or more file markers, wherein the one or more file markers:
do not represent any data;
are not stored in the data section of the system file; and
are used by the virtual cartridge to emulate a tape cartridge.
31. The method of claim 30 , wherein the portion of the data object is a user file, a system file, or both.
32. A computer-implemented method comprising:
receiving, by a computer, a data stream to be stored on a first storage system, the data stream comprising a data object and metadata that describes attributes of the data object;
storing, by the computer, the data stream on the first storage system as a system file including:
(i) a header comprising the metadata, the header including a tape directory that contains metadata that links a portion of the data object to a corresponding virtual cartridge; and
(ii) data including the portion of the data object; and
extracting, by the computer, the metadata from the data stream, comprising creating the metadata that links the portion of the data object to a corresponding virtual cartridge, wherein the one or more corresponding virtual cartridges emulate physical tape cartridges.
33. The method according to claim 32 , wherein receiving a data stream comprises receiving a data stream to be stored on a backup storage system.
34. The method according to claim 32 , wherein storing the extracted metadata comprises storing the extracted metadata in a cache of memory.
35. The method according to claim 32 , wherein storing the extracted metadata comprises storing the extracted metadata on the first storage system.
36. The method according to claim 32 , wherein storing the extracted metadata comprises storing the extracted metadata on a second storage system.
37. The method according to claim 32 , wherein extracting the metadata from the data stream is performed after storing the data stream on the backup storage system.
38. The method according to claim 32 , wherein extracting the metadata from the data stream is performed while storing the data stream on the backup storage system.
39. The method according to claim 32 , wherein extracting the metadata from the data stream is performed before storing the data stream on the backup storage system.