Predictive data streaming in a virtual storage system
A method of predictive data streaming in a virtual storage system, including: identifying, for a plurality of data objects that have been migrated from a first tier of storage in a virtual storage system to a lower tier of storage, metadata describing one or more access patterns for the plurality of data objects; determining, based at least on the metadata describing the plurality of data objects, one or more data objects that have a greater likelihood of being accessed relative to other data objects among the plurality of data objects; and transferring, from the lower tier of storage, the one or more data objects that have a greater likelihood of being accessed relative to other data objects among the plurality of data objects.
1. A method of comprising:
identifying, for a plurality of data objects that have been migrated from a first tier of storage in a virtual storage system to a lower tier of storage, metadata describing one or more access patterns for the plurality of data objects;
determining, based at least on the metadata describing the plurality of data objects, one or more data objects that have a greater likelihood of being accessed relative to other data objects among the plurality of data objects; and
transferring, from the lower tier of storage, the one or more data objects that have a greater likelihood of being accessed relative to other data objects among the plurality of data objects, wherein the metadata is based on tracking cache contents that include data from the one or more data objects, wherein the cache contents are tracked prior to a snapshot of a volume of data that includes the one or more data objects, and wherein for each snapshot of the volume of data there is a corresponding version of metadata.
2. The method of claim 1 , wherein transferring the one or more data objects is performed prior to a request for data included within the one or more data objects.
3. The method of claim 1 , wherein the metadata is based on a heat map of data accesses for data within the volume of data, and wherein the heat map corresponds to a version of the volume of data corresponding to a snapshot.
4. The method of claim 1 , wherein the lower tier of storage is an object store provided by a cloud services provider.
5. The method of claim 1 , wherein transferring the one or more objects is in response to a data loss within the virtual storage system.
6. The method of claim 1 , wherein the metadata is based on one or more characteristics of the one or more data objects, and wherein the one or more characteristics includes one or more of: a type of application using the volume of data, an identity of a user accessing the volume of data, a time of day, or a time of year.
7. The method of claim 6 , wherein the application is a database, and wherein the one or more data objects include transaction logs for the database.
8. An apparatus comprising a computer processor, a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the steps of:
identifying, for a plurality of data objects that have been migrated from a first tier of storage in a virtual storage system to a lower tier of storage, metadata describing one or more access patterns for the plurality of data objects;
determining, based at least on the metadata describing the plurality of data objects, one or more data objects that have a greater likelihood of being accessed relative to other data objects among the plurality of data objects; and
transferring, from the lower tier of storage, the one or more data objects that have a greater likelihood of being accessed relative to other data objects among the plurality of data objects, wherein the metadata is based on tracking cache contents that include data from the one or more data objects, wherein the cache contents are tracked prior to a snapshot of a volume of data that includes the one or more data objects, and wherein for each snapshot of the volume of data there is a corresponding version of metadata.
9. The apparatus of claim 8 , wherein transferring the one or more data objects is performed prior to a request for data included within the one or more data objects.
10. The apparatus of claim 8 , wherein the metadata is based on a heat map of data accesses for data within the volume of data, and wherein the heat map corresponds to a version of the volume of data corresponding to a snapshot.
11. The apparatus of claim 8 , wherein the lower tier of storage is an object store provided by a cloud services provider.
12. The apparatus of claim 8 , wherein transferring the one or more objects is in response to a data loss within the virtual storage system.
13. The apparatus of claim 8 , wherein the metadata is based on one or more characteristics of the one or more data objects, and wherein the one or more characteristics includes one or more of: a type of application using the volume of data, an identity of a user accessing the volume of data, a time of day, or a time of year.
14. A computer program product disposed upon a computer readable medium, the computer program product comprising computer program instructions that, when executed, cause a computer to carry out the steps of:
identifying, for a plurality of data objects that have been migrated from a first tier of storage in a virtual storage system to a lower tier of storage, metadata describing one or more access patterns for the plurality of data objects;
determining, based at least on the metadata describing the plurality of data objects, one or more data objects that have a greater likelihood of being accessed relative to other data objects among the plurality of data objects; and
transferring, from the lower tier of storage, the one or more data objects that have a greater likelihood of being accessed relative to other data objects among the plurality of data objects, wherein the metadata is based on tracking cache contents that include data from the one or more data objects, wherein the cache contents are tracked prior to a snapshot of a volume of data that includes the one or more data objects, and wherein for each snapshot of the volume of data there is a corresponding version of metadata.
15. The computer program product of claim 14 , wherein transferring the one or more data objects is performed prior to a request for data included within the one or more data objects.
16. The computer program product of claim 14 , wherein the metadata is based on a heat map of data accesses for data within the volume of data, and wherein the heat map corresponds to a version of the volume of data corresponding to a snapshot.
17. The computer program product of claim 14 , wherein the lower tier of storage is an object store provided by a cloud services provider.