RECOVERY DATASET SELECTION IN A VIRTUAL STORAGE SYSTEM
Data recovery in a virtual storage system, including: detecting, within storage provided by a first tier of storage of the virtual storage system, data loss within a dataset, wherein recovery data for the dataset is stored in a second tier of storage; determining a recovery point for the dataset up to which a consistent version of the dataset is recoverable from the recovery data stored in the second tier of storage; and restoring, within the storage provided by the first tier of storage of the virtual storage system, the consistent version of the dataset.
1 . A method comprising:
in response to detecting data loss at a first tier of storage of a virtual storage system, selecting, from a plurality of recovery datasets stored in a second tier of storage of the virtual storage system, a recovery dataset that excludes one or more data portions associated with an operational sequence, associated with the dataset, that includes at least one operation that was incomplete at a time of the data loss; and
recovering from the data loss using the recovery dataset.
2 . The method of claim 1 , wherein the first tier of storage includes staging memory that provides transactional consistency and write acknowledgments, and wherein the second tier of storage includes virtual drives provided by virtual drive servers of the virtual storage system.
3 . The method of claim 1 , wherein recovering from the data loss further comprises restoring a consistent version of the dataset based on erasure codes stored among virtual drives of staging memory, on data migrated from the staging memory to an object store, or on mirrored data among the virtual drives of the staging memory.
4 . The method of claim 2 , wherein the staging memory of the virtual storage system is characterized by a low read latency relative to object storage provided by a cloud services provider.
5 . The method of claim 2 , wherein the staging memory includes multiple virtual drive servers.
6 . The method of claim 5 , wherein the multiple virtual drive servers include respective local storage.
7 . The method of claim 5 , wherein the multiple virtual drive servers provide block-level data storage.
8 . The method of claim 1 , wherein the first tier of storage includes virtual drives provided by virtual drive servers of the virtual storage system, and wherein the second tier includes object storage provided by a cloud services provider that provides object storage independent of the virtual storage system.
9 . The method of claim 1 , further comprising referencing a database of segment identifiers to determine whether a segment in object storage is usable to restore the dataset.
10 . The method of claim 1 , wherein the recovery dataset is determined based at least in part on defining batches of backend updates determined to have been committed.
11 . A virtual storage system contained in a cloud computing environment, the virtual storage system including:
one or more virtual drives providing a first tier of storage for storage operations; and
one or more virtual controllers, each virtual controller executing in a cloud computing instance, the cloud computing instance comprising a computer processor, a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions that, when executed by the computer processor, cause the virtual controller to carry out the steps of:
in response to detecting data loss at a first tier of storage of a virtual storage system, select, from a plurality of recovery datasets stored in a second tier of storage of the virtual storage system, a recovery dataset that excludes one or more data portions associated with an operational sequence, associated with the dataset, that includes at least one operation that was incomplete at a time of the data loss; and
recover from the data loss using the recovery dataset.
12 . The virtual storage system of claim 11 , wherein the first tier of storage includes staging memory that provides transactional consistency and write acknowledgments, and wherein the second tier of storage includes virtual drives provided by virtual drive servers of the virtual storage system.
13 . The virtual storage system of claim 12 , wherein recovering from the data loss further comprises restoring a consistent version of the dataset based on erasure codes stored among virtual drives of the staging memory, on data migrated from the staging memory to an object store, or on mirrored data among the virtual drives of the staging memory.
14 . The virtual storage system of claim 12 , wherein the staging memory of the virtual storage system is characterized by a low read latency relative to object storage provided by a cloud services provider.
15 . The virtual storage system of claim 12 , wherein the staging memory includes multiple virtual drive servers.
16 . The virtual storage system of claim 15 , wherein the multiple virtual drive servers include respective local storage.
17 . The virtual storage system of claim 15 , wherein the multiple virtual drive servers provide block-level data storage.
18 . The virtual storage system of claim 11 , wherein the first tier of storage includes virtual drives provided by virtual drive servers of the virtual storage system, and wherein the second tier includes object storage provided by a cloud services provider that provides object storage independent of the virtual storage system.
19 . The virtual storage system of claim 11 , wherein the computer program instructions, when executed by the computer processor, cause the virtual controller to carry out steps to reference a database of segment identifiers to determine whether a segment in object storage is usable to restore the dataset.
20 . The virtual storage system of claim 11 , wherein the recovery dataset is determined based at least in part on defining batches of backend updates determined to have been committed.