Virtualized data storage system architecture
Virtual storage arrays consolidate branch data storage at data centers connected via wide area networks. Virtual storage arrays appear to storage clients as local data storage; however, virtual storage arrays actually store data at the data center. The virtual storage arrays overcomes bandwidth and latency limitations of the wide area network by predicting and prefetching storage blocks, which are then cached at the branch location. Virtual storage arrays leverage an understanding of the semantics and structure of high-level data structures associated with storage blocks to predict which storage blocks are likely to be requested by a storage client in the near future. Virtual storage arrays determine the association between requested storage blocks and corresponding high-level data structure entities to predict additional high-level data structure entities that are likely to be accessed. From this, the virtual storage array identifies the additional storage blocks for prefetching.
1. A method of optimizing a block storage protocol write access to a block storage device via a wide area network, the method comprising:
receiving a sequence of storage block write operations;
selecting, by using a processor, a first storage block write operation included in the sequence of storage block write operations, wherein the first storage block operation includes a first version of a storage block;
determining whether the sequence of storage block write operations includes a second storage block write operation including a second version of the storage block, wherein the second storage block write operation is more recent than the first storage block write operation, and wherein the determining whether the sequence of storage block write operations includes the second storage block write operation including the second version of the storage block comprises searching the sequence of storage block write operations from a time associated with the first storage block write operation up to a snapshot time;
in response to the determination that the sequence of storage block write operations does not include the second storage block write operation including the second version of the storage block, communicating the first version of the storage block via a wide area network to a data storage connected with the wide area network at a first network location;
in response to the determination that the sequence of storage block write operations includes the second storage block write operation including the second version of the storage block, communicating the second version of the storage block via the wide area network to the data storage;
determining whether the sequence of storage block write operations after the snapshot time includes a third storage block write operation including a third version of the storage block, wherein the third storage block write operation is more recent than the second storage block write operation; and
in response to the determination that the sequence of storage block write operations includes the third storage block write operation including the third version of the storage block, communicating the third version of the storage block via the wide area network to the data storage.
2. The method of claim 1 , comprising:
in response to receiving the sequence of storage block requests, caching the sequence of storage block requests in a storage block cache; and
following the communication of the second version of the storage block to the data storage, removing the first storage block write operation and the first version of the storage block from the storage block cache.
3. The method of claim 2 , wherein the storage block cache is connected with the wide-area network at a second network location, the method comprising:
following the communication of the second version of the storage block to the data storage, retaining the first version of the storage block in the storage block cache for read access by a storage client connected with the wide-area network at the second location.
4. The method of claim 1 , wherein the determining whether the sequence of storage block write operations includes the second storage block write operation including the second version of the storage block comprises:
searching the sequence of storage block write operations from a time associated with the first storage block write operation up to an end of the sequence of storage block write operations.
5. A non-transitory computer-readable storage medium storing instructions that, when executed by a computer, cause the computer to perform a method of optimizing a block storage protocol write access to a block storage device via a wide area network, the method comprising:
receiving a sequence of storage block write operations;
selecting a first storage block write operation included in the sequence of storage block write operations, wherein the first storage block operation includes a first version of a storage block;
determining whether the sequence of storage block write operations includes a second storage block write operation including a second version of the storage block, wherein the second storage block write operation is more recent than the first storage block write operation, and wherein the determining whether the sequence of storage block write operations includes the second storage block write operation including the second version of the storage block comprises searching the sequence of storage block write operations from a time associated with the first storage block write operation up to a snapshot time;
in response to the determination that the sequence of storage block write operations does not include the second storage block write operation including the second version of the storage block, communicating the first version of the storage block via a wide area network to a data storage connected with the wide area network at a first network location;
in response to the determination that the sequence of storage block write operations includes the second storage block write operation including the second version of the storage block, communicating the second version of the storage block via the wide area network to the data storage;
determining whether the sequence of storage block write operations after the snapshot time includes a third storage block write operation including a third version of the storage block, wherein the third storage block write operation is more recent than the second storage block write operation; and
in response to the determination that the sequence of storage block write operations includes the third storage block write operation including the third version of the storage block, communicating the third version of the storage block via the wide area network to the data storage.
6. The non-transitory computer-readable storage medium of claim 5 , comprising:
in response to receiving the sequence of storage block requests, caching the sequence of storage block requests in a storage block cache; and
following the communication of the second version of the storage block to the data storage, removing the first storage block write operation and the first version of the storage block from the storage block cache.
7. The non-transitory computer-readable storage medium of claim 6 , wherein the storage block cache is connected with the wide-area network at a second network location, the method comprising:
following the communication of the second version of the storage block to the data storage, retaining the first version of the storage block in the storage block cache for read access by a storage client connected with the wide-area network at the second location.
8. The non-transitory computer-readable storage medium of claim 5 , wherein the determining whether the sequence of storage block write operations includes the second storage block write operation including the second version of the storage block comprises:
searching the sequence of storage block write operations from a time associated with the first storage block write operation up to an end of the sequence of storage block write operations.
9. An apparatus, comprising:
a processor; and
a non-transitory computer-readable storage medium storing instructions that, when executed by the processor, cause the apparatus to perform a method of optimizing a block storage protocol write access to a block storage device via a wide area network, the method comprising:
receiving a sequence of storage block write operations;
selecting a first storage block write operation included in the sequence of storage block write operations, wherein the first storage block operation includes a first version of a storage block;
determining whether the sequence of storage block write operations includes a second storage block write operation including a second version of the storage block, wherein the second storage block write operation is more recent than the first storage block write operation, and wherein the determining whether the sequence of storage block write operations includes the second storage block write operation including the second version of the storage block comprises searching the sequence of storage block write operations from a time associated with the first storage block write operation up to a snapshot time;
in response to the determination that the sequence of storage block write operations does not include the second storage block write operation including the second version of the storage block, communicating the first version of the storage block via a wide area network to a data storage connected with the wide area network at a first network location;
in response to the determination that the sequence of storage block write operations includes the second storage block write operation including the second version of the storage block, communicating the second version of the storage block via the wide area network to the data storage;
determining whether the sequence of storage block write operations after the snapshot time includes a third storage block write operation including a third version of the storage block, wherein the third storage block write operation is more recent than the second storage block write operation; and
in response to the determination that the sequence of storage block write operations includes the third storage block write operation including the third version of the storage block, communicating the third version of the storage block via the wide area network to the data storage.
10. The apparatus of claim 9 , comprising:
in response to receiving the sequence of storage block requests, caching the sequence of storage block requests in a storage block cache; and
following the communication of the second version of the storage block to the data storage, removing the first storage block write operation and the first version of the storage block from the storage block cache.
11. The apparatus of claim 10 , wherein the storage block cache is connected with the wide-area network at a second network location, the apparatus comprising:
following the communication of the second version of the storage block to the data storage, retaining the first version of the storage block in the storage block cache for read access by a storage client connected with the wide-area network at the second location.
12. The apparatus of claim 9 , wherein the determining whether the sequence of storage block write operations includes the second storage block write operation including the second version of the storage block comprises:
searching the sequence of storage block write operations from a time associated with the first storage block write operation up to an end of the sequence of storage block write operations.