Rapid access for restored cloud backup data
Techniques are disclosed relating to providing fast access to restored data in a cloud storage environment. A computing system stores multiple sets of incremental backup data that reflect changes in data being backed up between backup intervals and metadata that indicates which set of incremental backup data stores a given object. The computing system generates an endpoint for a requesting computing system, where the endpoint supports requests for restored backup data and data responses. In response to a request from the requesting computing system via the endpoint, the computing system queries the metadata based on the request and stores metadata retrieved from the query in a key/value store using object identification information as key data and the retrieved metadata as value data. The computing system provides requested data according to a lazy loading technique, including providing requested data via the endpoint based on the metadata in the key/value store.
1 . A method, comprising:
storing, by a computing system:
multiple sets of incremental backup data that reflects changes in data being backed up between backup intervals, and
metadata that indicates, for a given object, which set of incremental backup data stores the given object;
generating, by the computing system, an endpoint for a requesting computing system, wherein the endpoint supports requests for restored backup data and data responses; and
in response to a request from the requesting computing system via the endpoint, by the computing system:
querying the metadata based on the request,
storing metadata retrieved from the querying in a key/value store using object identification information as key data and the retrieved metadata as value data,
providing requested data according to a lazy loading technique, including providing requested data via the endpoint based on the metadata in the key/value store; and
performing a full restore of the requested data to a data store of an account associated with the request, wherein the full restore is performed at least partially in parallel with the lazy loading technique.
2 . The method of claim 1 , wherein the object identification information includes an object name, a prefix, or both.
3 . The method of claim 1 , wherein the metadata includes object location information, an object creation time, and a size of the given object.
4 . The method of claim 1 , wherein the storing includes storing retrieved metadata in multiple different lookup tables of the key/value store.
5 . The method of claim 4 , wherein the querying the metadata includes performing multiple queries at least partially in parallel to multiple different partitions of the multiple sets of incremental backup data.
6 . The method of claim 5 , wherein the querying the metadata and the storing are based on a mapping of multiple partitions to a given lookup table of the multiple different lookup tables.
7 . The method of claim 5 , wherein:
a given partition of the multiple partitions includes an ordered list of objects; and
the storing maintains ordering from among the multiple partitions according to an ordered list of partitions.
8 . The method of claim 1 , wherein the request specifies at least one protection group.
9 . The method of claim 1 , wherein the request specifies restoration time information.
10 . The method of claim 1 , wherein the generating the endpoint is performed in response to an endpoint request from the requesting computing system.
11 . A non-transitory computer-readable medium having instructions stored thereon that are executable by a computing device to perform operations comprising:
storing:
multiple sets of incremental backup data that reflects changes in data being backed up between backup intervals, and
metadata that indicates, for a given object, which set of incremental backup data stores the given object;
generating an endpoint for a requesting computing system, wherein the endpoint supports requests for restored backup data and data responses; and
in response to a request from the requesting computing system via the endpoint:
querying the metadata based on the request, wherein the querying includes performing multiple queries at least partially in parallel to multiple different partitions of the multiple sets of incremental backup data,
storing metadata retrieved from the querying in a key/value store using object identification information as key data and the retrieved metadata as value data, wherein the storing includes storing retrieved metadata in multiple different lookup tables of the key/value store, and
providing requested data according to a lazy loading technique, including providing requested data via the endpoint based on the metadata in the key/value store.
12 . The non-transitory computer-readable medium of claim 11 , wherein the querying the metadata and the storing are based on a mapping of partitions to a given lookup table of the multiple different lookup tables.
13 . A method, comprising:
sending, by a requesting computing system, a request for restored backup data via an endpoint provided by a backup computing system; and
receiving requested data via the endpoint, wherein the backup computing system generated the requested data by:
querying metadata based on the request, wherein the metadata indicates, for a given object in incremental backup data, which set of incremental backup data stores the given object,;
storing metadata retrieved from the querying in a key/value store using object identification information as key data and the metadata as value data; and
providing the requested data based on the metadata in the key/value store; and
receiving a full restore of the requested data at a data store of an account associated with the request, at least partially in parallel with receiving requested data via the endpoint.
14 . The method of claim 13 , further comprising, the backup computing system performing the querying, the storing, and the providing.
15 . The method of claim 13 , further comprising:
requesting, by the requesting computing system, the endpoint.
16 . The method of claim 15 , wherein the request for the endpoint identifies a protection group and restoration time information.