Application level support for selectively accessing files in cloud-based storage
In one example, a method includes accessing a manifest that includes a listing of available versions of a dataset, selecting a dataset from the manifest, mounting the selected dataset, running an application that is associated with the dataset, requesting a specific subset of data of the mounted dataset, receiving the requested subset of data, performing a file system operation involving a change to the subset of data, and backing up the change to the subset of data.
1. A method, comprising:
performing the following operations at a single client:
accessing a manifest that includes a listing of versions of a dataset that are available at a datacenter;
selecting a dataset from the manifest;
mounting the selected dataset;
performing an operation concerning a file, using an application that is associated with the dataset, wherein the operation involves requesting a specific subset of data of the mounted dataset, and the specific subset is a byte range that includes less than all of the file;
causing, by requesting only the specific subset of data, creation at the data center of a virtual synthetic that corresponds to the requested byte range and comprises respective portions of one or more different backups of the file, wherein, prior to the request from the client for the specific subset of data, the virtual synthetic did not exist separately on its own at the datacenter;
receiving the requested subset of data;
performing a file system operation involving a change to the subset of data; and
backing up the change to the subset of data.
2. The method as recited in claim 1 , wherein the dataset is selected based on a cutoff date/time, or based on a time of creation of the dataset relative to a particular point in time.
3. The method as recited in claim 1 , wherein the mounted dataset includes an incremental and/or a baseline dataset.
4. The method as recited in claim 1 , wherein the request for the specific subset of data of the mounted dataset is a translation of a filesystem request by the application.
5. The method as recited in claim 1 , further comprising, before requesting the specific subset of data, checking a local cache at the client to see if part or all of the specific subset of data is already present locally.
6. The method as recited in claim 1 , further comprising receiving, from the datacenter, an indication that some of the data in the specific subset of data has already been transmitted.
7. The method as recited in claim 1 , wherein the data received by the client from the datacenter is in an encrypted form.
8. A non-transitory storage medium having stored therein computer-executable instructions which are executable by one or more hardware processors to:
perform the following operations at a single client:
accessing a manifest that includes a listing of versions of a dataset that are available at a datacenter;
selecting a dataset from the manifest;
mounting the selected dataset;
performing an operation concerning a file, using an application that is associated with the dataset, wherein the operation involves requesting a specific subset of data of the mounted dataset, and the specific subset is a byte range that includes less than all of the file;
causing, by requesting only the specific subset of data, creation at the data center of a virtual synthetic that corresponds to the requested byte range and comprises respective portions of one or more different backups of the file, wherein, prior to the request from the client for the specific subset of data, the virtual synthetic did not exist separately on its own at the datacenter;
receiving the requested subset of data;
performing a file system operation involving a change to the subset of data; and
backing up the change to the subset of data.
9. The non-transitory storage medium as recited in claim 8 , wherein the dataset is selected based on a cutoff date/time, or based on a time of creation of the dataset relative to a particular point in time.
10. The non-transitory storage medium as recited in claim 8 , wherein the mounted dataset includes an incremental and/or a baseline dataset.
11. The non-transitory storage medium as recited in claim 8 , wherein the request for the specific subset of data of the mounted dataset is a translation of a filesystem request by the application.
12. The non-transitory storage medium as recited in claim 8 , wherein the operations further comprise, before requesting the specific subset of data, checking a local cache at the client to see if part or all of the specific subset of data is already present locally.
13. The non-transitory storage medium as recited in claim 8 , wherein the operations further comprise receiving, from the datacenter, an indication that some of the data in the specific subset of data has already been transmitted.
14. The non-transitory storage medium as recited in claim 8 , wherein the data received by the client from the datacenter is in an encrypted form.
15. A system, comprising:
one or more hardware processors; and
non-transitory storage medium having stored therein computer-executable instructions which are executable by the one or more hardware processors to perform the following operations at a single client:
accessing a manifest that includes a listing of versions of a dataset that are available at a datacenter;
selecting a dataset from the manifest;
mounting the selected dataset;
performing an operation concerning a file, using an application that is associated with the dataset, wherein the operation involves requesting a specific subset of data of the mounted dataset, and the specific subset is a byte range that includes less than all of the file;
causing, by requesting only the specific subset of data, creation at the data center of a virtual synthetic that corresponds to the requested byte range and comprises respective portions of one or more different backups of the file, wherein, prior to the request from the client for the specific subset of data, the virtual synthetic did not exist separately on its own at the datacenter;
receiving the requested subset of data;
performing a file system operation involving a change to the subset of data; and
backing up the change to the subset of data.
16. The system as recited in claim 15 , wherein the dataset is selected based on a cutoff date/time, or based on a time of creation of the dataset relative to a particular point in time.
17. The system as recited in claim 15 , wherein the mounted dataset includes an incremental and/or a baseline dataset.
18. The system as recited in claim 15 , wherein the data received by the client from the datacenter is in an encrypted form.
19. The system as recited in claim 15 , further comprising receiving, from the datacenter, an indication that some of the data in the specific subset of data has already been transmitted.
20. The system as recited in claim 15 , wherein the operations further comprise, before requesting the specific subset of data, checking a local cache at the client to see if part or all of the specific subset of data is already present locally.