Secure cloud-based storage of data shared across file system objects and clients
A combined object associated with a data chunk included in a request file is determined. An encryption key associated with the combined object and a corresponding chunk hash value associated with the data chunk are used to determine a corresponding chunk key associated with the data chunk. At least a locator to be used to retrieve the combined object and the corresponding chunk key associated with the data chunk are provided to a requesting system.
1. A method, comprising:
determining a combined object associated with a data chunk included in a requested file;
using an encryption key associated with the combined object and a corresponding chunk hash value associated with the data chunk to determine a corresponding chunk key associated with the data chunk;
providing to a requesting system at least a locator to be used to retrieve the combined object and the corresponding chunk key associated with the data chunk; and
using a metadata table to identify a plurality of chunks comprising the requested file, wherein the data chunk is identified using the metadata table.
2. The method of claim 1 , further comprising receiving an access request with respect to the requested file, wherein the requested file is comprised of a plurality of data chunks that at least includes the data chunk.
3. The method of claim 2 , wherein the access request includes a request for the requested file by file name.
4. The method of claim 2 , wherein the access request includes a request for the requested file by file path.
5. The method of claim 1 , wherein the combined object associated with the data chunk is determined using the metadata table.
6. The method of claim 1 , wherein the locator is a uniform resource indicator.
7. The method of claim 1 , wherein a combined object offset of the data chunk is provided to the requesting system.
8. The method of claim 7 , wherein the requesting system uses the locator to retrieve the combined object from a cloud-based object store.
9. The method of claim 8 , wherein the requesting system uses the combined object offset of the data chunk to find the data chunk within the combined object.
10. The method of claim 9 , wherein the requesting system uses the corresponding chunk key to decrypt the data chunk.
11. The method of claim 10 , wherein the requesting system uses the decrypted data chunk in part to reconstruct the requested file.
12. A system, comprising:
a processor configured to:
determine a combined object associated with a data chunk included in a request file;
use an encryption key associated with the combined object and a corresponding chunk hash value associated with the data chunk to determine a corresponding chunk key associated with the data chunk; and
provide to a requesting system at least a locator to be used to retrieve the combined object and the corresponding chunk key associated with the data chunk;
use a metadata table to identify a plurality of chunks comprising the requested file, wherein the data chunk is identified using the metadata table; and
a memory coupled to the processor and configured to provide the processor with instructions.
13. The system of claim 12 , wherein the processor is configured to receive an access request with respect to the requested file, wherein the requested file is comprised of a plurality of data chunks that at least includes the data chunk.
14. The system of claim 12 , wherein the combined object associated with the data chunk is determined using the metadata table.
15. The system of claim 12 , wherein the processor is configured to provide to the requesting system a combined object offset of the data chunk.
16. The system of claim 15 , wherein the requesting system is configured to use the combined object offset of the data chunk to find the data chunk within the combined object.
17. The system of claim 16 , wherein the requesting system is configured to use the corresponding chunk key to decrypt the data chunk and configured to use the decrypted data chunk in part to reconstruct the requested file.
18. A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
determining a combined object associated with a data chunk included in a request file;
using an encryption key associated with the combined object and a corresponding chunk hash value associated with the data chunk to determine a corresponding chunk key associated with the data chunk;
providing to a requesting system at least a locator to be used to retrieve the combined object and the corresponding chunk key associated with the data chunk; and
using a metadata table to identify a plurality of chunks comprising the requested file, wherein the data chunk is identified using the metadata table.