Secure cloud-based storage of data shared across file system objects and clients
Techniques to provide secure cloud-based storage of data shared across file system objects and clients are disclosed. In various embodiments, a primary encryption key is determined for an object associated with a plurality of component chunks of file system data. The primary encryption key is used to generate for each of said component chunks a corresponding chunk key, based at least in part on the primary encryption key and data comprising or otherwise associated with the chunk. The respective chunk keys are provided to a file system client configured to create and store the object at least in part by encrypting each chunk included in the plurality of component chunks using the chunk key provided for that chunk to generated encrypted chunk data, and combining the encrypted chunk data to create and store the object.
1. A method of storing file system data, comprising:
computing a corresponding chunk hash value for each of a plurality of component chunks of file system data associated with an object, wherein the corresponding chunk hash value is based on at least a portion of data stored in the corresponding component chunk;
determining a primary encryption key for the object, wherein the object is comprised of the plurality of component chunks, wherein the primary encryption key is based on a hash value associated with the plurality of component chunks;
using the primary encryption key to generate, for each of said plurality of component chunks, a corresponding chunk key, wherein the corresponding chunk key is based at least in part on the primary encryption key including the hash value associated with the plurality of component chunks and the corresponding chunk hash value associated with the corresponding chunk; and
providing chunk keys of the plurality of component chunks associated with the object to a file system client, wherein the file system client is configured to encrypt each chunk included in the plurality of component chunks using a chunk key provided for that chunk.
2. The method of claim 1 , wherein the primary encryption key is determined based at least in part on data comprising or otherwise associated with the plurality of component chunks.
3. The method of claim 1 , further comprising storing the primary encryption key in a file system metadata table.
4. The method of claim 1 , wherein a size of the plurality of component chunks is selected to achieve a desired performance with respect to de-duplication.
5. The method of claim 1 , wherein the chunk keys are not stored in file system metadata.
6. The method of claim 1 , further comprising providing to the file system client an identification of the plurality of component chunks to be included in the object.
7. The method of claim 1 , wherein the plurality of component chunks of file system data comprise at least a part of a file.
8. The method of claim 7 , further comprising receiving a request to store the file, the request including data identifying the plurality of component chunks as being associated with the file.
9. The method of claim 1 , further comprising receiving a request to access a file with which the plurality of component chunks are associated.
10. The method of claim 9 , further comprising providing in response to the request a locator to be used to retrieve the object, and for each chunk a corresponding offset within the object and a corresponding chunk key to be used to decrypt the chunk.
11. A system, comprising:
a communication interface; and
a processor coupled to the communication interface and configured to:
compute a corresponding chunk hash value for each of a plurality of component chunks of file system data associated with an object, wherein the corresponding chunk hash value is based on at least a portion of data stored in the corresponding component chunk;
determine a primary encryption key for the object, wherein the object is comprised of the plurality of component chunks, wherein the primary encryption key is based on a hash value associated with the plurality of component chunks;
use the primary encryption key to generate, for each of said plurality of component chunks, a corresponding chunk key, wherein the corresponding chunk key is based at least in part on the primary encryption key including the hash value associated with the plurality of component chunks and the corresponding chunk hash value associated with the corresponding chunk; and
provide chunk keys of the plurality of component chunks associated with the object, via the communication interface, to a file system client, wherein the file system client is configured to encrypt each chunk included in the plurality of component chunks using a chunk key provided for that chunk.
12. The system of claim 11 , wherein the primary encryption key is determined based at least in part on data comprising or otherwise associated with the plurality of component chunks.
13. The system of claim 11 , wherein the processor is further configured to store the primary encryption key in a file system metadata table.
14. The system of claim 11 , wherein a size of the plurality of component chunks is selected to achieve a desired performance with respect to de-duplication.
15. The system of claim 11 , wherein the chunk keys are not stored in file system metadata.
16. The system of claim 11 , wherein the processor is further configured to provide to the file system client an identification of the plurality of component chunks to be included in the object.
17. The system of claim 11 , wherein the plurality of component chunks of file system data comprise at least a part of a file.
18. The system of claim 17 , wherein the processor is further configured to receive a request to store the file, the request including data identifying the plurality of component chunks as being associated with the file.
19. The system of claim 11 , wherein the processor is further configured to receive a request to access a file with which the plurality of component chunks are associated; and to provide in response to the request a locator to be used to retrieve the object, and for each chunk a corresponding offset within the object and a corresponding chunk key to be used to decrypt the chunk.
20. A computer program product to store file system data, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
computing a corresponding chunk hash value for each of a plurality of component chunks of file system data associated with an object, wherein the corresponding chunk hash value is based on at least a portion of data stored in the corresponding component chunk;
determining a primary encryption key for the object, wherein the object is comprised of the plurality of component chunks, wherein the primary encryption key is based on a hash value associated with the plurality of component chunks;
using the primary encryption key to generate, for each of said plurality of component chunks, a corresponding chunk key, wherein the corresponding chunk key is based at least in part on the primary encryption key including the hash value associated with the plurality of component chunks and the corresponding chunk hash value associated with the corresponding chunk; and
providing chunk keys of the plurality of component chunks associated with the object to a file system client, wherein the file system client is configured to encrypt each chunk included in the plurality of component chunks using a chunk key provided for that chunk.