Method and system for interfacing to cloud storage
An interface between an existing local file system and a data store generates and exports to the data store a versioned file system. The state of the local file system at a given point in time can be determined using the versioned file system. In operation, the interface creates and exports to the data store structured data representations, which correspond to versions of the local file system, as well as actual file system data that these structured data representations represent. A cache associated with the interface stores recently used data and metadata, as well as all write data and metadata waiting to be transferred to the data store. Prior to transfer, one or more data transformations may be applied to the data and metadata. In one embodiment, the data store comprises one or more cloud storage service providers. A content control system is used to configure and manage the interface.
1. Apparatus to configure and manage storage for an enterprise, comprising:
one or more hardware processors;
computer memory associated with each hardware processor to hold computer software executed by the hardware processor, wherein the computer software comprises:
first computer software configured as a management interface to receive a first input representing a selection of a cloud-based storage service provider from a set of cloud-based storage service providers, and to receive a second input that provisions and manages a scalable file system across storage resources associated with the selected cloud-based storage provider, wherein the second input defines a volume, and one or more attributes associated with the volume, wherein the volume is a logical construct representing a point of indirection separating the scalable file system from the storage resources in the cloud; and
second computer software configured as a file system interface to represent, to the enterprise, a local file system whose inode structure and data are stored in the storage resources of the selected cloud-based storage service provider in a write-once, read-many manner;
wherein a capacity of the scalable file system is thinly-provisioned and adjusted continuously as the file system interface exports, into the volume, its local file system inode structure and data to the selected cloud-based storage service provider, the capacity scaling continuously and as needed to store the local file system inode structure and data;
wherein the local file system provides a cache for the cloud; and
wherein a data transformation operation is carried out on the data prior to export to the selected cloud-based storage service provider.
2. The apparatus as described in claim 1 wherein the data transformation operation is one of: encryption, compression, and de-duplication.