Cloud-native global file system with multi-site support using push classes
A technique for data sharing among multiple filers that share a volume in a private or public cloud object store is implemented. In this approach, a mechanism is provided to enable a local filer to determine whether other filers that are sharing the volume have a consistent view of new data being written to the cloud object store by the local filer. The begins by associating together a collection of one or more files in a “push class.” On demand, a push operation for the push class is initiated on the local filer. Preferably, the push is managed according to one or more push criteria associated with the push class. Typically, the push operation pushes file data and metadata associated with the one or more files of the push class in respective phases, with the file data being pushed to the cloud during a first phase and the metadata associated with that file data being pushed during a second phase that follows the first phase. After the push operation completes, a determination is made whether the new version of the file is available at one or more other filers that share the volume.
1. An apparatus associated with a private or public cloud object store in which a volume is being shared among filers across a number of sites, comprising:
computer hardware; and
software executed in the computer hardware and configured to:
receive a first call from a first filer, the first call comprising an attribute identifying a set of one or more files that satisfy a user-defined criteria and that comprise a payload configured to be pushed from the first filer to one or more second filers distinct from any point-in-time snapshot on a volume in the cloud object store;
responsive to receipt of the first call, issue to one or more second filers a second call, the second call comprising an identifier for the volume and configured to determine whether a push of the payload has arrived at a particular second filer; and
issue a notification that the payload has arrived at the particular second filer.
2. The apparatus as described in claim 1 wherein when the attribute has a first value, the payload comprises all dirty files present on the first filer.
3. The apparatus as described in claim 1 wherein the first and second calls each have an associated timeout.
4. The apparatus as described in claim 1 wherein the user-defined criteria is defined by one of: a directory pattern to follow, and a temporal constraint.
5. The apparatus as described in claim 1 wherein at least one second filer is located remote from the first filer.
6. The apparatus as described in claim 1 wherein the software provides a web-accessible management console.
7. The apparatus as described in claim 1 wherein the any point-in-time snapshot is performed on-demand.
8. The apparatus as described in claim 1 wherein the user-defined criteria is a push class.
9. The apparatus as described in claim 8 wherein file data and metadata associated with the one or more files are pushed from the first filer in respective phases, with the file data being pushed to the cloud during a first phase and the metadata associated with that file data being pushed during a second phase that follows the first phase.
10. An apparatus associated with a private or public cloud object store in which a volume is being shared among filers across a number of sites, comprising:
computer hardware; and
software executed in the computer hardware and configured to:
receive a first call from a first filer, the first call comprising an attribute identifying a set of one or more files that satisfy a user-defined criteria and that comprise a payload configured to be pushed from the first filer to one or more second filers distinct from any point-in-time snapshot on a volume in the cloud object store;
wherein when the attribute has a first value, the payload comprises all dirty files on the first filer; and
issue a notification to at least one second filer a second call, the second call comprising an identifier for the volume and configured to determine whether a push of the payload has arrived at the at least one second filer.