Persistent queuing for distributed file systems
View Patent ↗Disclosed are novel methods and apparatus for persistent queuing in distributed file systems. In an embodiment, an apparatus is disclosed. The apparatus includes a distributed file system including a plurality of remote systems. The plurality of remote systems includes a sender site and a receiver site. The apparatus further includes a local queue accessible by the sender site; a remote queue accessible by the receiver site; a next attempt time indicator; and an attempt counter. The next attempt time indicator may specify a next time to install a transferred file on the receiver site. The attempt counter indicates how many attempts have been made to install the transferred file on the receiver site.
1. A communication system comprising:
a distributed file system including a plurality of remote systems, the plurality of remote systems including a sender site and a receiver site, the sender site to transfer a file to the receiver site;
a local queue accessible by the sender site to store data associated with the transfer of the file; and
a remote queue accessible by the receiver site to store data associated with the transferred file and including:
a next attempt time indicator, the next attempt time indicator specifying a next time to install the transferred file from the sender site on the receiver site; and
an attempt counter, the attempt counter indicating how many attempts have been made by the receiver site to install the transferred file on the receiver site,
wherein receiving the file at the receiver site is independent of installing the file at the receiver site, and
wherein the attempt counter and the next attempt time indicator operate together to exponentially back off each subsequent try by the receiver site to install the transferred file on the receiver site.
2. The communication system of claim 1 wherein the local queue and remote queue assist in synchronizing data on the sender site and the receiver site by providing storage for the file if either the sender site or receiver site is inoperable.
3. The communication system of claim 1 wherein the attempt counter is incremented every time an installation of the transferred file is unsuccessful.
4. The communication system of claim 1 wherein the remote queue is accessible by the sender site.
5. The communication system of claim 1 wherein the local queue includes one or more fields selected from a group comprising insert time, send time, received time, installation message, checksum, resend, job description, pointers, destination site id, local site id, and unsent job count.
6. The communication system of claim 1 wherein the remote queue includes one or more fields selected from a group comprising origin site, checksum, predecessor information, size, read time, complete time, and installation priority of job N.
7. The communication system of claim 1 wherein the sender site further includes a database reader to access information stored in the sender site database.
8. The communication system of claim 1 wherein the receiver site further includes a remote server to access information stored in a receiver site database.
9. The communication system of claim 1 further including an Revision Control System (RCS) for at least one of the sender site and the receiver site.
10. The communication system of claim 1 wherein the sender site further includes a send daemon to transfer the file.
11. The communication system of claim 1 wherein the sender site and the receiver site are configured in a hub and spoke network.
12. A method comprising:
providing a distributed file system including a plurality of remote systems, the plurality of remote systems including a sender site and a receiver site, the sender site to transfer a file to the receiver site;
providing a local queue accessible by the sender site to store data associated with the transfer of the file; and
providing a remote queue accessible by the receiver site to store data associated with the transferred file, the remote queue including:
a next attempt time indicator, the next attempt time indicator specifying a next time to install the transferred file from the sender site on the receiver site; and
an attempt counter, the attempt counter indicating how many attempts have been made by the receiver site to install the transferred file on the receiver site;
wherein receiving the file at the receiver site is independent of installing the file at the receiver site, and
wherein the attempt counter and the next attempt time indicator operate together to exponentially back off each subsequent try by the receiver site to install the transferred file on the receiver site.
13. The method of claim 12 wherein the local queue and remote queue assist in synchronizing data on the sender site and the receiver site by providing storage for the file if either the sender site or receiver site is inoperable.
14. The method of claim 12 further including incrementing the attempt counter each time an installation of the transferred file is unsuccessful.
15. The method of claim 12 wherein the remote queue is accessible by the sender site.
16. The method of claim 12 wherein the local queue includes one or more fields selected from a group comprising insert time, send time, received time, installation message, checksum, resend, job description, pointers, destination site id, local site id, and unsent job count.
17. The method of claim 12 wherein the remote queue includes one or more fields selected from a group comprising origin site, checksum, predecessor information, size, read time, complete time, and installation priority of job N.
18. The method of claim 12 wherein the sender site further includes a database reader to access information stored in the sender site database.
19. The method of claim 12 wherein the receiver site further includes a remote server to access information stored in a receiver site database.
20. The method of claim 12 further including a Revision Control System (RCS) for at least one of the sender site and the receiver site.
21. The method of claim 12 wherein the sender site further includes a send daemon to transfer the file.
22. The method of claim 12 wherein the sender site and the receiver site are configured in a hub and spoke network.
23. An apparatus comprising:
a distributed file system including a plurality of remote systems, the plurality of remote systems including a sender site and a receiver site, the sender site to transfer a file to the receiver site;
a local queue means accessible by the sender site to store data associated with the transfer of the file; and
a remote queue means accessible by the receiver site to store data associated with the transferred file and including:
a next attempt means, the next attempt means specifying a next time to install the transferred file from the sender site on the receiver site; and
an attempt counter means, the attempt counter means indicating how many attempts have been made by the receiver site to install the transferred file on the receiver site,
wherein receiving the file at the receiver site is independent of installing the file at the receiver site, and
wherein the next attempt means and the attempt counter means operate together to exponentially back off each subsequent try by the receiver site to install the transferred file on the receiver site.
24. The apparatus of claim 23 , wherein the local queue and remote queue assist in synchronizing data on the sender site and the receiver site by providing storage for the file if either the sender site or receiver site is inoperable.
25. The apparatus of claim 23 , wherein the attempt counter means is incremented every time an installation of the transferred file is unsuccessful.
26. The apparatus of claim 23 , wherein the remote queuing means is accessible by the sender site.
27. The apparatus of claim 23 , wherein the local queuing means includes one or more fields selected from a group comprising insert time, send time, received time, installation message, checksum, resend, job description, pointers, destination site id, local site id, and unsent job count.