Systems, methods and media for deferred synchronization of files in cloud storage client device
Systems, methods and media are provided for deferred synchronization of files in cloud storage systems. One method includes detecting changes to a data file. The method also includes monitoring I/O operations performed by a process associated with the changes. When the process is busy, the method also includes adding to an upload file list a name of a first file in response to a creation/modification of the first file. The method further includes adding to the list a new name of a second file and, when applicable, removing from the list an old name of the second file in response to renaming the second file. The method also includes removing from the list a name of a third file in response to a deletion of the third file and uploading files identifiable using file names in the list to the cloud storage server when the process is no longer busy.
1. A method, comprising:
detecting a change to content of a first file stored on a device connected to a cloud storage server, the first file having a first name;
determining an operation load of a process associated with the change to the content of the first file based on a number of operations performed by the process;
monitoring the process for a plurality of operations;
determining that a first operation from the plurality of operations renames the first file from the first name of the first file to a second name of the first file;
in response to determining that the first operation renames the first file, adding to an upload file list the second name of the first file;
determining that a second operation from the plurality of operations creates or modifies a second file;
in response to determining that the second operation creates or modifies the second file, adding to the upload file list a first name of the second file;
determining that a third operation from the plurality of operations renames the second file from the first name of the second file to a second name of the second file;
in response to determining that the third operation renames the second file:
adding to the upload file list the second name of the second file; and
removing from the upload file list the first name of the second file;
determining that a fourth operation from the plurality of operations deletes the first file; and
in response to determining that the fourth operation deletes the first file, removing from the upload file list the second name of the first file such that the upload file list includes the second name of the second file and does not include either the second name of the first file or the first name of the second file; and
uploading to the cloud storage server, after removing from the upload file list the second name of the first file, the second file based on the upload file list including the second name of the second file.
2. The method of claim 1 , wherein the first file is stored in a directory on the device, and the directory is managed by a cloud storage service program configured to run a background process.
3. The method of claim 1 , wherein the first file and the second file each includes at least one of a document file, an image file, an executable file, a graphics file, an animation file, an object file, a database file and a text file.
4. The method of claim 1 , wherein the process is associated with a running instance of an application program.
5. The method of claim 1 , wherein the second file includes the content of the first file and the change to the content of the first file.
6. The method of claim 5 , wherein the second name of the second file corresponds to the first name of the first file such that the second file, when uploaded to the cloud storage server, replaces a copy of the first file stored on the cloud storage server.
7. The method of claim 6 , wherein the first file is renamed before the second file is renamed.
8. The method of claim 7 , wherein the first file is deleted after the second file is renamed.
9. The method of claim 1 , wherein the upload file list includes at least one of a queue, a linked list and a text file.
10. An apparatus, comprising:
one or more interfaces configured to provide communication with one or more devices over a network; and
a processor, in communication with the one or more interfaces, configured to run a cloud storage management module stored in memory that is configured to:
detect a change to content of a first file stored on a device connected to a cloud storage server, the first file having a first name;
determine a first operation load of a process associated with the change to the content of the first file using a load-measuring heuristic that calculates the first operation load of the process based on (1) a number of operations performed by the process at a first time, (2) a second operation load of the process associated with a second time and being non-zero, and (3) a multiplier applied to the second operation load of the process;
in response to the first operation load of the process indicating that the process is busy:
monitor a plurality of operations associated with the process;
determine that a first operation from the plurality of operations renames the first file from the first name of the first file to a second name of the first file;
in response to determining that the first operation renames the first file, add to an upload file list the second name of the first file;
determine that a second operation from the plurality of operations creates or modifies a second file;
in response to determining that the second operation creates or modifies the second file, add to the upload file list a first name of the second file;
determine that a third operation from the plurality of operations renames the second file from the first name of the second file to a second name of the second file;
in response to determining that the third operation renames the second file:
add to the upload file list the second name of the second file; and
remove from the upload file list the first name of the second file;
determine that a fourth operation from the plurality of operations deletes the first file; and
in response to determining that the fourth operation deletes the first file, remove from the upload file list the second name of the first file; and
in response to the first operation load of the process not indicating that the process is busy, upload to the cloud storage server the second file based on the upload file list including the second name of the second file.
11. The apparatus of claim 10 , wherein the second file includes the content of the first file and the change to the content of the first file.
12. The apparatus of claim 11 , wherein the second name of the second file corresponds to the first name of the first file such that the second file, when uploaded to the cloud storage server, replaces a copy of the first file stored on the cloud storage server.
13. The apparatus of claim 12 , wherein the first file is renamed before the second file is renamed.
14. The apparatus of claim 13 , wherein the first file is deleted after the second file is renamed.
15. The apparatus of claim 10 , wherein the load-measuring heuristic calculates the first operation load of the process associated with the first time using an equation L t =F t +H*L t−1 , where
L t is the first operation load of the process,
F t is the number of operations performed by the process at the first time,
H is the multiplier, and
L t−1 is the second operation load of the process associated with the second time.
16. A non-transitory computer readable medium having executable instructions operable to cause an apparatus to:
detect a change to content of a first file stored on a device connected to a cloud storage server, the first file having a first name;
monitor a plurality of operations associated with a process associated with the change to the content of the first file;
determine that a first operation from the plurality of operations renames the first file from the first name of the first file to a second name of the first file;
in response to determining that the first operation renames the first file, add to an upload file list the second name of the first file, the upload file list including one or more names of files and not information indicating one or more operations performed to files;
determine that a second operation from the plurality of operations creates or modifies a second file;
in response to determining that the second operation creates or modifies the second file, add to the upload file list a first name of the second file;
determine that a third operation from the plurality of operations renames the second file from the first name of the second file to a second name of the second file;
in response to determining that the third operation renames the second file:
add to the upload file list the second name of the second file; and
remove from the upload file list the first name of the second file;
determine that a fourth operation from the plurality of operations deletes the first file;
in response to determining that the fourth operation deletes the first file, remove from the upload file list the second name of the first file; and
upload to the cloud storage server the second file based on the upload file list including the second name of the second file.
17. The computer readable medium of claim 16 , wherein the second file includes the content of the first file and the change to the content of the first file.
18. The computer readable medium of claim 17 , wherein the second name of the second file corresponds to the first name of the first file such that the second file, when uploaded to the cloud storage server, replaces a copy of the first file stored on the cloud storage server.
19. The computer readable medium of claim 18 , wherein the first file is deleted after the second file is renamed.
20. The computer readable medium of claim 18 , wherein the uploading occurs after the second name of the second file remains on the upload file list for a predetermined period of time.