Preventing unnecessary upload
A computer-implemented method that can prevent an upload of a data set upon detection of a modification of the data set. The method includes storing a first portion of a file in a buffer while being in a receiving mode. Upon determining that applying one of a predefined transformation performed to the first portion of an existing data set will result in reproducing a content of the buffer: generating a transformation notification signal; and upon receiving a stop message, stopping the receiving mode which results in using the existing file on the server.
1. A computer-implemented method, the computer-implemented method comprising:
uploading, by one or more processors, a first portion of a file from a client device to a buffer of a server device while a receiving mode of the buffer is active, wherein the first portion of the file is a predefined number of rows, a predefined volume of data, or a predefined number of records;
generating, by one or more processors, a transformation notification signal based, at least in part, on determining that applying a predefined transformation on a first portion of an existing data set stored on the server device results in a generation of a data set that corresponds to the first portion of the file stored in the buffer; and
terminating, by one or more processors, an upload of a second portion of the file from the client device to the buffer of the server device based, at least in part, on receiving a stop message.
2. The computer-implemented method according to claim 1 , the computer-implemented method comprising:
determining that an execution of the predefined transformation will yield a content of the buffer; and
applying the predefined transformation to all of the existing data set.
3. The computer-implemented method according to claim 2 , the computer-implemented method comprising one or both of:
generating a progress message that indicates a status of the transformation that is being applied to the entire existing data set; and
upon determining that an inconsistency exists between the second portion of the file being uploaded to the buffer of the server device and a portion of a transformed existing file while being in the receiving mode, generating a difference message that indicates the inconsistency.
4. The computer-implemented method according to claim 1 , wherein the predefined transformation comprises executing at least one action selected out of a group of possible actions that include: a removal of a column, a renaming of a column, a reordering of columns, an insertion of a column, and a removal of an empty row.
5. The computer-implemented method according to claim 1 , the computer-implemented method comprising:
receiving a file upload request that includes meta data about a given file to be uploaded; and
using the meta data to identify a candidate existing file that, when transformed, may yield at least a portion of the given file to be uploaded.
6. The computer-implemented method according to claim 1 , the computer-implemented method comprising:
before reception of the data set, storing meta data of one or both of (i) a first portion of a complete file, wherein the first portion is stored in the buffer, and (ii) a related existing file generable by a transformation or an applied transformation.
7. The computer-implemented method according to claim 1 , the computer-implemented method comprising:
terminating, by the one or more processors, the receiving mode of the buffer automatically in response to a determination that the stop message was not received by the client device within a predetermined time period and that applying the predefined transformation to a predetermined percentage of a second portion of the existing data set stored on the server device continues to result in a set of data that corresponds to the second portion of the file already uploaded to the buffer of the server device.
8. The computer-implemented method according to claim 1 , the computer-implemented method comprising:
responsive to sending, by one or more processors, the stop message to the client device, using a transformed existing file for an additional operation.
9. A computer program product, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a device to cause the device to perform a computer-implemented method comprising:
uploading, by one or more processors, a first portion of a file from a client device to a buffer of a server device while a receiving mode of the buffer is active, wherein the first portion of the file is a predefined number of rows, a predefined volume of data, or a predefined number of records;
generating, by one or more processors, a transformation notification signal based, at least in part, on determining that applying a predefined transformation on a first portion of an existing data set stored on the server device results in a generation of a data set that corresponds to the first portion of the file stored in the buffer; and
terminating, by one or more processors, an upload of a second portion of the file from the client device to the buffer of the server device based, at least in part, on receiving a stop message.
10. The computer program product according to claim 9 , the computer-implemented method comprising:
determining that an execution of the predefined transformation will yield a content of the buffer; and
applying the predefined transformation to all of the existing data set.
11. The computer program product according to claim 10 , the computer-implemented method comprising one or both of:
generating a progress message that indicates a status of the transformation that is being applied to the entire existing data set; and
upon determining that an inconsistency exists between the second portion of the file being uploaded to the buffer of the server device and a portion of a transformed existing file while being in the receiving mode, generating a difference message that indicates the inconsistency.
12. The computer program product according to claim 9 , wherein the predefined transformation comprises executing at least one action selected out of a group of possible actions that include: a removal of a column, a renaming of a column, a reordering of columns, an insertion of a column, and a removal of an empty row.
13. The computer program product according to claim 9 , the computer-implemented method comprising:
receiving a file upload request that includes meta data about a given file to be uploaded; and
using the meta data to identify a candidate existing file that, when transformed, may yield at least a portion of the given file to be uploaded.
14. The computer program product according to claim 9 , the computer-implemented method comprising:
before reception of the data set, storing meta data of one or both of (i) a first portion of a complete file, wherein the first portion is stored in the buffer, and (ii) a related existing file generable by a transformation or an applied transformation.
15. The computer program product according to claim 9 , the computer-implemented method comprising:
terminating, by the one or more processors, the receiving mode of the buffer automatically in response to a determination that the stop message was not received by the client device within a predetermined time period and that applying the predefined transformation to a predetermined percentage of a second portion of the existing data set stored on the server device continues to result in a set of data that corresponds to the second portion of the file already uploaded to the buffer of the server device.
16. A computer system, the computer system comprising:
one or more computer processors;
at least one computer readable storage medium that is not a transitory signal per se; and
program instructions stored on the at least one computer readable storage medium, the program instructions being executable by at least one computer processor of the one or more computer processors to cause the at least one computer processor to perform a computer-implemented method comprising:
uploading, by one or more processors, a first portion of a file from a client device to a buffer of a server device while a receiving mode of the buffer is active, wherein the first portion of the file is a predefined number of rows, a predefined volume of data, or a predefined number of records;
generating, by one or more processors, a transformation notification signal based, at least in part, on determining that applying a predefined transformation on a first portion of an existing data set stored on the server device results in a generation of a data set that corresponds to the first portion of the file stored in the buffer; and
terminating, by one or more processors, an upload of a second portion of the file from the client device to the buffer of the server device based, at least in part, on receiving a stop message.