Method and apparatus for data transfer reconciliation
View Patent ↗A method and system for monitoring data transfers over a one-way data link from a send node to a receive node. A send log file monitoring and transmitting module associated with the send node on a first server outputs a send log file containing information about data sent by the send node. A receive log file monitoring and transmitting module associated with the receive node on a second server outputs a receive log file containing information about data received by the receive node. A reconciliation module on a third server receives the send log file and the receive log file and identifies any data transfer errors by comparing the send log file with the receive log file. A web server is coupled to the reconciliation module to provide user access to the identified data transfer errors.
1. A system for monitoring data file transfers from a send node on a first server computer to a receive node on a second server computer, comprising:
a one-way data link having an input coupled to an output of the first server computer and an output coupled to an input of the second server computer, the first server computer coupled to the second server computer only via the one-way data link, there being no other communication path between the first server computer and the second server computer, the one-way data link configured to transmit data files from the input thereof to the output thereof and to prevent any signal from passing from the output thereof to the input thereof;
the send node on the first server computer including a send log file monitoring and transmitting module which outputs a send log file containing information about a sequence of a plurality of data files separately sent to the input of the one-way data link by the send node;
the receive node on the second server computer including a receive log file monitoring and transmitting module which outputs a receive log file containing information about a sequence of a plurality of data files separately received by the receive node on the output of the one-way data link; and
a third server computer, separate from the first server computer and the second server computer, containing a reconciliation module for receiving the send log file and the receive log file and identifying any data file transfer errors by comparing the send log file with the receive log file.
2. The system of claim 1 , further comprising a web server coupled to the reconciliation module for providing user access to the identified data file transfer errors.
3. The system of claim 1 , further comprising:
a first communications link for coupling the send log file monitoring and transmitting module to the reconciliation module; and
a second communications link for coupling the receive log file monitoring and transmitting module to the reconciliation module.
4. The system of claim 3 , wherein the first communications link transfers the send log file from the send log file monitoring and transmitting module to the reconciliation module and wherein the second communications link transfers the receive log file from the receive log file monitoring and transmitting module to the reconciliation module.
5. The system of claim 4 , where in the first communications link and the second communications link are one-way data links.
6. The system of claim 1 , wherein the send log file monitoring and transmitting module outputs the send log to the data link and further comprising:
a pass-through circuit associated with the receive node for receiving the send log from the data link; and
a communications link for coupling the receive log file monitoring and transmitting module and the pass-through circuit to the reconciliation module.
7. The system of claim 6 , wherein the communications link transfers the send log file from the pass-through circuit to the reconciliation module and the receive log file from the receive log file monitoring and transmitting module to the reconciliation module.
8. The system of claim 7 , wherein the communications link is a one-way data link.
9. The system of claim 1 , wherein the information included in the send log includes at least one of file name, file size, time to send, rate of transfer, number of packets for transfer, date of transfer and time of transfer.
10. The system of claim 1 , wherein the information included in the receive log includes at least one of file name, file size, time to receive the file, rate of transfer, MD5 check status, date of receipt and time of receipt.
11. A method for monitoring data file transfers over a one-way data link from a send node to a receive node, the receive node coupled to the send node only via the one-way data link, there being no other communication path between the first server computer and the second server computer, the one-way data link configured to transmit data files from an input thereof to an output thereof and to prevent any signal from passing from the output thereof to the input thereof, comprising the steps of:
outputting a send log file from a send log file monitoring and transmitting module associated with the send node to the input of the one-way data link, the send log file containing information about a sequence of a plurality of data files separately sent by the send node;
outputting a receive log file from a receive log file monitoring and transmitting module associated with the receive node, the receive log file containing information about a sequence of a plurality of data files separately received by the receive node on the output of the one-way data link; and
identifying any data file transfer errors in a reconciliation module for receiving the send log file and the receive log file by comparing the send log file with the receive log file.
12. The method of claim 11 , further comprising the step of providing the data file transfer error information to a web server coupled to the reconciliation module for providing user access to the identified data transfer errors.
13. The method of claim 11 , wherein the send node is on a first server and is only able to send data over the one-way data link, and wherein the receive node is on a second server and is only able to receive data over the one-way data link.
14. The method of claim 13 , wherein the reconciliation module is on a third server, separate from the first server and the second server.
15. The method of claim 14 , further comprising the steps of:
providing the send log file from the send log file monitoring and transmitting module to the reconciliation module via a first communications link; and
providing the receive log file from the receive log file monitoring and transmitting module to the reconciliation module via a second communications link.
16. The method of claim 15 , where in the first communications link and the second communications link are one-way data links.
17. The method of claim 14 , further comprising steps of:
outputting the send log file from the send log monitoring and transmitting module to the data link;
receiving the send log file from the data link at a pass-through circuit associated with the receive node;
providing the send log and the receive log file to a communications link coupling the receive log file monitoring and transmitting module and the pass-through circuit to the reconciliation module; and
receiving the send log file and the receive log file at the reconciliation module via the communication link.
18. The method of claim 17 , wherein the communications link is a one-way data link.
19. The method of claim 11 , wherein the information included in the send log includes at least one of file name, file size, time to send, rate of transfer, number of packets for transfer, date of transfer and time of transfer.
20. The method of claim 11 , wherein the information included in the receive log includes at least one of file name, file size, time to receive the file, rate of transfer, MD5 check status, date of receipt and time of receipt.
21. A system for monitoring data file transfers from a send node on a first server computer to a receive node on a second server computer, comprising:
a one-way data link having an input coupled to an output of the first server computer and an output coupled to an input of the second server computer, the first server computer coupled to the second server computer only via the one-way data link, there being no other communication path between the first server computer and the second server computer, the one-way data link configured to transmit data files from the input thereof to the output thereof and to prevent any signal from passing from the output thereof to the input thereof;
the send node on the first server computer including a send log file monitoring and transmitting module which outputs a send log file containing information about a sequence of a plurality of data files separately sent to the input of the one-way data link by the send node;
the receive node on the second server computer including a receive log file monitoring and transmitting module which outputs a receive log file containing information about a sequence of a plurality of data files separately received by the receive node on the output of the one-way data link; and
a third server computer, separate from the first server computer and the second server computer, containing:
a module for receiving and storing the send log file and the receive log file; and
a common event format module coupled to the module for receiving and storing for providing an output in a common event format.
22. The system of claim 21 , wherein the module for receiving and storing also identifies any data file transfer errors by comparing the send log file with the receive log file.
23. The system of claim 21 , wherein the information included in the send log includes at least one of file name, file size, time to send, rate of transfer, number of packets for transfer, date of transfer and time of transfer.
24. The system of claim 21 , wherein the information included in the receive log includes at least one of file name, file size, time to receive the file, rate of transfer, MD5 check status, date of receipt and time of receipt.