Systems and methods for cross-region data processing
A system may include processor(s) and a memory in communication with the processor(s) and storing instructions, that when executed by the processor(s), are configured to cause the system to perform a method for cross-region data processing. The system may receive data in a first processing region and may format the data into a plurality of data portions. The system may generate a copy of each data portion and may transmit each data portion copy to a cross-region processor. Responsive to determining the first processing region is functioning, the system may process data portion(s). The system may transmit, to a centralized location, the processed data portion(s). Responsive to determining the first processing region is not functioning, the system may transmit, from the cross-region processor, each data portion copy to a second processing region.
1. A system for data processing, comprising:
one or more processors; and
a memory in communication with the one or more processors and storing instructions that, when executed by the one or more processors, are configured to cause the system to:
receive first data in a first processing region;
format the first data into a plurality of first data portions;
generate a copy of each first data portion of the plurality of first data portions;
transmit each first data portion copy to a cross-region processor;
determine whether the first processing region is functioning;
responsive to determining the first processing region is functioning:
determine whether one or more first data portions of the plurality of first data portions can be processed;
responsive to determining the one or more first data portions of the plurality of first data portions can be processed, process the one or more first data portions of the plurality of first data portions;
responsive to determining the one or more first data portions of the plurality of first data portions cannot be processed, transmit the one or more first data portions that cannot be processed to a first raw data queue;
determine that the first raw data queue comprises one or more second portions of raw data;
process the one or more second portions of raw data; and
transmit, to a centralized location, the one or more processed first data portions and the one or more processed second portions of raw data; and
responsive to determining the first processing region is not functioning:
transmit, from the cross-region processor, each first data portion copy to a second processing region;
determine whether one or more first data portion copies of the plurality of first data portion copies can be processed;
responsive to determining the one or more first data portion copies of the plurality of first data portion copies can be processed, process the one or more of the first data portion copies;
responsive to determining the one or more first data portion copies of the plurality of first data portion copies cannot be processed, transmit the one or more first data portion copies that cannot be processed to a second raw data queue;
determine that the second raw data queue comprises one or more third portions of raw data;
process the one or more third portions of raw data; and
transmit, to the centralized location, the one or more processed first data portion copies and the one or more processed third portions of raw data.
2. The system of claim 1 , wherein the first data comprises invoice data.
3. The system of claim 1 , wherein the system utilizes one or more functions each comprising a time limit.
4. The system of claim 3 , wherein at least one of the one or more processors is configured to extend a time limit of at least one of the one or more functions.
5. The system of claim 3 , wherein at least one of the one or more functions comprises a time limit of 15 minutes.
6. The system of claim 1 , wherein the instructions are further configured to cause the system to:
responsive to determining the first processing region is not functioning, receive second data in the second processing region.
7. A system for data processing, comprising:
one or more processors; and
a memory in communication with the one or more processors and storing instructions that, when executed by the one or more processors, are configured to cause the system to:
receive first data in a first processing region;
format the first data into a plurality of first data portions;
generate a copy of each first data portion of the plurality of first data portions;
transmit each first data portion copy to a cross-region processor;
determine whether the first processing region is functioning;
responsive to determining the first processing region is functioning:
determine whether one or more first data portions of the plurality of first data portions can be processed;
responsive to determining the one or more first data portions can be processed, process the one or more first data portions of the plurality of first data portions;
transmit, to a centralized location, the one or more processed first data portions; and
responsive to determining the one or more first data portions of the plurality of first data portions cannot be processed, transmit the one or more first data portions that cannot be processed to a first raw data queue; and
responsive to determining the first processing region is not functioning:
transmit, from the cross-region processor, each first data portion copy to a second processing region;
determine whether one or more first data portion copies can be processed;
responsive to determining the one or more first data portions copies can be processed:
process the one or more first data portion copies;
transmit, to the centralized location, the one or more processed first data portion copies; and
responsive to determining the one or more first data portions copies cannot be processed, transmit the one or more first data portions copies that cannot be processed to a second raw data queue.
8. The system of claim 7 , wherein the first data comprises invoice data.
9. The system of claim 7 , wherein the system utilizes one or more functions each comprising a time limit.
10. The system of claim 7 , wherein the instructions are further configured to cause the system to:
responsive to determining the first processing region is not functioning, receive second data in the second processing region.
11. The system of claim 7 , wherein the instructions are further configured to cause the system to:
responsive to determining the first processing region is functioning:
determine whether the first raw data queue comprises one or more second portions of raw data;
responsive to determining the first raw data queue comprises one or more second portions of raw data, process at least one of the one or more second portions of raw data; and
transmit, to the centralized location, the at least one processed second portion of raw data.
12. The system of claim 7 , wherein the instructions are further configured to cause the system to:
responsive to determining the first processing region is not functioning:
determine whether the second raw data queue comprises one or more third portions of raw data;
responsive to determining the second raw data queue comprises one or more third portions of raw data, process at least one of the one or more third portions of raw data; and
transmit, to the centralized location, the at least one processed third portion of raw data.
13. A system for data processing, comprising:
one or more processors; and
a memory in communication with the one or more processors and storing instructions that, when executed by the one or more processors, are configured to cause the system to:
receive first data in a first processing region;
format the first data into a plurality of first data portions;
generate a copy of each first data portion of the plurality of first data portions;
transmit each first data portion copy to a cross-region processor;
attempt to process each first data portion of the plurality of first data portions;
determine the first processing region is not functioning; and
responsive to determining the first processing region is not functioning:
transmit, from the cross-region processor, each first data portion copy to a second processing region;
determine whether at least one copy of the one or more first data portion copies cannot be processed; and
responsive to determining the at least one copy cannot be processed, transmit the at least one copy that cannot be processed to a first raw data queue.
14. The system of claim 13 , wherein the instructions are further configured to cause the system to:
process one or more first data portions of the plurality of first data portions;
access a first raw data queue;
determine whether the first raw data queue comprises one or more second portions of raw data;
responsive to determining the first raw data queue comprises one or more second portions of raw data, process at least one of the one or more second portions of raw data; and
transmit, to a centralized location, the one or more processed first data portion copies and the at least one processed second portion of raw data.
15. The system of claim 13 , wherein the system utilizes one or more functions each comprising a time limit.
16. The system of claim 15 , wherein at least one of the one or more processors is configured to extend a time limit of at least one of the one or more functions.
17. The system of claim 13 , wherein the instructions are further configured to cause the system to:
receive second data in the second processing region.