Parallel generating of bundles of data objects
Computer-implemented methods, computer systems and computer program products are provided for parallel processing a plurality of data objects with a plurality of processors. As disclosed herein, the data objects to be assembled for further processing may be in bundles, the bundles obeying first predefined criteria, which is dynamically controlled by using a bundle specific master table. The methods and systems may generate pipelines of data objects by pre-selecting and grouping the data objects according to second predefined criteria by a first group of the plurality of processors, and create the bundles from each pipeline of the pre-selected data objects by a second group of the plurality of processors.
1. A method for parallel processing a plurality of data objects in a computer system comprising a plurality of processors for processing the plurality of data objects, wherein the data objects to be assembled for further processing are in bundles, the bundles obeying first predefined criteria, which is dynamically controlled by using a bundle specific master table, the method comprising:
generating pipelines of data objects by pre-selecting and grouping the data objects according to second predefined criteria by a first group of the plurality of processors; and
creating the bundles from each pipeline of the pre-selected data objects by a second group of the plurality of processors, wherein the creation of bundles from each pipeline is performed independently of all other pipelines.
2. The method according to claim 1 , wherein the data objects are stored in a relational database.
3. The method according to claim 1 , wherein the method is used for a real-time processing of the data objects.
4. The method according to claim 1 , wherein the data objects are chosen as bank transactions.
5. The method according to claim 1 , wherein the first predefined criteria are chosen as size criteria of the bundles.
6. The method according to claim 1 , wherein at least one of the first group of processors and the second group of processors are incorporated in one single application server of the computer system.
7. A system for parallel processing a plurality of data objects, wherein the data objects to be assembled for processing are in bundles, the bundles obeying first predefined criteria, which is dynamically controlled by using a bundle specific master table, the system comprising:
a plurality of processors for processing the plurality of data objects, wherein a first group of the plurality of processors is configured to generate pipelines of data objects by pre-selecting and grouping the data objects according to second predefined criteria, and a second group of the plurality of processors is configured to create the bundles from each pipeline of the pre-selected data objects independently of all other pipelines.
8. The system according to claim 7 , wherein the data objects are stored in a relational database.
9. The system according to claim 7 , wherein the system is configured to be used for a real-time processing of the data objects.
10. The system according to claim 7 , wherein the data objects are bank transactions.
11. The system according to claim 7 , wherein the first predefined criteria are size criteria of the bundles.
12. A computer-readable physical storage medium with a computer program stored thereon, the computer program comprising instructions operable to cause a method for parallel processing a plurality of data objects to be performed in a computer system comprising a plurality of processors for processing the plurality of data objects, wherein the data objects to be assembled for further processing are in bundles, the bundles obeying first predefined criteria, which is dynamically controlled by using a bundle specific master table, the method comprising:
generating pipelines of data objects by pre-selecting and grouping the data objects according to second predefined criteria by a first group of the plurality of processors; and
creating the bundles from each pipeline of the pre-selected data objects by a second group of the plurality of processors, wherein the creation of bundles from each pipeline is performed independently of all other pipelines.
13. The computer-readable medium of claim 12 , wherein the data objects are stored in a relational database.
14. The computer-readable medium of claim 12 , wherein the method is used for a real-time processing of the data objects.
15. The computer-readable medium of claim 12 , wherein the data objects are chosen as bank transactions.
16. The computer-readable medium of claim 12 , wherein the first predefined criteria are chosen as size criteria of the bundles.