Configuration and execution of mass data run objects
Systems and processes may perform actions on a huge set of business objects, often in a batch process. A mass data run object may be instantiated based, at least in part, on a batch process request in a service-oriented architecture. Mass data run objects may include, potentially among other things, description elements and selection elements. The batch process can then be executed on a plurality of data elements using the mass data run object and its selection element.
1. A computer implemented method performed by one or more processors for mass data processing, the method comprising:
instantiating a mass data run object based, at least in part, on a batch process request in a service-oriented architecture, the mass data run object comprising a description element, a first selection element, a second selection element, and an execute action, wherein the execute action comprises code for execution of the mass data run object, the first selection element is associated with the data elements operable to be archived and includes criteria used to retrieve data for a batch process performed in response to the batch process request, and the second selection element is associated with particular selection criteria for data element types;
performing, by the mass data run object when executed, the execute action to generate a plurality of work packages for the batch process based on the first selection element and the second selection element, each work package comprising a discrete business object action;
creating multiple clusters with each cluster having a different group of independent work packages from the plurality of work packages;
for each cluster, confirming that none of the work packages in the cluster have sequence dependencies with any other work packages in the cluster; and
executing the batch process on a plurality of data elements by transmitting each cluster to a framework for parallel processing, wherein the framework is configured to execute each of the discrete business object actions of the work packages in each cluster in parallel.
2. The method of claim 1 , further comprising receiving the batch process request and selection criteria for the first and the second selection element via a user interface.
3. The method of claim 1 , wherein the mass data run object is executed synchronously.
4. The method of claim 1 , wherein the mass data run object is executed asynchronously.
5. The method of claim 1 , wherein executing the batch process includes transmitting the work package to a logically decoupled framework for parallel processing.
6. The method of claim 5 , wherein the framework for parallel processing calls an action using a local client proxy to retrieve and lock required data for processing the work package.
7. The method of claim 1 , wherein executing the batch process includes retrieving at least one data element for a report using the first and the second selection element.
8. The method of claim 1 , wherein executing the batch process includes at least one of modifying or archiving at least one of the data elements based on the first and the second selection element.
9. The method of claim 1 further comprising instantiating a log object associated with the particular mass data run object and the batch process.
10. The method of claim 9 , wherein the log object includes parameters for the batch process, a message, tracing information, and a summary, at least one of the foregoing comprising application-specific data.
11. The method of claim 9 , the log object operable to be saved by a remote process.
12. The method of claim 1 , wherein different instances of the mass data run object are used for different batch process requests.
13. Software for mass data processing, the software comprising computer readable instructions embodied on non-transitory, tangible, computer-readable media and operable to:
instantiate a mass data run object based, at least in part, on a batch process request in a service-oriented architecture, the mass data run object comprising a description element, a first selection element, a second selection element, and an execute action, wherein the execute action comprises code for execution of the mass data run object, and wherein the first selection element is associated with the data elements operable to be archived and includes criteria used to retrieve data for a batch process performed in response to the batch process request, and the second selection element is associated with particular selection criteria for data element types;
perform, by the mass data run object when executed, the execute action to generate a plurality of work packages for the batch process based on the first selection element and the second selection element, each work package comprising a discrete business object action;
create multiple clusters with each cluster having a different group of independent work packages from the plurality of work packages;
for each cluster, confirm that none of the work packages in the cluster have sequence dependencies with any other work packages in the cluster; and
execute the batch process on a plurality of data elements by transmitting each cluster to a framework for parallel processing, wherein the framework is configured to execute each of the discrete business object actions of the work packages in each cluster in parallel.
14. The software of claim 13 , further operable to receive the batch process request and selection criteria for the first and the second selection element via a user interface.
15. The software of claim 13 , wherein executing the batch process includes transmitting the work package to a logically decoupled framework for parallel processing.
16. A system for mass data processing, the system comprising:
memory for storing one or more mass data run objects; and
one or more processors operable to:
instantiate a mass data run object based, at least in part, on a batch process request in a service-oriented architecture, the mass data run object comprising a description element, a first selection element, a second selection element, and an execute action, wherein the execute action comprises code for execution of the mass data run object, and wherein the first selection element is associated with the data elements operable to be archived and includes criteria used to retrieve data for a batch process performed in response to the batch process request, and the second selection element is associated with particular selection criteria for data element types;
perform, by the mass data run object when executed, the execute action to generate a plurality of work packages for the batch process based on the first selection element and the second selection element, each work package comprising a discrete business object action;
create multiple clusters with each cluster having a different group of independent work packages from the plurality of work packages;
for each cluster, confirm that none of the work packages in the cluster have sequence dependencies with any other work packages in the cluster; and
execute the batch process on a plurality of data elements by transmitting each cluster to a framework for parallel processing, wherein the framework is configured to execute each of the discrete business object actions of the work packages in each cluster in parallel.
17. The system of claim 16 , wherein the batch process request and selection criteria for the first and the second selection element are received via a user interface.
18. The system of claim 16 , wherein executing the batch process includes transmitting the work package to a logically decoupled framework for parallel processing.
19. The system of claim 16 , wherein the one or more processors are further operable to instantiate a log object associated with the particular mass data run object and the batch process.