System and method for an improved merge utility
View Patent ↗Software application that interfaces with a main frame operating a job control language so as to overcome the file limit for processing in the job control language, by dividing files or other data sets into batches that are equal to or less than the limit of the job control language. The software application then provides the batches for processing in the job control language individually, so that the file limit is not exceeded for any processing operation.
1. A method comprising:
reading, by a computer-based system and to overcome a limit on a number of files that an external routine comprising an operating system (“OS”) is able to process, a parameter file associated with the OS to determine the number of files that the OS is able to process, wherein the number of files that the OS is able to process is associated with a job control language (“JCL”), and wherein the parameter file indicates a number of characters associated with at least one file in a list file, and wherein the parameter file further identifies the external routine;
setting, by the computer-based system, a batch size that is less than or equal to the limit;
allocating, by the computer-based system and from the list file, a series of files to a batch until a counter that is incremented each time a file from the list file is allocated to the batch has a value that is equal to the batch size;
delivering, by the computer-based system, the batch to the OS;
processing, by the computer-based system running the external routine, the batch;
resetting, by the computer-based system, the counter in response to the processing; and
repeating, by the computer-based system, the allocating, delivering, processing, and resetting.
2. The method of claim 1 , further comprising delivering, by the computer-based system, the batch individually to the OS as a list file.
3. The method of claim 1 , further comprising delivering, by the computer-based system, a plurality of batches to the OS in seriatim.
4. An article of manufacture including a non-transitory, tangible computer readable storage medium having instructions stored thereon that, in response to execution by a computer-based system and to overcome a limit on a number of files that an external routine comprising an operating system (“OS”) is able to process, cause the computer-based system to perform operations comprising:
reading, by the computer-based system, a parameter file associated with the OS to determine the number of files that the OS is able to process, wherein the number of files that the OS is able to process is associated with a job control language (“JCL”), and wherein the parameter file indicates a number of characters associated with at least one file in a list file, and wherein the parameter file further identifies the external routine;
setting, by the computer-based system, a batch size that is less than or equal to the limit;
allocating, by the computer-based system and from the list file, a series of files to a batch until a counter that is incremented each time a file from the list file is allocated to the batch has a value that is equal to the batch size;
delivering, by the computer-based system, the batch to the OS;
processing, by the computer-based system running the external routine, the batch;
resetting, by the computer-based system, the counter in response to the processing; and
repeating, by the computer-based system, the allocating, delivering, processing, and resetting.
5. The article of claim 4 , further comprising delivering, by the computer-based system, the batch individually to the OS as a list file.
6. The article of claim 4 , further comprising delivering, by the computer-based system, a plurality of batches to the OS in seriatim.
7. A system comprising:
a processor that overcomes a limit on a number of files that an external routine comprising an operating system (“OS”) is able to process,
a tangible, non-transitory memory configured to communicate with the processor, the tangible, non-transitory memory having instructions stored thereon that, in response to execution by the processor, cause the processor to perform operations comprising:
reading, by the processor, a parameter file associated with the OS to determine the number of files that the OS is able to process, wherein the number of files that the OS is able to process is associated with a job control language (“JCL”), and wherein the parameter file indicates a number of characters associated with at least one file in a list file, and wherein the parameter file further identifies the external routine;
setting, by the processor, a batch size that is less than or equal to the limit;
allocating, by the processor and from the list file, a series of files to a batch until a counter that is incremented each time a file from the list file is allocated to the batch has a value that is equal to the batch size;
delivering, by the processor, the batch to the OS;
processing, by the processor running the external routine, the batch;
resetting, by the processor, the counter in response to the processing; and
repeating, by the processor, the allocating, delivering, processing, and resetting.
8. The system of claim 7 , further comprising delivering, by the processor, the batch individually to the OS as a list file.
9. The system of claim 7 , further comprising delivering, by the processor, a plurality of batches to the OS in seriatim.