Queued parallel processing of block handling for virtual tape control units
View Patent ↗Embodiments are described for a method and system for performing data writes in a virtual tape emulation system. A parallel processing component receives data blocks from a mainframe host and upon receipt provides indication to the mainframe that a current block is received so that the mainframe can proceed to send the next block while the current block is processed. The component initiates parallel processing of the received block in a separate task, and as the operation completes, the data is written to non-tape media in a block-wise manner.
1. A method comprising:
receiving, in a virtual tape emulation (VTE) device, a data block of a plurality of data blocks from a host mainframe computer, wherein each block of the plurality of data blocks is processed in a dedicated processor of a multi-processor system;
transmitting a receive status of the received data block back to the host upon receipt of the received data block;
initiating a parallel execution thread for the received data block to asynchronously process the received data block through a parallelized operation; and
queuing additional data blocks of the plurality of blocks for the parallel execution thread until a stop condition is reached, and wherein the received data block and each of the additional data blocks is processed through a buffer pool and structure array corresponding to a maximum number of parallel processing blocks.
2. The method of claim 1 wherein the parallelized operation is selected from the group consisting of: compression, encryption, deduplication, data rearrangement, and checksum calculation.
3. The method of claim 2 wherein the stop condition comprises one of: reaching a maximum number of parallel-processing blocks per device, reaching an end-of-chain condition, receiving a different non-write command, and receiving an error packet.
4. The method of claim 1 further comprising writing the processed block and additional data blocks to a storage media in a block-wise manner.
5. The method of claim 1 wherein the maximum number is determined through one of an automated process that incorporates user input, and a fixed setting defined in the VTE.
6. The method of claim 1 wherein the data blocks are generated through a channel command word (CCW) operation.
7. The method of claim 6 further comprising performing a CCW validity check to verify parameters including flags, length, and write mode.
8. The method of claim 1 further comprising writing the data blocks to non-tape storage media coupled to the mainframe, wherein the virtual tape emulation device facilitates the use of tape-based storage commands to process data.
9. The method of claim 2 wherein the deduplication comprises an assisted mainframe deduplication that is configured to rearrange data within the received data block to aggregate data that is capable of being deduplicated separately from data that is not capable of being deduplicated.
10. A system comprising:
a virtual tape emulation (VTE) device receiving a data block of a plurality of data blocks from a host mainframe computer, and transmitting a receive status of the received data block back to the host upon receipt of the received data block; and
a parallel processing component initiating a parallel execution thread for the received data block to asynchronously process the received data block, and queue additional data blocks of the plurality of blocks for the parallel execution thread until a stop condition is reached, wherein the parallel processing component comprises an buffer pool and structure array, and wherein a number of buffers in the buffer pool and number of structures in the structure array dictate how many concurrent operations may be executed by the VTE device.
11. The system of claim 10 wherein the parallel processing component is integrated within the VTE device.
12. The system of claim 10 wherein the buffer pool and structure array are instantiated for the VTE upon startup of the system.
13. The system of claim 10 wherein the VTE is one of a plurality of VTE devices in a system coupling the host mainframe computer to a storage medium.
14. The system of claim 10 wherein the number of buffers in the buffer pool and number of structures in the structure array is determined through one of an automated process that incorporates user input, and a fixed setting defined in the VTE.
15. The system of claim 10 wherein the received data block is processed through at least one parallelized operation selected from the group consisting of: compression, encryption, deduplication, data rearrangement, and checksum calculation.
16. The method of claim 15 wherein the stop condition comprises one of: reaching a maximum number of parallel-processing blocks per device, reaching an end-of-chain condition, receiving a different non-write command, and receiving an error packet.
17. A computer program product comprising a non-transitory computer usable medium having machine readable code embodied therein for:
receiving, in a virtual tape emulation (VTE) device, a data block of a plurality of data blocks from a host mainframe computer, wherein each block of the plurality of data blocks is processed in a dedicated processor of a multi-processor system;
transmitting a receive status of the received data block back to the host upon receipt of the received data block;
initiating a parallel execution thread for the received data block to asynchronously process the block through a parallelized operation; and
queuing additional data blocks of the plurality of blocks for the parallel execution thread until a stop condition is reached, and wherein the received data block and each of the additional data blocks is processed through a buffer pool and structure array corresponding to a maximum number of parallel processing blocks.