Systems and methods for automatic data management for an asynchronous task-based runtime
A compilation system can define, at compile time, the data blocks to be managed by an Even Driven Task (EDT) based runtime/platform, and can also guide the runtime/platform on when to create and/or destroy the data blocks, so as to improve the performance of the runtime/platform. The compilation system can also guide, at compile time, how different tasks may access the data blocks they need in a manner that can improve performance of the tasks.
1. A system for creating at runtime, in a memory efficient manner, one or more data blocks to be used by one or more tasks to be executed by an event-driven task (EDT) platform comprising a plurality of processing nodes, the system comprising:
a first processor; and
a first memory in electrical communication with the first processor, the first memory comprising instructions which, when executed by a processing unit comprising at least one of the first processor and a second processor, and in electronic communication with a memory module comprising at least one of the first memory and a second memory, configure the processing unit as a compiler programmed to:
identify a data block to be used by a first task to be executed by the event-driven task (EDT) platform;
identify a first set of predecessor tasks comprising each task that is: (i) predecessor to the first task, and (ii) independent of the data block;
generate a data block creation task directing creation of the data block; and
specify: (i) the data block creation task as a predecessor of the first task; and (ii) at least one task in the first set of predecessor tasks as a predecessor of the data block creation task, thereby delaying runtime creation and corresponding memory usage of the data block.
2. The system of claim 1 , wherein the first set of predecessor tasks consists essentially of each task that is: (i) an immediate predecessor to the first task, and (ii) independent of the data block.
3. The system of claim 2 , wherein to perform the specify operation, the instructions program the processing unit to specify each task in the second set of predecessor tasks as a predecessor of the data block creation task.
4. The system of claim 1 , wherein to perform the specify operation, the instructions program the processing unit to specify each task in the first set of predecessor tasks as a predecessor of the data block creation task.
5. The system of claim 1 , wherein the instructions further program the processing unit to:
identify a second task to be executed by the event-driven task (EDT) platform, the second task also using the data block; and
identify a second set of predecessor tasks comprising each task that is: (i) predecessor to the second task, and (ii) independent of the data block,
wherein to perform the specify operation, the instructions program the processing unit to specify: (i) the data block creation task as a predecessor of the second task; and (ii) at least one task in the second set of predecessor tasks as a predecessor of the data block creation task.
6. The system of claim 1 , wherein the instructions program the processing unit to:
identify a first set of successor tasks comprising each task that is: (i) successor of the first task, and (ii) independent of the data block;
generate a data block deletion task directing deletion of the data block; and
specify: (i) the data block deletion task as a successor of the first task; and (ii) at least one task in the first set of successor tasks as a successor of the data block deletion task, thereby advancing runtime deletion and corresponding freeing of memory allocated to the data block.
7. The system of claim 6 , wherein the first set of successor tasks consists essentially of each task that is: (i) an immediate successor of the first task, and (ii) independent of the data block.
8. The system of claim 6 , wherein to perform the specify operation, the instructions program the processing unit to specify each task in the first set of successor tasks as a successor of the data block deletion task.
9. The system of claim 6 , wherein the instructions program the processing unit to:
identify a second task to be executed by the event-driven task (EDT) platform, the second task also using the data block; and
identify a second set of successor tasks comprising each task that is: (i) successor of the second task, and (ii) independent of the data block,
wherein to perform the specify operation, the instructions program the processing unit to specify: (i) the data block deletion task as a successor of the second task; and (ii) at least one task in the second set of successor tasks as a successor of the data block deletion task.
10. The system of claim 9 , wherein to perform the specify operation, the instructions program the processing unit to specify each task in the second set of successor tasks as a successor of the data block deletion task.