Managing task flow in edge computing environment
The present disclosure provides a computer-implemented method, computer system and computer program product for managing a task flow. According to the computer-implemented method, a definer module may receive a request for executing a task flow. The definer module may determine a cluster of edge devices to execute the task flow from a set of edge devices. The definer module may retrieve metadata information for the task flow and edge devices in the cluster, wherein the metadata information is used to schedule the task flow in the cluster. Then the edge devices in the cluster may execute the task flow according to the metadata information.
1. A computer-implemented method comprising:
receiving, by a definer module, a request for executing a task flow;
determining, by the definer module, a cluster of edge devices to execute the task flow from a set of edge devices, wherein determining the cluster of edge devices to execute the task flow from the set of edge devices comprises:
retrieving, by the definer module, attributes of the task flow and the set of edge devices respectively; and
selecting a group of edge devices from the set of edge devices as the cluster of edge devices to execute the task flow based on a mapping relationship of the attributes between the task flow and the set of edge devices;
retrieving, by the definer module, metadata information for the task flow and the edge devices in the cluster, wherein the metadata information is used to schedule the task flow in the cluster; and
executing, by the edge devices in the cluster, the task flow according to the metadata information, wherein executing the task flow according to the metadata information comprises:
sending, by a sending module, a request for executing the task flow with the metadata information to one or more starting edge devices in the cluster, wherein the task flow comprises a series of subtasks and the one or more starting edge devices correspond to one or more starting subtasks according to the metadata information;
running, by a corresponding edge device in the cluster, the corresponding subtask according to the metadata information; and
in response to one or more last subtasks being completed by one or more last edge devices, sending, by the one or more last edge devices, one or more final running results to a receiver module;
selecting, by the definer module, one edge device from the edge devices in the cluster as a coordinator device to manage a status of other edge devices in the cluster; and
indicating, by the definer module, the information of the coordinator device in the metadata information.
2. The method of claim 1 , wherein executing the task flow according to the metadata information comprises:
sending, by a sending module, a request for executing the task flow with the metadata information to one or more starting edge devices in the cluster, wherein the task flow comprises a series of subtasks and the one or more starting edge devices correspond to one or more starting subtasks according to the metadata information;
running, by a corresponding edge device in the cluster, the corresponding subtask according to the metadata information;
in response to one or more last subtasks being completed by one or more last edge devices, sending, by the one or more last edge devices, one or more final running results to a receiver module;
obtaining, by the coordinator device, status information of the other edge devices in the cluster; and
sending, by the coordinator device, the status information to the receiver module.
3. The method of claim 1 , wherein sending the request for executing the task flow with the metadata information to the one or more starting edge devices in the cluster comprises:
sending, by the sending module, the request for executing the task flow with the metadata information in a header of the request to the one or more starting edge devices in the cluster.
4. The method of claim 1 , wherein the metadata information is selected from a group consisting of at least one of an ID of the task flow, an ID of the cluster, IDs of the edge devices involved in the cluster, IDs of subtasks of the task flow to be executed by the edge devices in the cluster, or an ID of a coordinator device.
5. A computer system, the computer system comprising:
one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage medium, and program instructions stored on at least one of the one or more tangible storage medium for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising:
receiving, by a definer module, a request for executing a task flow;
determining, by the definer module, a cluster of edge devices to execute the task flow from a set of edge devices, wherein determining the cluster of edge devices to execute the task flow from the set of edge devices comprises:
retrieving, by the definer module, attributes of the task flow and the set of edge devices respectively; and
selecting a group of edge devices from the set of edge devices as the cluster of edge devices to execute the task flow based on a mapping relationship of the attributes between the task flow and the set of edge devices;
retrieving, by the definer module, metadata information for the task flow and the edge devices in the cluster, wherein the metadata information is used to schedule the task flow in the cluster;
executing, by the edge devices in the cluster, the task flow according to the metadata information, wherein executing the task flow according to the metadata information comprises:
sending, by a sending module, a request for executing the task flow with the metadata information to one or more starting edge devices in the cluster, wherein the task flow comprises a series of subtasks and the one or more starting edge devices correspond to one or more starting subtasks according to the metadata information;
running, by a corresponding edge device in the cluster, the corresponding subtask according to the metadata information; and
in response to one or more last subtasks being completed by one or more last edge devices, sending, by the one or more last edge devices, one or more final running results to a receiver module;
selecting, by the definer module, one edge device from the edge devices in the cluster as a coordinator device to manage a status of other edge devices in the cluster; and
indicating, by the definer module, the information of the coordinator device in the metadata information.
6. The computer system of claim 5 , wherein executing the task flow according to the metadata information comprises:
sending, by a sending module, a request for executing the task flow with the metadata information to one or more starting edge devices in the cluster, wherein the task flow comprises a series of subtasks and the one or more starting edge devices correspond to one or more starting subtasks according to the metadata information;
running, by a corresponding edge device in the cluster, the corresponding subtask according to the metadata information;
in response to one or more last subtasks being completed by one or more last edge devices, sending, by the one or more last edge devices, one or more final running results to a receiver module;
obtaining, by the coordinator device, status information of the other edge devices in the cluster; and
sending, by the coordinator device, the status information to the receiver module.
7. The computer system of claim 5 , wherein sending the request for executing the task flow with the metadata information to the one or more starting edge devices in the cluster comprises:
sending, by the sending module, the request for executing the task flow with the metadata information in a header of the request to the one or more starting edge devices in the cluster.
8. The computer system of claim 5 , wherein the metadata information is selected from a group consisting of at least one of an ID of the task flow, an ID of the cluster, IDs of the edge devices involved in the cluster, IDs of subtasks of the task flow to be executed by the edge devices in the cluster, or an ID of a coordinator device.
9. A computer program product, the computer program product comprising:
one or more computer-readable storage medium and program instructions stored on at least one of the one or more storage medium, the program instructions executable by a processor capable of performing a method, the method comprising:
receiving, by a definer module, a request for executing a task flow;
determining, by the definer module, a cluster of edge devices to execute the task flow from a set of edge devices, wherein determining the cluster of edge devices to execute the task flow from the set of edge devices comprises:
retrieving, by the definer module, attributes of the task flow and the set of edge devices respectively; and
selecting a group of edge devices from the set of edge devices as the cluster of edge devices to execute the task flow based on a mapping relationship of the attributes between the task flow and the set of edge devices;
retrieving, by the definer module, metadata information for the task flow and the edge devices in the cluster, wherein the metadata information is used to schedule the task flow in the cluster; and
executing, by the edge devices in the cluster, the task flow according to the metadata information, wherein executing the task flow according to the metadata information comprises:
sending, by a sending module, a request for executing the task flow with the metadata information to one or more starting edge devices in the cluster, wherein the task flow comprises a series of subtasks and the one or more starting edge devices correspond to one or more starting subtasks according to the metadata information;
running, by a corresponding edge device in the cluster, the corresponding subtask according to the metadata information; and
in response to one or more last subtasks being completed by one or more last edge devices, sending, by the one or more last edge devices, one or more final running results to a receiver module;
selecting, by the definer module, one edge device from the edge devices in the cluster as a coordinator device to manage a status of other edge devices in the cluster; and
indicating, by the definer module, the information of the coordinator device in the metadata information.
10. The computer program product of claim 9 , wherein executing the task flow according to the metadata information comprises:
sending, by a sending module, a request for executing the task flow with the metadata information to one or more starting edge devices in the cluster, wherein the task flow comprises a series of subtasks and the one or more starting edge devices correspond to one or more starting subtasks according to the metadata information;
running, by a corresponding edge device in the cluster, the corresponding subtask according to the metadata information;
in response to one or more last subtasks being completed by one or more last edge devices, sending, by the one or more last edge devices, one or more final running results to a receiver module;
obtaining, by the coordinator device, status information of the other edge devices in the cluster; and
sending, by the coordinator device, the status information to the receiver module.
11. The computer program product of claim 9 , wherein sending the request for executing the task flow with the metadata information to the one or more starting edge devices in the cluster comprises:
sending, by the sending module, the request for executing the task flow with the metadata information in a header of the request to the one or more starting edge devices in the cluster.