Method, electronic device and computer program product for processing machine learning model
A method comprises obtaining an intermediate representation of the machine learning model written in a source language. The intermediate representation is independent of the source language and a target language and comprises a structured text. The method also comprises generating a computation graph based on the intermediate representation. Nodes in the computation graph represent functions related to the machine learning model and a directed edge in the computation graph represents a dependency between functions. The method further comprises partitioning the computation graph into sequential parts in sequence such that the parts are executed sequentially, and functions corresponding to nodes in each part are executed in parallel.
1. A method for processing a machine learning model, comprising:
obtaining an intermediate representation of a machine learning model written in a source language, the intermediate representation being independent of the source language and a target language and comprising a structured text;
generating a computation graph based on the intermediate representation, nodes in the computation graph representing functions related to the machine learning model, a directed edge in the computation graph representing a dependency between the functions; and
partitioning the computation graph into sequential parts, such that the parts are executed sequentially and functions corresponding to nodes in each part are executed in parallel;
wherein partitioning the computation graph into sequential parts comprises determining a value for each of at least a first part of the nodes of the computation graph, wherein the value represents a number of edges directed to a given node; and
wherein each node in the first part has a first predetermined value.
2. The method of claim 1 , wherein partitioning the computation graph into sequential parts comprises partitioning the computation graph into the parts based on the values for each of the at least a first part of the nodes.
3. The method of claim 2 , wherein partitioning the computation graph into sequential parts based on the values comprises executing iteratively acts of removing, from the computation graph, the first part and a directed edge associated with nodes in the first part, to update the computation graph.
4. The method of claim 3 , wherein partitioning the computation graph into sequential parts based on the values comprises executing iteratively acts of selecting one or more sequential first parts of the computation graph, such that each node in the one or more sequential first parts has the first predetermined value.
5. The method of claim 4 , wherein the first predetermined value is equal to zero.
6. A computer program product, being tangibly stored on a non-transitory computer-readable medium and comprising machine executable instructions, the machine executable instructions, when executed, causing a machine to perform acts comprising:
obtaining an intermediate representation of a machine learning model written in a source language, the intermediate representation being independent of the source language and s target language and including a structured text;
generating a computation graph based on the intermediate representation, a node in the computation graph representing functions related to the machine learning model, a directed edge in the computation graph representing a dependency between the functions; and
partitioning the computation graph into sequential parts, such that the parts are executed sequentially, and functions corresponding to nodes in each part are executed in parallel;
wherein partitioning the computation graph into sequential parts comprises determining a value for each of at least a first part of the nodes of the computation graph, wherein the value represents a number of edges directed to a given node; and
wherein each node in the first part has a first predetermined value.
7. The method of claim 1 , wherein the first predetermined value is equal to zero.
8. An electronic device, comprising:
a processor; and
a memory storing computer program instructions, the processor running the computer program instructions in the memory to control the electronic device to perform acts comprising:
obtaining an intermediate representation of a machine learning model written in a source language, the intermediate representation being independent of the source language and a target language and comprising a structured text;
generating a computation graph based on the intermediate representation, nodes in the computation graph representing functions related to the machine learning model, a directed edge in the computation graph representing a dependency between the functions; and
partitioning the computation graph into sequential parts in sequence, such that the parts are executed sequentially, and functions corresponding to nodes in each part are executed in parallel;
wherein partitioning the computation graph into sequential parts comprises determining a value for each of at least a first part of the nodes of the computation graph, wherein the value represents a number of edges directed to a given node; and
wherein each node in the first part has a first predetermined value.
9. The electronic device of claim 8 , wherein partitioning the computation graph into sequential parts comprises partitioning the computation graph into the parts based on the values for each of the at least a first part of the nodes.
10. The electronic device of claim 9 , wherein partitioning the computation graph into sequential parts based on the values comprises executing iteratively acts of removing, from the computation graph, the first part and a directed edge associated with nodes in the first part, to update the computation graph.
11. The electronic device of claim 10 , wherein partitioning the computation graph into sequential parts based on the values comprises executing iteratively acts of selecting one or more sequential first parts of the computation graph, such that each node in the one or more sequential first parts has the first predetermined value.
12. The electronic device of claim 8 , wherein the first predetermined value is equal to zero.
13. The electronic device of claim 8 , wherein the intermediate representation of the machine learning model is described in a JavaScript Object Notation (JSON) format.
14. The electronic device of claim 8 , wherein the intermediate representation of the machine learning model is described in an Extensible Markup Language (XML) format.
15. The computer program product of claim 6 , wherein the first predetermined value is equal to zero.
16. The computer program product of claim 6 , wherein partitioning the computation graph into sequential parts comprises partitioning the computation graph into the parts based on the values for each of the at least a first part of the nodes.
17. The computer program product of claim 16 , wherein partitioning the computation graph into sequential parts based on the values comprises executing iteratively acts of removing, from the computation graph, the first part and a directed edge associated with nodes in the first part, to update the computation graph.
18. The computer program product of claim 17 , wherein partitioning the computation graph into sequential parts based on the values comprises executing iteratively acts of selecting one or more sequential first parts of the computation graph, such that each node in the one or more sequential first parts has the first predetermined value.
19. The computer program product of claim 6 , wherein the intermediate representation of the machine learning model is described in a JavaScript Object Notation (JSON) format.
20. The computer program product of claim 6 , wherein the intermediate representation of the machine learning model is described in an Extensible Markup Language (XML) format.