Granted Patent B2

US 12,314,866 · App. 17/138,334 · Granted May 27, 2025

Inventor: Shaoli Liu (Shanghai, CN)

Assignee: SHANGHAI CAMBRICON INFORMATION TECHNOLOGY CO., LTD

G06N5/02G06F7/57G06F11/3636G06N3/063G06N3/08

Abstract

Claims (27)

1. An operation device comprising a plurality of operation modules configured to execute computational sub-commands in parallel to complete a computational operation of a network model, wherein, each of the operation modules includes:

at least one operation unit configured to execute a first computational sub-command using first computational sub-data, wherein the first computational sub-command of each of the operation modules is part of the computational operation of the network model and the operation modules each execute the first computational sub-command in parallel; and

a separate storage unit configured to store the first computational sub-data, wherein the first computational sub-data includes data for executing the first computational sub-command;

wherein at least two operation modules in the plurality of operation modules have a data connection and a data transfer channel is built between the at least two operation modules based on the data connection for one of the at least two operation modules to obtain data stored in a separate storage unit of another of the at least two operation modules; and

wherein the at least one operation unit in the at least two operation modules is configured to execute the first computational sub-command using the first computational sub-data and second computational sub-data, and wherein the second computational sub-data is stored in the separate storage unit of the other operation module of the at least two operation modules.

2. The operation device of claim 1 , further comprising a control module configured to allocate a corresponding computational sub-command and corresponding computational sub-data to the plurality of operation modules according to a received computational command and computational data, wherein,

the received computational command includes a plurality of computational sub-commands, and the received computational data includes computational sub-data required for executing the plurality of computational sub-commands.

3. The operation device of claim 2 , wherein, the control module includes:

a first allocation unit configured to divide the computational command into a plurality of computational sub-commands according to a computational logic relationship in the computational command, and correspondingly allocate the plurality of computational sub-commands to different operation modules for operation, and

a second allocation unit configured to determine computational sub-data required for executing the computational sub-commands, and allocate the computational sub-data to a corresponding operation module for storage.

4. The operation device of claim 2 , wherein, the control module is further configured to selectively connect operation modules according to a computational logic relationship between the computational sub-commands.

5. The operation device of claim 1 , wherein, the operation unit includes a network processing circuit or a computing circuit.

6. The operation device of claim 1 , wherein, the storage unit includes at least one of a register, a register file, and a memory array.

7. A data processing chip comprising the operation device of claim 1 .

8. An electronic equipment comprising the data processing chip of claim 7 .

9. An operation method, wherein, the method is applied to an operation device, wherein the operation device comprises a plurality of operation modules configured to execute computational sub-commands in parallel to complete a computational operation of a network model, wherein at least two operation modules in the plurality of operation modules are connected by a data connection and a data transfer channel is built between the at least two operation modules based on the data connection, and wherein the method comprises:

storing first computational sub-data using a storage unit of an operation module of the at least two operation modules, wherein the first computational sub-data includes data for executing a first computational sub-command;

storing second computational sub-data using a separate storage unit of another operation module of the at least two operation modules, wherein the second computational sub-data includes data for executing the first computational sub-command; and

executing the first computational sub-command by an operation unit of the operation module using the first computational sub-data and the second computational sub-data, wherein the second computational sub-data is obtained via the data transfer channel from the separate storage unit in the other operation module of the at least two operation modules.

10. The method of claim 9 , further comprising:

allocating a computational sub-command and corresponding computational sub-data to the operation modules according to a received computational command and computational data, wherein,

the received computational command includes a plurality of computational sub-commands, and the received computational data includes computational sub-data required for executing the computational sub-commands.

11. The method of claim 10 , wherein, the allocating the computational sub-command and the corresponding computational sub-data to the operation modules according to the received computational command and computational data includes:

using a first allocation unit to divide the computational command into a plurality of computational sub-commands according to a computational logic relationship in the computational command, and correspondingly allocating the plurality of computational sub-commands to different operation modules for operation, and

using a second allocation unit to determine computational sub-data required for executing the computational sub-commands, and allocating the computational sub-data to a corresponding operation module for storage.

12. The method of claim 10 , further comprising:

selectively connecting operation modules according to a computational logic relationship between the computational sub-commands.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (280)