IP Library › Granted Patent US 12,093,807
Granted Patent B2
US 12,093,807 · App. 16/891,079 · Granted Sep 17, 2024

Neural network, method of control of neural network, and processor of neural network

Inventors: Takao Marukame (Tokyo, JP); Kazuo Ishikawa (Kawasaki, JP); Junichi Sugino (Kawasaki, JP); Toshimitsu Kitamura (Kawasaki, JP); Yutaka Tamura (Kawasaki, JP); Koji Takahashi (Kawasaki, JP)
Assignees: Kabushikiki Kaisha Toshiba; Toshiba Information Systems (Japan) Corporation
G06N3/063G06F7/5443
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,093,807
App. No.
16/891,079
Granted
Sep 17, 2024
Kind
B2
Abstract

A neural network not requiring massive changes in configuration when changing the number of stages (number of levels) of the neural network. This neural network is provided with at least one neuron core 10 performing an analog multiply-accumulate operation and a weight-value-supply control unit 30 supplying the weight value to the neuron core 10. This neural network is subjected to control processing by a control-processor unit 40 controlling the supply of the weight value from said weight-value-supply control unit 30 in synchronization with the timing of the analog multiply-accumulate operation of the neuron core 10, and processing the data output from the neuron core 10 at every analog multiply-accumulate operation performed by said neuron core as serial data and/or parallel data.

Claims (41)

1. A neural network comprising:

at least one neuron core having a data input terminal for receiving analog input data, a data output terminal for outputting analog output data, and a weight value input terminal, the neuron core being configured to perform an analog multiply-accumulate operation based on the analog input data arriving from the data input terminal and a weight value arriving from the weight value input terminal, the weight value being analog data;

a weight-value-supply control unit connected to the weight value input terminal and supplying the weight value from the weight value input terminal to said neuron core,

a control-processor unit controlling the supply of the weight value from said weight-value-supply control unit and processing the analog output data output from the data output terminal at every analog multiply-accumulate operation performed by said neuron core as serial data and/or parallel data; and

a data-hold-supply control unit connected to the data input terminal and the data output terminal, and provided with at least one second register and a second selector, the second register being configured to hold at least the analog output data operated by the neuron core and output from the data output terminal such that the hold data is suppliable to output to the second selector, and the second selector being capable of selecting any one of the at least one second register or an input data arriving from a prior stage, and wherein the second selector causes opening and closing a path for transmitting the held data in the second register to the data input terminal,

wherein said control-processor unit controls timing of holding data at the second register, and timing of opening and closing of the path, and controls the selecting operation of the second selector with respect to the input data from the prior stage and the hold data in the second registers.

2. The neural network according to claim 1 , wherein said weight-value-supply control unit is provided with

a plurality of first registers respectively holding weight values and

a first selector for selecting any one of the plurality of first registers and opening and closing a path for transmitting the held weight value to the weight value input terminal.

3. The neural network according to claim 1 , wherein said control-processor unit is configured by

a main control unit controlling the overall neural network and

a sub-control unit directly controlling said neuron core, said weight-value-supply control unit, and said data-hold-supply control unit based on instructions of said main control unit,

said main control unit capable of setting the weight value at said weight-value-supply control unit and the data at said data-hold-supply control unit.

4. The neural network according to claim 3 , which can refer to the weight value set at said weight-value-supply control unit and the data set at said data-hold-supply control unit from said main control unit.

5. The neural network according to claim 1 , which compares the data set at said data-hold-supply control unit with the analog output data from the data output terminal, and notifies said main control unit of the comparison results.

6. A method of control of a neural network, the neural network comprising:

at least one neuron core having a data input terminal for receiving analog input data, a data output terminal for outputting analog output data, and a weight value input terminal, the neuron core being configured to perform an analog multiply-accumulate operation based on the analog input data arriving from the data input terminal and a weight value arriving from the weight value input terminal, the weight value being analog data,

a weight-value-supply control unit connected to the weight value input terminal and supplying the weight value from the weight value input terminal to said neuron core, and

a data-hold-supply control unit provided with at least one second register and a second selector, the second register being configured to hold the analog output data operated by the neuron core and output from the data output terminal such that the hold data is suppliable to output to the second selector, and the second selector being capable of selecting any one of the at least one second register or an input data arriving from a prior stage, and wherein the second selector causes opening and closing a path for transmitting the held data in the second register to the data input terminal,

the method comprising:

controlling the supply of a weight value from said weight-value-supply control unit;

processing analog output data output from the data output terminal for every analog multiply-accumulate operation performed by said neuron core as serial data and/or parallel data;

receiving and holding, at the at least one second register of the data-hold-supply control unit, the analog output data output from the data output terminal; and

supplying the analog output data held by the at least one second register of the data-hold-supply control unit to the data input terminal of the neuron core having the data output terminal for use in the subsequent analog multiply-accumulate operation by the neuron core,

wherein the method further comprises controlling timing of holding data at the second register of the data-hold-supply control unit and timing of opening and closing at the path, and controlling the selecting operation of the second selector with respect to the input data from the prior stage and the hold data in the second registers.

7. The method of control of a neural network according to claim 6 , further comprising referring to data and a weight value set at said weight-value-supply control unit and data set at said data-hold-supply control unit.

8. The method of control of a neural network according to claim 6 , further comprising comparing data set at said data-hold-supply control unit with analog output data from the data output terminal and controlling the state of the neural network based on the comparison results.

9. A processor of a neural network,

the neural network comprising:

at least one neuron core having a data input terminal for receiving analog input data, a data output terminal for outputting analog output data, and a weight value input terminal, the neuron core being configured to perform an analog multiply-accumulate operation based on the analog input data arriving from the data input terminal and a weight value arriving from the weight value input terminal, the weight value being analog data;

a weight-value-supply control unit connected to the weight value input terminal and supplying the weight value from the weight value input terminal to said neuron core; and

a data-hold-supply control unit connected to the data input terminal and the data output terminal, and provided with at least one second register and a second selector, the second register being configured to hold at least the analog output data operated by the neuron core and output from the data output terminal such that the hold data is suppliable to output to the second selector, and the second selector being capable of selecting any one of the at least one second register or an input data arriving from a prior stage, and wherein the second selector causes opening and closing a path for transmitting the held data in the second register to the data input termina,

wherein, the processor is configured to:

control the supply of the weight value from said weight-value-supply control unit;

process the analog output data output from the data output terminal at every analog multiply-accumulate operation performed by said neuron core as serial data and/or parallel data;

receive and hold, at the at least one second register of the data-hold-supply control unit, the analog output data output from the data output terminal; and

supply the analog output data held by the at least one second register of the data-hold-supply control unit to the data input terminal of the neuron core having the data output terminal for use in the subsequent analog multiply-accumulate operation by the neuron core,

wherein the processor is further configured to control timing of holding data at the second register of said data-hold-supply control unit and timing of opening and closing at the path, and controlling the selecting operation of the second selector with respect to the input data from the prior stage and the hold data in the second registers.

10. The processor of a neural network according to claim 9 , wherein said weight-value-supply control unit comprises

a plurality of first registers respectively holding weight values and

a first selector for selecting any one of the plurality of registers and opening and closing a path for transmitting the held weight value to the weight value input terminal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 30, 2020
From: MARUKAME, TAKAO; ISHIKAWA, KAZUO; SUGINO, JUNICHI; KITAMURA, TOSHIMITSU; TAMURA, YUTAKA; TAKAHASHI, KOJI
To: KABUSHIKI KAISHA TOSHIBA; TOSHIBA INFORMATION SYSTEMS (JAPAN) CORPORATION
Reel/Frame 053348/0705 →
Priority Claims (1)
JP 2019-103803 · Jun 3, 2019 · national
Continuity (1)
Related Publication 20200380347A1 · Dec 3, 2020