Counter based resistive processing unit for programmable and reconfigurable artificial-neural-networks
Technical solutions are described for storing weight in a crosspoint device of a resistive processing unit (RPU) array. An example system includes a crosspoint array, wherein each array node represents a connection between neurons of the neural network, and wherein each node stores a weight assigned to the node. The crosspoint array includes a crosspoint device at each node. The crosspoint device includes a counter that has multiple single bit counters, and states of the counters represent the weight to be stored at the crosspoint device. Further, the crosspoint device includes a resistor device that has multiple resistive circuits, and each resistive circuit is associated with a respective counter from the counters. The resistive circuits are activated or deactivated according to a state of the associated counter, and an electrical conductance of the resistor device is adjusted based at least in part on the resistive circuits that are activated.
1. A method for implementing a neural network, the method comprising:
selecting, by a global controller, a matrix to be loaded in a crosspoint array, the matrix corresponding to a connection between two layers of the neural network;
in response, loading, by a local controller at a crosspoint in the crosspoint array, a weight value in a crosspoint device associated with the crosspoint, the weight value assigned to the crosspoint for the selected matrix; and
in response, adjusting, by the crosspoint device, a conductance of a resistor device associated with the crosspoint, the conductance corresponding to the weight value loaded into the crosspoint device;
wherein the crosspoint device comprises:
a counter comprising a plurality of single bit counters, states of the single bit counters representing the weight to be stored at the crosspoint device; and
a resistor device comprising a plurality of resistive circuits, each resistive circuit associated with a respective single bit counter from the plurality of single bit counters, the resistive circuits activated or deactivated according to a state of the associated single bit counter.
2. The method of claim 1 , wherein an electrical conductance of the resistor device is adjusted based at least in part on the resistive circuits that are activated.
3. The method of claim 1 , wherein the global controller is configured to adjust values stored at each crosspoint device in the crosspoint array.
4. The method of claim 1 , wherein the method further comprises reading, from a local memory, a current state of each single bit counter of a plurality of single bit counters in the crosspoint device.
5. The method of claim 4 , wherein the method further comprises updating the local memory to indicate an updated state of each single bit counter of the plurality of single bit counters.
6. The method of claim 1 , wherein the plurality of resistive circuits in the resistor device of the crosspoint device include a quadratically increasing resistance, a first resistive circuit having a predetermined resistance and each further successive resistive circuit having a resistance that is twice of a previous resistive circuit.
7. The method of claim 1 , wherein the plurality of resistive circuits are field effect transistors (FETs).
8. The method of claim 1 , wherein the plurality of resistive circuits are a resistor ladder, each of the resistive circuit comprising:
a logic gate; and
a series of resistors; and
wherein, the logic gate is activated based at least in part on the state of the corresponding single bit counter.