System and method for energy-efficient implementation of neural networks
A system and method for enhancing C*RAM, improving its performance for known applications such as video processing but also making it well suited to low-power implementation of neural nets. The required computing engine is decomposed into banks of enhanced C*RAM each having a SIMD controller, thus allowing operations at several scales simultaneously. Several configurations of suitable controllers are discussed, along with communication structures and enhanced processing elements.
1. A single instruction, multiple data (SIMD) device comprising:
a plurality of banks, each bank including:
a controller including instruction memory; and
a plurality of processing elements with memory;
wherein the controller is connected to the plurality of processing elements with memory, the controller being operable to control the plurality of processing elements with memory to perform parallel operations, the instruction memory of the controller configured to be loaded from the memory of the plurality of processing elements.
2. The device of claim 1 , further comprising a decompressor operable to stream variable-length data from the instruction memory and produce fixed-length representations of coefficients.
3. The device of claim 1 , further comprising a decompressor operable to stream variable-length data from the instruction memory and produce instruction sequences.
4. A device comprising:
a plurality of banks, each bank including:
memory and a plurality of processing elements for performing parallel operations using the memory;
a single instruction, multiple data (SIMD) controller device, the SIMD controller device including instruction memory configured to be loaded from the memory of the plurality of processing elements;
wherein at least one of the SIMD controller devices includes a decompressor operable to stream variable-length data from instruction memory and produce decompressed information that includes one or both of fixed-length representations of coefficients and instruction sequences, the SIMD controller devices interconnected by a column bus to share the decompressed information.