SYSTEM AND METHOD FOR ENERGY-EFFICIENT IMPLEMENTATION OF NEURAL NETWORKS
A system and method for enhancing C*RAM, improving its performance for known applications such as video processing but also making it well suited to low-power implementation of neural nets. The required computing engine is decomposed into banks of enhanced C*RAM each having a SIMD controller, thus allowing operations at several scales simultaneously. Several configurations of suitable controllers are discussed, along with communication structures and enhanced processing elements.
1 . A SIMD controller device having instruction memory configured to be loaded from memory of one or more banks, each bank including memory and a plurality of processing elements for performing parallel operations using the memory.
2 . The device of claim 1 , further comprising a decompressor operable to stream variable-length data from the instruction memory and produce fixed-length representations of coefficients.
3 . The device of claim 1 , further comprising a decompressor operable to stream variable-length data from the instruction memory and produce instruction sequences.
4 . A plurality of SIMD controller devices, each SIMD controller device including instruction memory configured to be loaded from memory of one or more banks, each bank including memory and a plurality of processing elements for performing parallel operations using the memory, wherein at least one of the SIMD controller device includes a decompressor operable to stream variable-length data from instruction memory and produce decompressed information that includes one or both of fixed-length representations of coefficients and instruction sequences, the plurality of SIMD controller devices interconnected by a column bus to share the decompressed information.