Computational memory with cooperation among rows of processing elements and memory thereof
A computing device includes an array of processing elements mutually connected to perform single instruction multiple data (SIMD) operations, memory cells connected to each processing element to store data related to the SIMD operations, and a cache connected to each processing element to cache data related to the SIMD operations. Caches of adjacent processing elements are connected. The same or another computing device includes rows of mutually connected processing elements to share data. The computing device further includes a row arithmetic logic unit (ALU) at each row of processing elements. The row ALU of a respective row is configured to perform an operation with processing elements of the respective row.
1. A computing device comprising:
an array of processing elements mutually connected to perform single instruction multiple data (SIMD) operations;
memory cells connected to each processing element to store data related to the SIMD operations; and
a plurality of caches connected to each processing element to cache data related to the SIMD operations, wherein each cache is associated with a different block of the memory cells, wherein a first cache of a first processing element is connected to a second cache of a second processing element that is adjacent the first processing element in the array of processing elements.
2. The computing device of claim 1 , wherein the first cache of the first processing element is connected to a third cache of a third processing element that is adjacent the first processing element in the array of processing elements, wherein the first processing element is positioned between the second and third processing elements in the array of processing elements.
3. The computing device of claim 1 , further comprising a write multiplexer including an output connected to the first cache, wherein selectable inputs of the write multiplexer are connected to a register of the first processing element and to the second cache.
4. The computing device of claim 3 , wherein:
the array of processing elements is configured to perform a multiplying accumulation; and
the computing device further comprises a controller to control the write multiplexer to write to the first cache accumulated results and/or input values of the multiplying accumulation.
5. The computing device of claim 1 , further comprising a read multiplexer including an output connected to a register of the first processing element, wherein selectable inputs of the read multiplexer are connected to the first cache and to the second cache.
6. The computing device of claim 5 , wherein:
the array of processing elements is configured to perform a multiplying accumulation; and
the computing device further comprises a controller to control the read multiplexer to read from the first cache coefficients and/or input values of the multiplying accumulation.
7. A computing device comprising:
an array of processing elements mutually connected to perform single instruction multiple data (SIMD) operations;
memory cells connected to each processing element to store data related to the SIMD operations;
a cache connected to each processing element to cache data related to the SIMD operations, wherein a first cache of a first processing element is connected to a second cache of a second processing element that is adjacent the first processing element in the array of processing elements; and
a write multiplexer including an output connected to the first cache, wherein selectable inputs of the write multiplexer are connected to a register of the first processing element and to the second cache.
8. The computing device of claim 7 , wherein the first cache of the first processing element is connected to a third cache of a third processing element that is adjacent the first processing element in the array of processing elements, wherein the first processing element is positioned between the second and third processing elements in the array of processing elements.
9. The computing device of claim 7 , wherein:
the array of processing elements is configured to perform a multiplying accumulation; and
the computing device further comprises a controller to control the write multiplexer to write to the first cache accumulated results and/or input values of the multiplying accumulation.
10. The computing device of claim 7 , further comprising a read multiplexer including an output connected to a register of the first processing element, wherein selectable inputs of the read multiplexer are connected to the first cache and to the second cache.
11. The computing device of claim 10 , wherein:
the array of processing elements is configured to perform a multiplying accumulation; and
the computing device further comprises a controller to control the read multiplexer to read from the first cache coefficients and/or input values of the multiplying accumulation.
12. A computing device comprising:
an array of processing elements mutually connected to perform single instruction multiple data (SIMD) operations;
memory cells connected to each processing element to store data related to the SIMD operations;
a cache connected to each processing element to cache data related to the SIMD operations, wherein a first cache of a first processing element is connected to a second cache of a second processing element that is adjacent the first processing element in the array of processing elements; and
a read multiplexer including an output connected to a register of the first processing element, wherein selectable inputs of the read multiplexer are connected to the first cache and to the second cache.
13. The computing device of claim 12 , wherein the first cache of the first processing element is connected to a third cache of a third processing element that is adjacent the first processing element in the array of processing elements, wherein the first processing element is positioned between the second and third processing elements in the array of processing elements.
14. The computing device of claim 12 , wherein:
the array of processing elements is configured to perform a multiplying accumulation; and
the computing device further comprises a controller to control the read multiplexer to read from the first cache coefficients and/or input values of the multiplying accumulation.