Computational memory with cooperation among rows of processing elements and memory thereof
A computing device includes an array of processing elements mutually connected to perform single instruction multiple data (SIMD) operations, memory cells connected to each processing element to store data related to the SIMD operations, and a cache connected to each processing element to cache data related to the SIMD operations. Caches of adjacent processing elements are connected. The same or another computing device includes rows of mutually connected processing elements to share data. The computing device further includes a row arithmetic logic unit (ALU) at each row of processing elements. The row ALU of a respective row is configured to perform an operation with processing elements of the respective row.
1. A computing device comprising:
a plurality of rows of processing elements to perform single instruction multiple data (SIMD) operations, wherein the processing elements of each row are mutually connected to share data; and
a row arithmetic logic unit (ALU) at each row of the plurality of rows of processing elements, the row ALU of a respective row being configured to perform an operation with processing elements of the respective row, wherein the row ALU is connected to one or more end-most processing elements of the respective row; and
a controller connected to each of the row ALUs, the controller configured for SIMD control the row ALUs.
2. The computing device of claim 1 , wherein the row ALU is connected to two end-most processing elements of the respective row.
3. The computing device of claim 1 , wherein the row ALU is configured to perform addition with data contained in the processing elements of the respective row.
4. The computing device of claim 1 , wherein the row ALU is configured to perform argmax with data contained in the processing elements of the respective row.
5. The computing device of claim 1 , further comprising registers connected to the row ALU to store a result of the operation.
6. The computing device of claim 1 , further comprising a bank ALU connected to the row ALU of each row of processing elements, the bank ALU being configured to perform an additional operation with results obtained by row ALUs of the plurality of rows of processing elements.
7. The computing device of claim 6 , wherein the bank ALU is configured to perform addition with results obtained by the row ALUs.
8. The computing device of claim 6 , wherein the bank ALU is configured to perform argmax with results obtained by the row ALUs.
9. The computing device of claim 6 , further comprising registers connected to the bank ALU to store a result of the additional operation.