TRANSPOSING NEURAL NETWORK MATRICES IN HARDWARE
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium. In one aspect, a method includes the actions of receiving a request to perform computations for a neural network on a hardware circuit having a matrix computation unit, the request specifying a transpose operation to be performed on a first neural network matrix; and generating instructions that when executed by the hardware circuit cause the hardware circuit to transpose the first neural network matrix by performing first operations, wherein the first operations include repeatedly performing the following second operations: for a current subdivision of the first neural network matrix that divides the first neural network matrix into one or more current submatrices, updating the first neural network matrix by swapping an upper right quadrant and a lower left quadrant of each current submatrix, and subdividing each current submatrix into respective new submatrices to update the current subdivision.
1 . A method comprising:
receiving a request to perform computations for a neural network on a hardware circuit having a matrix computation unit, the request specifying a transpose operation to be performed on a first neural network matrix associated with the neural network; and
generating instructions that when executed by the hardware circuit cause the hardware circuit to transpose the first neural network matrix by performing first operations, wherein the first operations comprise repeatedly performing the following second operations:
for a current subdivision of the first neural network matrix that divides the first neural network matrix into one or more current submatrices:
updating the first neural network matrix by swapping an upper right quadrant and a lower left quadrant of each current submatrix in the current subdivision using the matrix computation unit, and
subdividing each current submatrix in the current subdivision into a respective plurality of new submatrices to update the current subdivision, each of the respective plurality of new submatrices being a respective quadrant of the current submatrix.