MAC processing pipelines, circuitry to configure same, and methods of operating same
An integrated circuit comprising a plurality MAC processors, interconnected into a linear pipeline, configurable to process input data, wherein each MAC processor includes (A) a multiplier and (B) an accumulator circuit, and (C) a plurality of rotate input data paths, wherein each rotate input data path couples two sequential MAC processors of the linear pipeline including an input of the multiplier circuit of a first MAC processor of sequential MAC processors to an input of the multiplier circuit of the immediately following MAC processor of the associated sequential MAC processors of the pipeline—wherein each rotate input data path is configurable to provide rotate input data from a first MAC processor of sequential MAC processors of the linear pipeline to the immediately following MAC processor of the associated sequential MAC processors thereby forming a serial circular path via the plurality of rotate input data paths.
1 . An integrated circuit comprising:
a plurality MAC processors, interconnected into a linear pipeline, configurable to process input data during a plurality of execution cycles of an execution sequence, wherein each MAC processor of the plurality of the MAC processors includes:
a multiplier circuit to (i) receive first input data at a first input and (ii) receive multiplier weight data at a second input, (iii) multiply first input data by multiplier weight data to generate product data, and (iv) output the product data,
an accumulator circuit, coupled to the multiplier circuit of the associated MAC processor, to (i) receive accumulation data at a first input, (ii) receive the product data output by the associated multiplier circuit, (iii) add the accumulation data and the product data output by the associated multiplier circuit to generate second accumulation data, and (iv) output the second accumulation data via an output of the accumulation circuit, and
an accumulation data path to couple the output of the accumulation circuit of the associated MAC processor to the first input thereof;
a plurality of rotate input data paths, wherein each rotate input data path couples two sequential MAC processors of the linear pipeline including the first input of the multiplier circuit of a first MAC processor of sequential MAC processors to the first input of the multiplier circuit of the immediately following MAC processor of the associated sequential MAC processors of the linear pipeline; and
wherein each rotate input data path is configurable to provide rotate input data from a first MAC processor of sequential MAC processors of the linear pipeline to the immediately following MAC processor of the associated sequential MAC processors thereby forming a serial circular path, including the plurality of MAC processors of the linear pipeline, via the plurality of rotate input data paths.
2 . The integrated circuit of claim 1 wherein:
each MAC processor of the plurality of the MAC processors further includes an accumulation register disposed in the accumulation data path of the associated MAC processor between the output of the accumulation circuit of the associated MAC processor and the first input thereof.
3 . The integrated circuit of claim 2 wherein:
accumulation register, in operation, stores the second accumulation data output from the accumulation circuit of the associated MAC processor on a first execution cycle and the accumulator circuit inputs second accumulation data at the first input as accumulation data on an execution cycle that follows the first execution cycle.
4 . The integrated circuit of claim 2 wherein:
after a multiply-accumulate operation of the linear pipeline, the accumulation register of each MAC processor stores a different second accumulation data output from the accumulation circuit of the associated MAC processor.
5 . The integrated circuit of claim 1 wherein:
each MAC processor of the plurality of the MAC processors further includes an input data register connected to an output of the rotate input data path to store rotate input data provided from the immediately preceding MAC processor of the plurality of the MAC processors of the linear pipeline, via the associated rotate input data path, thereby forming a circular serial shift path between the plurality of MAC processors of the linear pipeline.
6 . The integrated circuit of claim 1 wherein:
each MAC processor of the plurality of the MAC processors further includes an input data register disposed between the first input of the multiplier circuit of the first MAC processor and the first input of the multiplier circuit of the second MAC processor of each associated pair of MAC processors to store rotate input data provided from the immediately preceding MAC processor, via the associated rotate input data path, after a multiply-accumulate operation of the plurality of the MAC processors of the linear pipeline.
7 . The integrated circuit of claim 1 wherein:
each MAC processor of the plurality of the MAC processors further includes a data input register, connected to an output of the associated rotate input data path, to store rotate input data.
8 . The integrated circuit of claim 1 wherein:
each MAC processor of the plurality of the MAC processors further includes a memory dedicated to the associated MAC processor, wherein the memory is configurable to store filter weight data corresponding to the associated MAC processor.
9 . The integrated circuit of claim 8 wherein:
the memory includes a plurality of memory banks, each bank is configurable to store filter weight data for each execution cycle of the execution sequence.
10 . An integrated circuit comprising:
a plurality MAC processors, interconnected into a linear pipeline, configurable to process input data during a plurality of execution cycles of an execution sequence, wherein each MAC processor of the plurality of the MAC processors includes:
a multiplier circuit to (i) receive first input data at a first input and (ii) receive multiplier weight data at a second input, (iii) multiply first input data by multiplier weight data to generate product data, and (iv) output the product data,
an accumulator circuit, coupled to the multiplier circuit of the associated MAC processor, to (i) receive accumulation data at a first input, (ii) receive the product data output by the associated multiplier circuit, (iii) add the accumulation data and the product data output by the associated multiplier circuit to generate second accumulation data, and (iv) output the second accumulation data via an output of the accumulation circuit, and
an accumulation data path to couple the output of the accumulation circuit of the associated MAC processor to the first input thereof;
a plurality of rotate input data paths, wherein each rotate input data path couples two sequential MAC processors of the linear pipeline including the first input of the multiplier circuit of a first MAC processor of sequential MAC processors to the first input of the multiplier circuit of the immediately following MAC processor of the associated sequential MAC processors of the linear pipeline;
a plurality of rotate accumulation data paths, wherein each rotate accumulation data path couples two sequential MAC processors of the linear pipeline including the output of the accumulator circuit of a first MAC processor of sequential MAC processors to the first input of the accumulator circuit of the immediately following MAC processor of the associated sequential MAC processors of the linear pipeline;
wherein each rotate input data path is configurable to provide rotate input data from a first MAC processor of sequential MAC processors to the immediately following MAC processor of the associated sequential MAC processors thereby forming a first configurable serial circular path, including the plurality of MAC processors of the linear pipeline, via the plurality of rotate input data paths; and
wherein each rotate accumulation data path is configurable to provide rotate accumulation data from the first MAC processor of sequential MAC processors to the immediately following MAC processor of the associated sequential MAC processors thereby forming a second configurable serial circular path, including the plurality of MAC processors of the linear pipeline, via the plurality of rotate accumulation data paths.
11 . The integrated circuit of claim 10 wherein:
each MAC processor includes circuitry to responsively connect (1) the rotate input data path between each of the sequential MAC processors of the linear pipeline or (2) the rotate accumulation data path between each of the sequential MAC processors of the linear pipeline.
12 . The integrated circuit of claim 10 wherein:
each MAC processor of the plurality of the MAC processors further includes a multiplexer having (i) a first input connected to an output of the rotate input data path from the immediately preceding MAC processor, (ii) a second input connected to a shift in data path of the linear pipeline, and (iii) and output coupled to the first input of the multiplier circuit of the associated MAC processor.
13 . The integrated circuit of claim 10 wherein:
each MAC processor of the plurality of the MAC processors further includes a multiplexer having (i) a first input connected to an output of the rotate accumulation data path from the immediately preceding MAC processor, (ii) a second input connected to the output of the accumulator circuit of the associated MAC processor, and (iii) and output coupled to the first input of the accumulator circuit of the associated MAC processor.
14 . The integrated circuit of claim 10 wherein:
each MAC processor of the plurality of the MAC processors further includes:
a first multiplexer having (i) a first input connected to an output of the rotate input data path from the immediately preceding MAC processor, (ii) a second input connected to a shift in data path of the linear pipeline, and (iii) and output coupled to the first input of the multiplier circuit of the associated MAC processor; and
a second multiplexer having (i) a first input connected to an output of the rotate accumulation data path from the immediately preceding MAC processor, (ii) a second input connected to the output of the accumulator circuit of the associated MAC processor, and (iii) and output coupled to the first input of the accumulator circuit of the associated MAC processor.
15 . The integrated circuit of claim 10 wherein:
each MAC processor of the plurality of the MAC processors further includes an accumulation register disposed in the accumulation data path of the associated MAC processor between the output of the accumulation circuit of the associated MAC processor and the first input thereof.
16 . The integrated circuit of claim 15 wherein:
accumulation register, in operation, stores the second accumulation data output from the accumulation circuit of the associated MAC processor on a first execution cycle and the accumulator circuit inputs second accumulation data at the first input as accumulation data on an execution cycle that follows the first execution cycle.
17 . The integrated circuit of claim 15 wherein:
after a multiply-accumulate operation, the accumulation register of each MAC processor stores a different second accumulation data output from the accumulation circuit of the associated MAC processor.
18 . The integrated circuit of claim 10 wherein:
each MAC processor of the plurality of the MAC processors further includes an input data register connected to an output of the rotate input data path to store rotate input data provided from the immediately preceding MAC processor of the plurality of the MAC processors of the linear pipeline, via the associated rotate input data path, thereby forming a circular serial shift path between the plurality of MAC processors of the linear pipeline.
19 . The integrated circuit of claim 10 wherein:
each MAC processor of the plurality of the MAC processors further includes an input data register disposed between the first input of the multiplier circuit of the first MAC processor and the first input of the multiplier circuit of the second MAC processor of each associated pair of MAC processors to store rotate input data provided to the first MAC processor after a multiply-accumulate operation of the plurality of the MAC processors of the linear pipeline.
20 . The integrated circuit of claim 10 wherein:
each MAC processor of the plurality of the MAC processors further includes an input data register to store rotate input data after a multiply-accumulate operation of the plurality of the MAC processors of the linear pipeline.