IP Library › Granted Patent US 12,321,714
Granted Patent B2
US 12,321,714 · App. 17/358,722 · Granted Jun 3, 2025

Compressed wallace trees in FMA circuits

Inventors: Aditya Varma (Noida, IN); Mahesh Kumashikar (Bangalore, IN); Michael Espig (Newberg, OR)
Assignee: Intel Corporation
G06F7/5318G06F7/502G06F7/5312G06F17/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,321,714
App. No.
17/358,722
Granted
Jun 3, 2025
Kind
B2
Abstract

An embodiment of an apparatus comprises one or more fractional width fused multiply-accumulate (FMA) circuits configured as a shared Wallace tree, and circuitry coupled to the one or more fractional width FMA circuits to provide one or more fractional width FMA operations through the one or more fractional width FMA circuits. Other embodiments are disclosed and claimed.

Claims (59)

1. An apparatus, comprising:

two or more fractional width fused multiply-accumulate (FMA) circuits configured as a shared Wallace tree comprising:

multiple 3:2 carry-save adder (CSA) circuits comprising a first 3:2 CSA circuit, a second 3:2 CSA circuit, and a third 3:2 CSA circuit;

a first 4:2 CSA circuit coupled to receive respective signals from the first 3:2 CSA circuit and the second 3:2 CSA circuit;

a second 4:2 CSA circuit coupled to receive respective signals from the first 4:2 CSA circuit and the third 3:2 CSA circuit; and

a multiplexer circuit coupled to selectively enable or prevent a communication of a carry signal between two of the multiple 3:2 CSA circuits; and

circuitry coupled to the two or more fractional width FMA circuits to provide one or more fractional width FMA operations through the two or more fractional width FMA circuits.

2. The apparatus of claim 1 , wherein the two or more fractional width FMA circuits support per-cycle operations of any of multiple different datatype widths.

3. The apparatus of claim 2 , wherein the two or more fractional width FMA circuits comprises:

a first set of cascaded carry-save adders (CSAs) that provide a first half-width FMA circuit; and

a second set of cascaded CSAs that provide a second half-width FMA circuit.

4. The apparatus of claim 3 , wherein the circuitry is further to:

provide two half-width FMA operations per cycle.

5. The apparatus of claim 3 , wherein the circuitry is further to:

provide half of a full width FMA operation per cycle.

6. The apparatus of claim 5 , wherein the circuitry is further to:

provide two passes through the first and second half-width FMA circuits to perform the full width FMA operation.

7. The apparatus of claim 5 , further comprising a second pair of half-width FMA circuits coupled sequentially to the first and second half-width FMA circuits, wherein the circuitry is further to:

provide the full width FMA operation per cycle in a pipelined manner through the first and second half-width FMA circuits followed by the second pair of half-width FMA circuits.

8. A method, comprising:

providing two or more fractional width fused multiply-accumulate (FMA) circuits configured as a shared Wallace tree comprising:

multiple 3:2 carry-save adder (CSA) circuits comprising a first 3:2 CSA circuit, a second 3:2 CSA circuit, and a third 3:2 CSA circuit;

a first 4:2 CSA circuit coupled to receive respective signals from the first 3:2 CSA circuit and the second 3:2 CSA circuit;

a second 4:2 CSA circuit coupled to receive respective signals from the first 4:2 CSA circuit and the third 3:2 CSA circuit; and

a multiplexer circuit coupled to selectively enable or prevent a communication of a carry signal between two of the multiple 3:2 CSA circuits; and

providing one or more fractional width FMA operations through the two or more fractional width FMA circuits.

9. The method of claim 8 , wherein the two or more fractional width FMA circuits support per-cycle operations of any of multiple different datatype widths.

10. The method of claim 8 , further comprising:

providing two half-width FMA operations per cycle.

11. The method of claim 8 , further comprising:

providing half of a full width FMA operation per cycle.

12. The method of claim 11 , further comprising:

providing two passes through a first pair of half-width FMA circuits to perform a full width FMA operation.

13. The method of claim 11 , further comprising:

providing a second pair of half-width FMA circuits coupled sequentially to the first pair of half-width FMA circuits; and

providing the full width FMA operation per cycle in a pipelined manner through the first pair of half-width FMA circuits followed by the second pair of half-width FMA circuits.

14. The method of claim 8 , further comprising:

utilizing a systolic array of the one or more fractional width FMA circuits to support an associated matrix to matrix multiplication.

15. An apparatus, comprising:

a processor core;

a memory; and

a fused multiply-accumulate (FMA) unit coupled to the processor core and the memory, wherein the FMA unit comprises two or more fractional width FMA circuits configured as a shared Wallace tree comprising:

multiple 3:2 carry-save adder (CSA) circuits comprising a first 3:2 CSA circuit, a second 3:2 CSA circuit, and a third 3:2 CSA circuit;

a first 4:2 CSA circuit coupled to receive respective signals from the first 3:2 CSA circuit and the second 3:2 CSA circuit;

a second 4:2 CSA circuit coupled to receive respective signals from the first 4:2 CSA circuit and the third 3:2 CSA circuit; and

a multiplexer circuit coupled to selectively enable or prevent a communication of a carry signal between two of the multiple 3:2 CSA circuits;

wherein the FMA unit is to provide one or more fractional width FMA operations through the two or more fractional width FMA circuits.

16. The apparatus of claim 15 , wherein the two or more fractional width FMA circuits support per-cycle operations of any of multiple different datatype widths.

17. The apparatus of claim 16 , wherein the two or more fractional width FMA circuits comprises:

a first set of cascaded carry-save adders (CSAs) that provide a first half-width FMA circuit; and

a second set of cascaded CSAs that provide a second half-width FMA circuit.

18. The apparatus of claim 17 , wherein the FMA unit is further to:

provide two half-width FMA operations per cycle.

19. The apparatus of claim 17 , wherein the FMA unit is further to:

provide half of a full width FMA operation per cycle.

20. The apparatus of claim 19 , wherein the FMA unit is further to:

provide two passes through the first and second half-width FMA circuits to perform the full width FMA operation.

21. The apparatus of claim 19 , wherein the FMA unit further comprises a second pair of half-width FMA circuits coupled sequentially to the first and second half-width FMA circuits, and wherein the FMA unit is further to:

provide the full width FMA operation per cycle in a pipelined manner through the first and second half-width FMA circuits followed by the second pair of half-width FMA circuits.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2021
From: VARMA, ADITYA; KUMASHIKAR, MAHESH; ESPIG, MICHAEL
To: INTEL CORPORATION
Reel/Frame 056673/0950 →
Priority Claims (1)
IN 202141021768 · May 14, 2021 · national
Continuity (1)
Related Publication 20220365751A1 · Nov 17, 2022
References Cited (7)
US 7433912B1 · Jagodik · 2008 [cited by examiner]
US 9848188B1 · Cismas · 2017 [cited by examiner]
US 10037189B2 · Langhammer · 2018 [cited by examiner]
US 20090287757A1 · Rarick · 2009 [cited by examiner]
US 20120151191A1 · Boswell · 2012 [cited by examiner]
US 20140188968A1 · Kaul · 2014 [cited by examiner]
US 20210011686A1 · Makino · 2021 [cited by examiner]