IP Library Granted Patent US 12,650,811
Granted Patent B2
US 12,650,811 · App. 17/474,843 · Granted Jun 9, 2026

Mixed signal circuitry for bitwise multiplication with different accuracies

Inventors: Ankur Agrawal (Chappaqua, NY); Mingu Kang (Old Tappan, NJ); Kyu-Hyoun Kim (Chappaqua, NY); Monodeep Kar (New York, NY)
Assignee: International Business Machines Corporation
G06F7/5443G06F7/50G06F7/523H03M1/38
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,650,811
App. No.
17/474,843
Granted
Jun 9, 2026
Kind
B2
Abstract

An apparatus comprises at least one processor and at least one memory including instruction code configured to, with the at least one processor, cause the apparatus at least to perform, with a first accuracy, a first portion of a bitwise multiplication of first and second digital inputs and to perform, with a second accuracy different than the first accuracy, at least a second portion of the bitwise multiplication.

Claims (36)

1 . An apparatus comprising:

multiply-accumulate circuitry, the multiply-accumulate circuitry comprising a set of two or more instances of bitwise dot-product summation circuitry, a first subset of the set of two or more instances of the bitwise dot-product summation circuitry utilizing first analog hardware and a second subset of the set of two or more instances of the bitwise dot-product summation circuitry utilizing second analog hardware, the second analog hardware being different than the first analog hardware;

at least one processor; and

at least one memory including instruction code;

the at least one memory and the instruction code being configured to, with the at least one processor, cause the apparatus at least to:

perform, with a first accuracy, a first portion of a bitwise multiplication of first and second digital inputs using the first analog hardware; and

perform, with a second accuracy different than the first accuracy, at least a second portion of the bitwise multiplication of the first and second digital inputs using the second analog hardware;

wherein the first analog hardware comprises two or more pop-counter circuit instances each configured to sum a first number of inputs utilizing a bit-design of a first number of bits; and

wherein the second analog hardware comprises a single pop-counter circuit instance coupled to an additional capacitor bank configured to sum a second number of inputs utilizing the bit-design of the first number of bits, the second number of inputs being greater than the first number of inputs.

2 . The apparatus of claim 1 , wherein the bitwise multiplication of the first and second digital inputs comprises computation of a set of weighted sums of bitwise dot products of the first and second digital inputs, wherein the first portion of the bitwise multiplication of the first and second digital inputs comprises a first subset of the set of weighted sums of the bitwise dot products of the first and second digital inputs, and wherein the second portion of the bitwise multiplication of the first and second digital inputs comprises a second subset of the set of weighted sums of the bitwise dot products of the first and second digital inputs.

3 . The apparatus of claim 2 , wherein the set of weighted sums of the bitwise dot products of the first and second digital inputs comprises n weighted sums of the bitwise dot products of the first and second digital inputs, wherein the first portion of the bitwise multiplication performed with the first accuracy comprises computation of the k highest weighted sums of the bitwise dot products of the first and second digital inputs, and wherein the second portion of the bitwise multiplication performed with the second accuracy comprises computation of at least a portion of a remaining n−k weighted sums of the bitwise dot products of the first and second digital inputs.

4 . The apparatus of claim 3 , wherein a value of k is selected based at least in part on determining additive noise contributions of different terms of the bitwise multiplication of the first and second digital inputs.

5 . The apparatus of claim 1 , wherein each of the two or more pop-counter circuit instances of the first analog hardware has a first resolution and the single pop-counter circuit instance of the second analog hardware has a second resolution different than the first resolution.

6 . The apparatus of claim 1 , wherein each of the two or more pop-counter circuit instances of the first analog hardware comprises a successive approximation register analog-to-digital converter comprising a first type of comparator, wherein the single pop-counter circuit instance of the second analog hardware comprises a successive approximation register analog-to-digital converter comprising a second type of comparator, wherein the first type of comparator is different than the second type of comparator.

7 . The apparatus of claim 6 , wherein at least one of:

the first type of comparator has a first noise profile and the second type of comparator has a second noise profile different than the first noise profile; and

the first type of comparator has a first offset cancellation accuracy and the second type of comparator has a second offset cancellation accuracy different than the first offset cancellation accuracy.

8 . The apparatus of claim 1 , wherein each of the two or more pop-counter circuit instances of the first analog hardware comprises a successive approximation register analog-to-digital converter comprising a first plurality of capacitors having respective first sizes, and wherein the single pop-counter circuit instance of the second analog hardware comprises a successive approximation register analog-to-digital converter comprises a second plurality of capacitors having respective second sizes different than the first sizes.

9 . The apparatus of claim 1 , wherein the first analog hardware comprises a first number of charge-sharing capacitors and the second analog hardware comprises a second number of charge-sharing capacitors, the second number of charge-sharing capacitors being different than the first number of charge-sharing capacitors.

10 . The apparatus of claim 1 , wherein the first analog hardware comprises a first set of charge-sharing capacitors with a first size and the second analog hardware comprises a second set of charge-sharing capacitors with a second size, the second size being different than the first size.

11 . The apparatus of claim 1 , wherein the first analog hardware comprises a first comparator with a first noise profile and the second analog hardware comprises a second comparator with a second noise profile, the second noise profile being different than the first noise profile.

12 . The apparatus of claim 1 , wherein the first analog hardware comprises a first comparator with a first offset cancellation and the second analog hardware comprises a second comparator with a second offset cancellation, the second offset cancellation being different than the first offset cancellation.

13 . The apparatus of claim 1 wherein the single pop-counter circuit instance of the second analog hardware is coupled to the additional capacitor bank via a switch, the switch being closed in a first mode of operation for a summation operating phase and being open in a second mode of operation for a successive approximation register phase.

14 . A method, comprising the steps of:

performing, with a first accuracy, a first portion of a bitwise multiplication of first and second digital inputs using a first subset of a set of two or more instances of bitwise dot-product summation circuitry, the first subset of the set of two or more instance of the bitwise dot-product summation circuitry utilizing first analog hardware; and

performing, with a second accuracy different than the first accuracy, at least a second portion of the bitwise multiplication of the first and second digital inputs using a second subset of the set of two or more instances of the bitwise dot-product summation circuitry, the second subset of the set of two or more instances of the bitwise dot-product summation circuitry utilizing second analog hardware, the second analog hardware being different than the first analog hardware;

wherein the method is executed by processing circuitry configured to execute instruction code;

wherein the first analog hardware comprises two or more pop-counter circuit instances each configured to sum a first number of inputs utilizing a bit-design of a first number of bits; and

wherein the second analog hardware comprises a single pop-counter circuit instance coupled to an additional capacitor bank configured to sum a second number of inputs utilizing the bit-design of the first number of bits, the second number of inputs being greater than the first number of inputs.

15 . The method of claim 14 , wherein the bitwise multiplication of the first and second digital inputs comprises computation of a set of weighted sums of bitwise dot products of the first and second digital inputs, wherein the first portion of the bitwise multiplication of the first and second digital inputs comprises a first subset of the set of weighted sums of the bitwise dot products of the first and second digital inputs, and wherein the second portion of the bitwise multiplication of the first and second digital inputs comprises a second subset of the set of weighted sums of the bitwise dot products of the first and second digital inputs.

16 . An article of manufacture comprising a non-transitory computer-readable storage medium having embodied therein executable instruction code that when executed by a processor causes the processor to perform the steps of:

performing, with a first accuracy, a first portion of a bitwise multiplication of first and second digital inputs using a first subset of a set of two or more instances of bitwise dot-product summation circuitry, the first subset of the set of two or more instance of the bitwise dot-product summation circuitry utilizing first analog hardware; and

performing, with a second accuracy different than the first accuracy, at least a second portion of the bitwise multiplication of the first and second digital inputs using a second subset of the set of two or more instances of the bitwise dot-product summation circuitry, the second subset of the set of two or more instances of the bitwise dot-product summation circuitry utilizing second analog hardware, the second analog hardware being different than the first analog hardware;

wherein the first analog hardware comprises two or more pop-counter circuit instances each configured to sum a first number of inputs utilizing a bit-design of a first number of bits; and

wherein the second analog hardware comprises a single pop-counter circuit instance coupled to an additional capacitor bank configured to sum a second number of inputs utilizing the bit-design of the first number of bits, the second number of inputs being greater than the first number of inputs.

17 . The article of claim 16 , wherein the bitwise multiplication of the first and second digital inputs comprises computation of a set of weighted sums of bitwise dot products of the first and second digital inputs, wherein the first portion of the bitwise multiplication of the first and second digital inputs comprises a first subset of the set of weighted sums of the bitwise dot products of the first and second digital inputs, and wherein the second portion of the bitwise multiplication of the first and second digital inputs comprises a second subset of the set of weighted sums of the bitwise dot products of the first and second digital inputs.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2021
From: AGRAWAL, ANKUR; KANG, MINGU; KIM, KYU-HYOUN; KAR, MONODEEP
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 057479/0532 →
Continuity (1)
Related Publication 20230083270A1 · Mar 16, 2023
References Cited (55)
US 6233597B1 · Tanoue et al. · 2001 [cited by applicant]
US 8959137B1 · Langhammer · 2015 [cited by examiner]
US 9356615B1 · Ranjbar · 2016 [cited by examiner]
US 10389375B1 · Fick et al. · 2019 [cited by applicant]
US 10552154B2 · Madduri et al. · 2020 [cited by applicant]
US 10621269B2 · Phelps et al. · 2020 [cited by applicant]
US 10637495B2 · Shen et al. · 2020 [cited by applicant]
US 10848167B1 · Far · 2020 [cited by examiner]
US 11809837B2 · Agrawal et al. · 2023 [cited by applicant]
US 20040228424A1 · Baldwin et al. · 2004 [cited by applicant]
US 20180321938A1 · Boswell · 2018 [cited by examiner]
US 20190087356A1 · Fick et al. · 2019 [cited by applicant]
US 20190102194A1 · Madduri et al. · 2019 [cited by applicant]
US 20190179776A1 · Fick et al. · 2019 [cited by applicant]
US 20190196785A1 · Danysh et al. · 2019 [cited by applicant]
US 20200127626A1 · Paulsen · 2020 [cited by examiner]
US 20200150926A1 · Connor · 2020 [cited by examiner]
US 20200311183A1 · Simpson · 2020 [cited by applicant]
US 20200356344A1 · Cruz-Albrecht et al. · 2020 [cited by applicant]
US 20200356620A1 · Yen · 2020 [cited by examiner]
US 20200364577A1 · LeGallo-Bourdeau et al. · 2020 [cited by applicant]
US 20200387564A1 · Simpson · 2020 [cited by applicant]
US 20200409659A1 · Brunie · 2020 [cited by applicant]
US 20200410333A1 · Das et al. · 2020 [cited by applicant]
US 20210005230A1 · Wang et al. · 2021 [cited by applicant]
US 20210097131A1 · Guo et al. · 2021 [cited by applicant]
US 20210209190A1 · Kung · 2021 [cited by examiner]
US 20220215257A1 · Shen et al. · 2022 [cited by applicant]
CN 109683961A · 2019 [cited by applicant]
CN 111144558A · 2020 [cited by applicant]
CN 111492343A · 2020 [cited by applicant]
CN 112130804A · 2020 [cited by applicant]
CN 112860220A · 2021 [cited by applicant]
CN 113159305A · 2021 [cited by applicant]
CN 117980899A · 2024 [cited by applicant]
DE 112022004400T5 · 2024 [cited by applicant]
JP 2000181984A · 2000 [cited by applicant]
JP 2024533118A · 2024 [cited by applicant]
TW 201905768A · 2019 [cited by applicant]
TW 201933786A · 2019 [cited by applicant]
TW I818547B · 2023 [cited by applicant]
WO 2019100036A1 · 2019 [cited by applicant]
WO 2020257531A1 · 2020 [cited by applicant]
WO PCTIB2022058613 · 2022 [cited by applicant]
WO 2023042068A1 · 2023 [cited by applicant]
Ghodrati, S. (Oct. 3, 2020). Mixed-Signal Charge-Domain Acceleration of Deep Neural Networks through Interleaved Bit-Partitioned Arithmetic. https://jongse-park.github.io/files/paper/2020-pact-bihiwe.pdf (Year: 2020). [cited by examiner]
Khaire, D. (Apr. 2014). Design of flash ADC using improved Comparator Scheme. https://www.ijera.com/special_issue/ICIAC_April_2014/EN/V3/EN-1703943.pdf (Year: 2014). [cited by examiner]
Nur Zazmera Mustafa Kamal. (May 2020). (PDF) design of low voltage comparator for analog to digital conversion. https://www.researchgate.net/publication/283887116_Design_of_Low_voltage_Comparator_for_Analog_to_Digital_C… [cited by examiner]
Bankman, D. (2017). An 8-bit, 16 input, 3.2 PJ/OP switched-capacitor dot product circuit in 28-NM FDSOI CMOS | IEEE conference publication | IEEE Xplore. https://ieeexplore.ieee.org/document/7844125 (Year: 2017). [cited by examiner]
Taiwan Office Action Application No. 11220078060, Jan. 31, 2023, 5 pages. [cited by applicant]
M. Duppils et al., “Low Power Mixed Analog-Digital Signal Processing,” Proceedings of the 2000 International Symposium on Low Power Electronics and Design, Jul. 2000, pp. 61-66. [cited by applicant]
P. Mell et al., “The NIST Definition of Cloud Computing,” Recommendations of the National Institute of Standards and Technology, Special Publication 800-145, Sep. 2011, 7 pages. [cited by applicant]
U.S. Appl. No. 17/012,916, filed Sep. 4, 2020, and entitled “Integer Matrix Multiplication Based on Mixed Signal Circuits.” [cited by applicant]
International Searching Authority, “Notification of Transmittal of the International Search Report and the Written Opinion of the International Searching Authority, or Declaration,” Patent Cooperation Treaty, Nov. 28, 2… [cited by applicant]
Japan Patent Office, “Notice of Reasons for Refusal” Dec. 23, 2025, 04 Pages, JP Application No. 2024-513738. [cited by applicant]