IP Library › Granted Patent US 12,200,926
Granted Patent B2
US 12,200,926 · App. 17/949,962 · Granted Jan 14, 2025

Input function circuit block and output neuron circuit block coupled to a vector-by-matrix multiplication array in an artificial neural network

Inventors: Hieu Van Tran (San Jose, CA); Steven Lemke (Boulder Creek, CA); Vipin Tiwari (Dublin, CA); Nhan Do (Saratoga, CA); Mark Reiten (Alamo, CA)
Assignee: SILICON STORAGE TECHNOLOGY, INC.
H10B41/42G06N3/08G11C16/0425H01L29/7883
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,200,926
App. No.
17/949,962
Granted
Jan 14, 2025
Kind
B2
Abstract

Numerous examples of an input function circuit block and an output neuron circuit block coupled to a vector-by-matrix multiplication (VMM) array in an artificial neural network are disclosed. In one example, an artificial neural network comprises a vector-by-matrix multiplication array comprising a plurality of non-volatile memory cells organized into rows and columns; an input function circuit block to receive digital input signals, convert the digital input signals into analog signals, and apply the analog signals to control gate terminals of non-volatile memory cells in one or more rows of the array during a programming operation; and an output neuron circuit block to receive analog currents from the columns of the array during a read operation and generate an output signal.

Claims (34)

1. An artificial neural network comprising:

a vector-by-matrix multiplication array comprising a plurality of non-volatile memory cells organized into rows and columns;

an input function circuit block to receive digital input signals, convert the digital input signals into analog signals, and apply the analog signals to control gate terminals of non-volatile memory cells in one or more rows of the array during a programming operation; and

an output neuron circuit block to receive analog currents from the columns of the array during a read operation and generate an output signal.

2. The artificial neural network of claim 1 , wherein the output neuron circuit block comprises:

a charge summer comprising a plurality of sample-and-hold circuits to convert the analog currents into the output signal, the output signal comprising digital bits.

3. The artificial neural network of claim 1 , wherein the output neuron circuit block comprises:

a current summer to sum the analog currents into a single current provided as the output signal.

4. The artificial neural network of claim 1 , wherein the output neuron circuit block comprises:

a digital summer to generate the output signal, the output signal comprising digital bits.

5. The artificial neural network of claim 1 , wherein the output neuron circuit block comprises:

an integrating analog-to-digital converter to integrate the analog currents and generate the output signal, the output signal comprising digital bits.

6. The artificial neural network of claim 1 , wherein the output neuron circuit block comprises:

a successive approximation register analog-to-digital converter to convert the analog currents into the output signal, the output signal comprising digital bits.

7. The artificial neural network of claim 1 , wherein the output neuron circuit block comprises:

a sigma-delta analog-to-digital converter to convert the analog currents into the output signal, the output signal comprising digital bits.

8. A method comprising:

receiving, by an input function circuit block coupled to a vector-by-matrix multiplication array comprising a plurality of non-volatile memory cells organized into rows and columns, digital input signals;

converting, by the input function circuit block, the digital input signals into analog signals;

applying, by the input function circuit block, the analog signals to control gate terminals of non-volatile memory cells in one or more rows of the vector-by-matrix multiplication array during a programming operation;

receiving, by an output neuron circuit block coupled to the vector-by-matrix multiplication array, analog currents from columns of the array during a read operation; and

generating, by the output neuron circuit block, an output signal in response to the analog currents.

9. The method of claim 8 , wherein the output neuron circuit block comprises:

a charge summer comprising a plurality of sample-and-hold circuits to convert the analog currents into the output signal, the output signal comprising digital bits.

10. The method of claim 8 , wherein the output neuron circuit block comprises:

a current summer to sum the analog currents into a single current provided as the output signal.

11. The method of claim 8 , wherein the output neuron circuit block comprises:

a digital summer to generate the output signal, the output signal comprising digital bits.

12. The method of claim 8 , wherein the output neuron circuit block comprises:

an integrating analog-to-digital converter to integrate the analog currents and generate the output signal, the output signal comprising digital bits.

13. The method of claim 8 , wherein the output neuron circuit block comprises:

a successive approximation register analog-to-digital converter to convert the analog currents into the output signal, the output signal comprising digital bits.

14. The method of claim 8 , wherein the output neuron circuit block comprises:

a sigma-delta analog-to-digital converter to convert the analog currents into the output signal, the output signal comprising digital bits.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2025
From: TRAN, HIEU VAN; LEMKE, STEVEN; TIWARI, VIPIN; DO, NHAN; REITEN, MARK
To: SILICON STORAGE TECHNOLOGY, INC.
Reel/Frame 070596/0025 →
Continuity (4)
Division 16919697 · Jul 2, 2020
Continuation 16231231 · Dec 21, 2018
Provisional Application 62746470 · Oct 16, 2018
Related Publication 20230031487A1 · Feb 2, 2023
References Cited (50)
US 5029130A · Yeh · 1991 [cited by applicant]
US 6747310B2 · Fan et al. · 2004 [cited by applicant]
US 8681563B1 · Lee et al. · 2014 [cited by applicant]
US 2020A1 · Ojima · 2020 [cited by applicant]
US 10741568B2 · Tran · 2020 [cited by applicant]
US 11482530B2 · Tran · 2022 [cited by examiner]
US 20020163838A1 · Guterman · 2002 [cited by applicant]
US 20050162916A1 · Guterman et al. · 2005 [cited by applicant]
US 20060291285A1 · Mokhlesi et al. · 2006 [cited by applicant]
US 20070050583A1 · Nishimura · 2007 [cited by applicant]
US 20080084752A1 · Li · 2008 [cited by applicant]
US 20080106944A1 · Kim et al. · 2008 [cited by applicant]
US 20100039859A1 · Moklesi · 2010 [cited by applicant]
US 20110273935A1 · Dong · 2011 [cited by applicant]
US 20160149567A1 · Matsuzaki et al. · 2016 [cited by applicant]
US 20170110194A1 · Tiwari · 2017 [cited by applicant]
US 20170337466A1 · Bayat et al. · 2017 [cited by applicant]
US 20190164617A1 · Tran · 2019 [cited by applicant]
US 20190287621A1 · Tran · 2019 [cited by applicant]
US 20200133989A1 · Song · 2020 [cited by applicant]
US 20200159495A1 · Joo · 2020 [cited by applicant]
US 20200167632A1 · Kim · 2020 [cited by applicant]
US 20200349421A1 · Tran · 2020 [cited by applicant]
CN 102089827A · 2011 [cited by applicant]
CN 110728358 · 2020 [cited by applicant]
JP H10106276 · 1998 [cited by applicant]
JP 10154398 · 1998 [cited by applicant]
JP 2006509326 · 2006 [cited by applicant]
JP 2009537055 · 2009 [cited by applicant]
JP 6259585 · 2018 [cited by applicant]
KR 101030617 · 2011 [cited by applicant]
TW 200822120A · 2008 [cited by applicant]
WO 200062301A1 · 2000 [cited by applicant]
WO 2017200883A1 · 2017 [cited by applicant]
WO 2018057766A1 · 2018 [cited by applicant]
Taiwanese Search Report dated Feb. 17, 2021 for the related Taiwanese Patent Application No. 108136072. [cited by applicant]
PCT Search Report corresponding to the related PCT US21/022855. [cited by applicant]
Hideo Kosaka, et al., “An Excellent Weight-Updating-Linearity EEPROM Synapse Memory Cell for Self-Learning Neuron-MOS Neural Networks,” IEEE Transactions on Electron Devices, vol. 41, No. 1, Jan. 31, 1995, pp. 135-143. [cited by applicant]
Richard Blum, “An Electronic System for Extracellular Neural Stimulation and Recording,” pp. 70-91, Aug. 31, 2007, retrieved on Aug. 19, 2014, from URL:https://smartech.gatech.edu/bitstream/handle/1853/16192/blum_richar… [cited by applicant]
M. Reza Mahmoodi, et al., “Breaking Pops/J Barrier with Analog Multiplier Circuits Based on Nonvolatile Memories,” Proceeding of the International Symposium on Low Power Electronics and Design, ISLPED '18, Jul. 23, 2018… [cited by applicant]
Xinjie Guo, “Mixed Signal Neurocomputing Based on Floating-gate Memories,” pp. 1-106, Mar. 31, 2017, retrieved on Oct. 1, 2019 from URL:https://www.alexandria.ucsb.edu/lib/ark:48907/f3jh3mb0. Parts 1 and 2. [cited by applicant]
European Extended Search Report mailed on May 2, 2023 corresponding to the related European Patent Application No. 23156869.2. [cited by applicant]
Japanese Office Action dated Jun. 27, 2023 corresponding to the related Japanese Patent Application No. 2021-520973. [cited by applicant]
Korean Office Action mailed on Feb. 5, 2024 corresponding to the related S. Korean Patent Application No. 10-2022-7004070. [cited by applicant]
European Examination Report mailed on Mar. 11, 2024 corresponding to the related European Patent Application No. 23 156 869.2. [cited by applicant]
Pai-Yu Chen, “Design of Resistive Synaptic Devices and Array Architectures for Neuromorphic Computing,” pp. 1-146, May 2018, Arizona State University. [cited by applicant]
European Examiner's Report mailed on May 31, 2024 corresponding to the related European Patent Application No. 21 718 319.3. [cited by applicant]
S. Korean Office Action mailed on May 7, 2024 corresponding to the related S. Korean Patent Application No. 10-2023-7015477. [cited by applicant]
Japanese Notice of Refusal mailed on Jul. 16, 2024 corresponding to Japanese Patent Application No. 2023-538012. (Google English Machine Translations and original copy of the Japanese Office Action are attached.). [cited by applicant]
Japanese Notice of Refusal mailed Sep. 10, 2020 corresponding to the related Japanese Patent Application No. 2023-191760. (Google English Translations and original copy of the Japanese Notice of Refusal are attached.). [cited by applicant]