IP Library Granted Patent US 12,639,236
Granted Patent B2
US 12,639,236 · App. 18/630,400 · Granted May 26, 2026

Neuromorphic memory device and method

Inventors: Brent Keeth (Boise, ID); Frank F Ross (Boise, ID); Richard C Murphy (Boise, ID)
Assignee: Micron Technology, Inc.
G06F13/1668G06N3/004H10W90/00H10W90/24H10W90/297H10W90/752H10W90/754
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,639,236
App. No.
18/630,400
Granted
May 26, 2026
Kind
B2
Abstract

Apparatus and methods are disclosed, including memory devices and systems. Example memory devices, systems and methods include a stack of memory dies, a controller die, and a buffer. Example memory devices, systems and methods include one or more neuromorphic layers logically coupled between one or more dies in the stack of memory dies and a host interface of the controller die.

Claims (27)

1 . A memory system, comprising:

a controller die coupled to a substrate, the controller die including a buffer, the buffer including a host interface and a die stack interface, wherein the host interface includes multiple memory channels, wherein a memory channel within the multiple memory channels is dedicated to to two or more sub-channels of the die stack interface to provide memory bandwidth, wherein a ratio of stack interface speed to host interface speed corresponds to a ratio of a number of sub- channels to a number of memory channels;

a stack of memory dies supported by the substrate and coupled to the two or more sub- channels; and

one or more neuromorphic layers logically coupled between one or more dies in the stack of dies and the host interface.

2 . The memory system of claim 1 , wherein the one or more neuromorphic layers are physically located within the controller die.

3 . The memory system of claim 1 , wherein the one or more neuromorphic layers include digital neuromorphic layers.

4 . The memory system of claim 1 , wherein the one or more neuromorphic layers include analog multiply accumulator (MAC) neuromorphic layers.

5 . The memory system of claim 1 , wherein the one or more neuromorphic layers include both digital and analog portions.

6 . The memory system of claim 1 , wherein the stack of memory dies include DRAM dies.

7 . The memory system of claim 1 , wherein the one or more neuromorphic layers include phase change cells.

8 . The memory system of claim 1 , wherein the one or more neuromorphic layers include memristor cells.

9 . The memory system of claim 1 , wherein the memory channel within the multiple memory channels is dedicated to two sub-channels of the die stack interface.

10 . The memory system of claim 1 , wherein the memory channel within the multiple memory channels is dedicated to four sub-channels of the die stack interface.

11 . The memory system of claim 1 , wherein each sub-channel is mapped to multiple dies in the stack of memory dies.

12 . The memory system of claim 1 , wherein each sub-channel is mapped to a single die in the stack of memory dies.

13 . A memory system, comprising:

a controller die coupled to a substrate, the controller die including a buffer, the buffer including a host interface and a die stack interface, wherein the host interface includes multiple memory channels, wherein a memory channel within the multiple memory channels is dedicated to to two or more sub-channels of the die stack interface to provide memory bandwidth, wherein a ratio of stack interface speed to host interface speed corresponds to a ratio of a number of sub-channels to a number of memory channels;

a stack of memory dies supported by the substrate and coupled to the two or more sub-channels;

one or more neuromorphic layers logically coupled between one or more dies in the stack of dies and the host interface; and

logic in the controller die to program one or more neuromorphic weights into the one or more neuromorphic layers.

14 . The memory system of claim 13 , wherein the one or more neuromorphic layers includes multiple layers in a single die.

15 . The memory system of claim 13 , wherein the one or more neuromorphic layers includes multiple layers in multiple dies.

16 . The memory system of claim 13 , wherein the one or more neuromorphic layers includes from 30 to 100 neuromorphic layers.

17 . The memory system of claim 13 , wherein the memory channel within the multiple memory channels is dedicated to two sub-channels of the die stack interface.

18 . The memory system of claim 13 , wherein the memory channel within the multiple memory channels is dedicated to four sub-channels of the die stack interface.

19 . The memory system of claim 13 , wherein each sub-channel is mapped to multiple dies in the stack of memory dies.

20 . The memory system of claim 13 , wherein each sub-channel is mapped to a single die in the stack of memory dies.

Continuity (3)
Continuation 17131217 · Dec 22, 2020
Provisional Application 62954186 · Dec 27, 2019
Related Publication 20240256473A1 · Aug 1, 2024
References Cited (201)
US 6226738B1 · Dowling · 2001 [cited by applicant]
US 6460152B1 · Demidov et al. · 2002 [cited by applicant]
US 7640386B2 · Coteus et al. · 2009 [cited by applicant]
US 7717752B2 · Loughner et al. · 2010 [cited by applicant]
US 8069379B2 · Perego et al. · 2011 [cited by applicant]
US 8275936B1 · Haywood et al. · 2012 [cited by applicant]
US 8543758B2 · Larson et al. · 2013 [cited by applicant]
US 8754533B2 · Or-Bach et al. · 2014 [cited by applicant]
US 8984189B2 · Casper et al. · 2015 [cited by applicant]
US 9357649B2 · Chun et al. · 2016 [cited by applicant]
US 9378707B2 · Lee · 2016 [cited by applicant]
US 9391048B2 · Lee · 2016 [cited by applicant]
US 9489009B2 · Lee et al. · 2016 [cited by applicant]
US 9519315B2 · Connolly · 2016 [cited by applicant]
US 9558805B2 · Kang et al. · 2017 [cited by applicant]
US 10528267B2 · Batra et al. · 2020 [cited by applicant]
US 10621043B2 · Casper et al. · 2020 [cited by applicant]
US 10628295B2 · Gu et al. · 2020 [cited by applicant]
US 10635610B1 · Calder · 2020 [cited by examiner]
US 10649680B2 · Riley et al. · 2020 [cited by applicant]
US 10733500B2 · Andreopoulos · 2020 [cited by examiner]
US 10740033B2 · Kim et al. · 2020 [cited by applicant]
US 10797020B2 · Thurgood · 2020 [cited by applicant]
US 10877857B2 · Park · 2020 [cited by applicant]
US 10922607B2 · Sengupta · 2021 [cited by examiner]
US 11386004B2 · Keeth et al. · 2022 [cited by applicant]
US 11538508B2 · Gibbons et al. · 2022 [cited by applicant]
US 11635910B2 · Keeth · 2023 [cited by applicant]
US 11645501B2 · Amir · 2023 [cited by examiner]
US 11868253B2 · Keeth et al. · 2024 [cited by applicant]
US 11989141B2 · Keeth et al. · 2024 [cited by applicant]
US 12045500B2 · Keeth · 2024 [cited by applicant]
US 20040163028A1 · Olarig · 2004 [cited by applicant]
US 20040233721A1 · Kim et al. · 2004 [cited by applicant]
US 20040260957A1 · Jeddeloh et al. · 2004 [cited by applicant]
US 20060107186A1 · Cowell et al. · 2006 [cited by applicant]
US 20060126369A1 · Raghuram · 2006 [cited by applicant]
US 20060233012A1 · Sekiguchi et al. · 2006 [cited by applicant]
US 20070195613A1 · Rajan et al. · 2007 [cited by applicant]
US 20080080261A1 · Shaeffer et al. · 2008 [cited by applicant]
US 20080109597A1 · Schakel et al. · 2008 [cited by applicant]
US 20080123459A1 · Rajan et al. · 2008 [cited by applicant]
US 20080126690A1 · Rajan et al. · 2008 [cited by applicant]
US 20080136002A1 · Yang · 2008 [cited by applicant]
US 20080144411A1 · Tsern · 2008 [cited by applicant]
US 20080253199A1 · Torabi et al. · 2008 [cited by applicant]
US 20090021874A1 · Divito et al. · 2009 [cited by applicant]
US 20090103345A1 · Mclaren et al. · 2009 [cited by applicant]
US 20090248969A1 · Wu et al. · 2009 [cited by applicant]
US 20100091537A1 · Best et al. · 2010 [cited by applicant]
US 20100121994A1 · Kim et al. · 2010 [cited by applicant]
US 20100195363A1 · Norman · 2010 [cited by applicant]
US 20100309706A1 · Saito et al. · 2010 [cited by applicant]
US 20120051152A1 · Hollis · 2012 [cited by applicant]
US 20120069034A1 · Biswas et al. · 2012 [cited by applicant]
US 20120102292A1 · Rajan et al. · 2012 [cited by applicant]
US 20120284436A1 · Casper et al. · 2012 [cited by applicant]
US 20120311231A1 · Porterfield · 2012 [cited by applicant]
US 20140063887A1 · Vogelsang · 2014 [cited by applicant]
US 20140173238A1 · Perego et al. · 2014 [cited by applicant]
US 20140192583A1 · Rajan et al. · 2014 [cited by applicant]
US 20140241211A1 · Zhang · 2014 [cited by examiner]
US 20140252656A1 · Lee · 2014 [cited by applicant]
US 20140254245A1 · Tadepalli et al. · 2014 [cited by applicant]
US 20140358834A1 · Kim · 2014 [cited by examiner]
US 20150155876A1 · Jayasena et al. · 2015 [cited by applicant]
US 20150302904A1 · Yoon et al. · 2015 [cited by applicant]
US 20150355965A1 · Peddle · 2015 [cited by applicant]
US 20160239439A1 · Lu · 2016 [cited by applicant]
US 20160284424A1 · Das et al. · 2016 [cited by applicant]
US 20160329303A1 · Ye et al. · 2016 [cited by applicant]
US 20160342343A1 · Yen · 2016 [cited by examiner]
US 20170147432A1 · Suh et al. · 2017 [cited by applicant]
US 20170194962A1 · Bains et al. · 2017 [cited by applicant]
US 20170255552A1 · Chatterjee et al. · 2017 [cited by applicant]
US 20170323875A1 · Tam · 2017 [cited by applicant]
US 20170344051A1 · Patel · 2017 [cited by applicant]
US 20170344275A1 · Ware et al. · 2017 [cited by applicant]
US 20180068217A1 · Eleftheriou et al. · 2018 [cited by applicant]
US 20180102344A1 · Ramachandra et al. · 2018 [cited by applicant]
US 20180174996A1 · Mostovoy et al. · 2018 [cited by applicant]
US 20180225235A1 · Lee · 2018 [cited by applicant]
US 20180294999A1 · Giovannini et al. · 2018 [cited by applicant]
US 20180309451A1 · Lu et al. · 2018 [cited by applicant]
US 20190146788A1 · Kim · 2019 [cited by applicant]
US 20190171359A1 · Lee et al. · 2019 [cited by applicant]
US 20190171520A1 · Cadigan et al. · 2019 [cited by applicant]
US 20190318230A1 · Cho et al. · 2019 [cited by applicant]
US 20200143229A1 · Van Der Made et al. · 2020 [cited by applicant]
US 20200151550A1 · Garbin et al. · 2020 [cited by applicant]
US 20200235050A1 · Lee et al. · 2020 [cited by applicant]
US 20200250516A1 · Li et al. · 2020 [cited by applicant]
US 20200272560A1 · Keeth et al. · 2020 [cited by applicant]
US 20200272564A1 · Keeth et al. · 2020 [cited by applicant]
US 20200279588A1 · Lym et al. · 2020 [cited by applicant]
US 20210073616A1 · Moraitis et al. · 2021 [cited by applicant]
US 20210125045A1 · Jang · 2021 [cited by examiner]
US 20210132856A1 · Chen · 2021 [cited by applicant]
US 20210181974A1 · Ghosh · 2021 [cited by applicant]
US 20210200464A1 · Keeth · 2021 [cited by applicant]
US 20210200699A1 · Keeth et al. · 2021 [cited by applicant]
US 20210201966A1 · Gibbons et al. · 2021 [cited by applicant]
US 20210318956A1 · Keeth et al. · 2021 [cited by applicant]
US 20210406660A1 · Chen · 2021 [cited by applicant]
US 20220121393A1 · Keeth · 2022 [cited by applicant]
US 20220342814A1 · Keeth et al. · 2022 [cited by applicant]
US 20230127970A1 · Gibbons et al. · 2023 [cited by applicant]
US 20230376235A1 · Keeth · 2023 [cited by applicant]
US 20240070069A1 · Keeth et al. · 2024 [cited by applicant]
US 20250329356A1 · Gibbons et al. · 2025 [cited by applicant]
CN 103140924A · 2013 [cited by applicant]
CN 103975428A · 2014 [cited by applicant]
CN 104471649B · 2017 [cited by applicant]
CN 108074593A · 2018 [cited by applicant]
CN 108205505A · 2018 [cited by applicant]
CN 109508316A · 2019 [cited by applicant]
CN 113728383A · 2021 [cited by applicant]
CN 113767435A · 2021 [cited by applicant]
CN 114902332A · 2022 [cited by applicant]
CN 114930452A · 2022 [cited by applicant]
CN 115398448A · 2022 [cited by applicant]
CN 116137923A · 2023 [cited by applicant]
DE 102019134293A1 · 2020 [cited by applicant]
EP 3928318A1 · 2021 [cited by applicant]
EP 3928319A1 · 2021 [cited by applicant]
EP 4081954A1 · 2022 [cited by applicant]
EP 4085458A1 · 2022 [cited by applicant]
EP 4085459A1 · 2022 [cited by applicant]
JP 2016522495A · 2016 [cited by applicant]
KR 100988388B1 · 2010 [cited by applicant]
KR 20160143988A · 2016 [cited by applicant]
KR 20170029074A · 2017 [cited by applicant]
KR 20210131391A · 2021 [cited by applicant]
KR 20210131392A · 2021 [cited by applicant]
KR 20220114027A · 2022 [cited by applicant]
KR 20220116258A · 2022 [cited by applicant]
KR 20220119697A · 2022 [cited by applicant]
WO WO2007095080A2 · 2007 [cited by applicant]
WO WO2020172551A1 · 2020 [cited by applicant]
WO WO2020172557A1 · 2020 [cited by applicant]
WO WO2021133826A1 · 2021 [cited by applicant]
WO WO2021138329A1 · 2021 [cited by applicant]
WO WO2021138408A1 · 2021 [cited by applicant]
WO WO2022087142A1 · 2022 [cited by applicant]
US 11,698,861 B2, 07/2023, Keeth et al. (withdrawn) [cited by applicant]
“Chinese Application Serial No. 202080030315.4, Office Action mailed Mar. 12, 2024”, with English translation, 16 pages. [cited by applicant]
“European Application Serial No. 20759297.3, Communication Pursuant to Article 94(3) EPC mailed Mar. 19, 2024”, 5 pgs. [cited by applicant]
“Korean Application Serial No. 10-2021-7030514, Notice of Preliminary Rejection mailed May 17, 2024”, with English translation, 13 pages. [cited by applicant]
“Chinese Application Serial No. , Voluntary Amendment filed Mar. 21, 2022”, with English claims, 16 pages. [cited by applicant]
“Chinese Application Serial No. 202080030311.6, Office Action mailed Aug. 26, 2022”, with English translation, 12 pages. [cited by applicant]
“Chinese Application Serial No. 202080030311.6, Response filed Jan. 5, 2023 to Office Action mailed Aug. 26, 2022”, with English claims, 13 pages. [cited by applicant]
“Chinese Application Serial No. 202080030315.4, Voluntary Amendment filed Mar. 25, 2022”, with English claims, 14 pages. [cited by applicant]
“European Application Serial No. 20758657.9, Extended European Search Report mailed Sep. 22, 2022”, 8 pgs. [cited by applicant]
“European Application Serial No. 20758657.9, Response Filed Apr. 11, 2022 to Communication Pursuant to Rules 161(2) and 162 EPC mailed Oct. 1, 2021”, 9 pgs. [cited by applicant]
“European Application Serial No. 20759297.3, Extended European Search Report mailed Nov. 2, 2022”, 9 pgs. [cited by applicant]
“European Application Serial No. 20905242.2, Extended European Search Report mailed Mar. 3, 2023”, 10 pgs. [cited by applicant]
“European Application Serial No. 20909806.0, Extended European Search Report mailed May 4, 2023”, 12 pgs. [cited by applicant]
“European Application Serial No. 20909806.0, Partial Supplementary European Search Report mailed Jan. 10, 2023”, 12 pgs. [cited by applicant]
“European Application Serial No. 20911114.5, Extended European Search Report mailed Jan. 18, 2024”, 9 pgs. [cited by applicant]
“European Application Serial No. 20759297.3, Response Filed Apr. 19, 2022 to Communication Pursuant to Rules 161(2) and 162 EPC mailed Oct. 5, 2021”, 9 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/019259, International Preliminary Report on Patentability mailed Sep. 2, 2021”, 8 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/019259, International Search Report mailed Jun. 19, 2020”, 6 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/019259, Written Opinion mailed Jun. 19, 2020”, 6 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/019269, International Preliminary Report on Patentability mailed Sep. 2, 2021”, 9 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/019269, International Search Report mailed Jun. 18, 2020”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/019269, Written Opinion mailed Jun. 18, 2020”, 7 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/066664, International Preliminary Report on Patentability mailed Jul. 7, 2022”, 5 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/066664, International Search Report mailed Apr. 8, 2021”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/066664, Written Opinion mailed Apr. 8, 2021”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/067319, International Preliminary Report on Patentability mailed Jul. 14, 2022”, 6 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/067319, International Search Report mailed Apr. 19, 2021”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/067319, Written Opinion mailed Apr. 19, 2021”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/067447, International Preliminary Report on Patentability mailed Jul. 14, 2022”, 6 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/067447, International Search Report mailed Apr. 27, 2021”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT/US2020/067447, Written Opinion mailed Apr. 27, 2021”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/055866, International Preliminary Report on Patentability mailed May 4, 2023”, 6 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/055866, International Search Report mailed Feb. 4, 2022”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/055866, Written Opinion mailed Feb. 4, 2022”, 4 pgs. [cited by applicant]
“Korean Application Serial No. 10-2021-7030514, Notice of Preliminary Rejection mailed Nov. 10, 2023”, with English translation, 15 pages. [cited by applicant]
“Korean Application Serial No. 10-2021-7030514, Response filed Feb. 13, 2024 to Notice of Preliminary Rejection mailed Nov. 10, 2023”, with English claims, 22 pages. [cited by applicant]
“The Authoritative Dictionary of IEEE Standards Terms”, 7th ed. IEEE, Standards Information Network IEEE Press, [Online] Retrieved from the internet: <https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=4116787>, (2000… [cited by applicant]
Madany, Waleed, et al., “An Enhanced PAM With PPM Modulation Interface for Memory Applications”, 4 pgs. [cited by applicant]
“Chinese Application Serial No. 202080030315.4, Response filed Dec. 10, 2024 to Office Action mailed Mar. 12, 2024”, with English claims, 21 pages. [cited by applicant]
“European Application Serial No. 20905242.2, Noting of loss of rights mailed Oct. 25, 2023”, 2 pgs. [cited by applicant]
“European Application Serial No. 20909806.0, Noting of loss of rights mailed Jan. 4, 2024”, 2 pgs. [cited by applicant]
“European Application Serial No. 20911114.5, Response filed Nov. 1, 2024 to Extended European Search Report mailed Jan. 18, 2024”, 86 pgs. [cited by applicant]
“European Application Serial No. 20911114.5, Response to Communication pursuant to Rules 161(2) and 162 EPC filed Feb. 28, 2023”, 10 pgs. [cited by applicant]
“Korean Application Serial No. 10-2021-7030535, Decision of Rejection mailed Sep. 12, 2024”, with English translation, 7 pages. [cited by applicant]
“Korean Application Serial No. 10-2021-7030535, Notice of Final Rejection mailed May 17, 2024”, with English translation, 15 pages. [cited by applicant]
“Korean Application Serial No. 10-2021-7030535, Notice of Final Rejection mailed Sep. 12, 2024”, with English translation, 4 pages. [cited by applicant]
“Korean Application Serial No. 10-2021-7030535, Office Action mailed Nov. 10, 2023”, with English translation, 23 pages. [cited by applicant]
“Korean Application Serial No. 10-2021-7030535, Response filed Jan. 4, 2024 to Office Action mailed Nov. 10, 2023”, with English claims, 34 pages. [cited by applicant]
“Korean Application Serial No. 10-2021-7030535, Response filed Aug. 13, 2024 to Notice of Final Rejection mailed May 17, 2024”, with English claims, 23 pages. [cited by applicant]
“European Application Serial No. 20759297.3, Response filed Sep. 19, 2024 to Communication Pursuant to Article 94(3) EPC mailed Mar. 19, 2024”, 179 pgs. [cited by applicant]
“Korean Application Serial No. 10-2021-7030514, Response filed Nov. 18, 2024 to Notice of Preliminary Rejection mailed May 17, 2024”, with English claims, 24 pages. [cited by applicant]
“European Application Serial No. 20911114.5, Communication Pursuant to Article 94(3) EPC mailed Sep. 16, 2025”, 7 pgs. [cited by applicant]
“Chinese Application Serial No. 202080094739.7, Office Action mailed May 29, 2025”, with English translation, 15 pages. [cited by applicant]
“Chinese Application Serial No. 202080094739.7, Response filed Sep. 26, 2025 to Office Action mailed May 29, 2025”, with English claims, 19 pages. [cited by applicant]
“European Application Serial No. 20759297.3, Communication Pursuant to Article 94(3) EPC mailed May 15, 2025”, 5 pgs. [cited by applicant]
“European Application Serial No. 20759297.3, Response filed Nov. 17, 2025 to Communication Pursuant to Article 94(3) EPC mailed May 15, 2025”, with English claims, 12 pages. [cited by applicant]
U.S. Appl. No. 19/025,093, filed Jan. 16, 2025, Memory Module Multiple Port Buffer Techniques. [cited by applicant]