Input/output connections of wafer-on-wafer bonded memory and logic
A wafer-on-wafer bonded memory and logic device can enable high bandwidth transmission of data directly between a memory die and a logic die. A memory device formed on a memory die can include many global input/output lines and many arrays of memory cells. Each array of memory cells can include respective local input/output (LIO) lines coupled to a global input/output line. A logic device can be formed on a logic die. A bond, formed between the memory die and the logic die via a wafer-on-wafer bonding process, can couple the many global input/output lines to the logic device.
1 . An apparatus, comprising:
a memory device formed on a memory die and comprising:
a plurality of global input/output lines; and
a plurality of arrays of memory cells, wherein each array of memory cells comprises a respective plurality of local input/output (LIO) lines coupled to one of the plurality of global input/output lines;
a logic device formed on a logic die; and
a bond, formed between the memory die and the logic die via a wafer-on-wafer bonding process, that couples the plurality of global input/output lines directly to the logic device.
2 . The apparatus of claim 1 , wherein the bond is configured to communicate data from the memory device to the logic device, in parallel, via the plurality of global input/output lines.
3 . The apparatus of claim 1 , wherein the plurality of arrays of memory cells comprises:
a first subset of arrays of memory cells associated with a first memory bank of the memory device; and
a second subset of arrays of memory cells associated with a second memory bank of the memory device, and
wherein a first one of the plurality of global input/output lines is coupled to the first subset of arrays of memory cells and a second one of the plurality of global input/output lines is coupled to the second subset of arrays of memory cells.
4 . The apparatus of claim 3 , wherein the memory device further comprises a global bus coupled to the bond and the first and second ones of the plurality of global input/output lines, and
wherein the bond is configured to communicate data from the first and second memory banks, concurrently and in parallel, to the logic device via the global bus.
5 . The apparatus of claim 1 , wherein the logic device comprises an artificial intelligence accelerator.
6 . The apparatus of claim 1 , wherein the logic device comprises a communication circuit from a group of communication circuits including a radio frequency communication circuit and a 5G communication circuit.
7 . The apparatus of claim 1 , wherein the logic device comprises a sensor circuit from a group of sensor circuits including a video circuit, an imaging circuit, a radar circuit, and a smart sensor circuit.
8 . The apparatus of claim 1 , wherein the logic device comprises a network circuit from a group of network circuits including a packet routing circuit and an intrusion-detection circuit.
9 . An apparatus, comprising:
a memory die comprising:
a plurality of global input/output lines; and
a plurality of memory devices formed thereon and coupled to the plurality of global input/output lines via a respective plurality of local input/output (LIO) lines; and
a logic die comprising a deep learning accelerator (DLA) formed thereon,
wherein the memory die and the logic die are arranged in a face-to-face arrangement,
wherein the plurality of memory devices are coupled to the logic device via a bond formed via a wafer-on-wafer bonding process,
wherein the bond provides paths for direct and in parallel communication between the plurality of memory devices and the DLA, and
wherein at least one path provided by the bond enables communication of data from a LIO line of the plurality of memory devices directly to the DLA.
10 . The apparatus of claim 9 , wherein each memory device comprises a respective plurality of arrays of memory cells comprising the respective plurality of LIO lines.
11 . The apparatus of claim 9 , wherein the bond comprises a metal material formed in contact with the plurality of memory devices and the DLA.
12 . The apparatus of claim 9 , wherein the bond comprises a first metal material of the logic die and a second metal material of the memory die.
13 . The apparatus of claim 9 , wherein the apparatus comprises a digital signal processor (DSP), a graphics processing unit (GPU), or a system on chip (SoC).
14 . The apparatus of claim 9 , wherein the plurality of memory devices comprise dynamic random-access memory (DRAM) devices.
15 . An apparatus, comprising:
a substrate;
a memory die coupled to the substrate and comprising a plurality of memory devices; and
a logic die coupled to the memory die and comprising a logic device,
wherein the memory die is physically coupled to the logic die via a bond formed between the memory die and the logic die via a wafer-on-wafer bonding process,
wherein global input/output lines of the plurality of memory devices are directly electrically coupled to the logic device via the bond, and
wherein the plurality of memory devices are configured to communicate data to the logic device without vias formed through the substrate.
16 . The apparatus of claim 15 , wherein the plurality of memory devices are configured to communicate data to the logic device without an interposer coupled to the plurality of memory devices and the logic device.
17 . The apparatus of claim 15 , wherein the memory die further comprises memory-to-logic circuitry coupled to the bond and configured to transmit signals indicative of data between the plurality of memory devices and the logic device via the bond.
18 . The apparatus of claim 17 , wherein the memory-to-logic circuitry is in contact with the bond.
19 . The apparatus of claim 15 , wherein the logic die further comprises logic-to-memory circuitry coupled to the bond and configured to transmit signals indicative of data between the logic device and the plurality of memory devices via the bond.
20 . The apparatus of claim 19 , wherein the logic-to-memory circuitry is further configured to:
receive signals indicative of first data directly from the plurality of memory devices via the bond;
transmit the signals indicative of first data to the logic device; and
transmit signals indicative of second data from the logic device to the plurality of memory devices via the bond.
21 . The apparatus of claim 19 , wherein the logic-to-memory circuitry is in contact with the bond.