Autonomous memory subsystem architecture
View Patent ↗An autonomous sub-system receives a database downloaded from a host controller. A controller monitors bus traffic and/or allocated resources in the subsystem and re-allocates resources based on the monitored results to dynamically improve system performance.
1. An autonomous memory sub-system, comprising:
a controller having a condition monitoring block;
first and second autonomous memory devices having bus traffic wherein the first autonomous memory device includes a die including a memory in the die to store contents and a control engine embedded in the same die with the memory, the condition monitoring block monitors the bus traffic and based on monitored results re-allocates resources to dynamically improve system performance, the first autonomous memory device including a first inter-die communication port physically coupled to a die of the second autonomous memory device to communicate with the die of the second autonomous memory device, and the first autonomous memory device including a second inter-die communication port physically coupled to a die of an additional autonomous memory device to communicate with the die of the additional autonomous memory device different from the first and second autonomous memory devices; and
a third autonomous memory device that is not a neighboring device to the first and second autonomous memory devices, wherein the controller selects contents of the third autonomous memory device to relocate to the first and second autonomous memory devices that are neighboring devices, and the first, second, and third autonomous memory devices further include a scratch pad memory port to couple external memory.
2. The autonomous memory sub-system of claim 1 wherein read-only content distributed within the first, second and third autonomous memory devices is replicated in the first and second autonomous memory devices to perform parallel operations on the read-only content without incurring bus traffic by the third autonomous memory device.
3. The autonomous memory sub-system of claim 1 wherein the controller selects to relocate contents of the second autonomous memory device to the first autonomous memory device to reduce bus traffic between the first and second autonomous memory devices.
4. The autonomous memory sub-system of claim 1 wherein the external memory is NAND memory or Dynamic Random Access Memory (DRAM).
5. An autonomous memory sub-system, comprising:
a memory device in an array of memory devices to initiate instructions to disperse portions of a database neighboring memory devices; and
a condition monitoring block to monitor bus traffic in the autonomous memory sub-system and re-allocate memory content in the array of memory devices to dynamically reduce bus traffic of the memory device to the neighboring memory devices, the memory device including a first inter-die communication port physically coupled to a die of a first memory device of the neighboring memory devices to communicate with the die of the first memory device of the neighboring memory devices, and the memory device including a second inter-die communication port physically coupled to a die of a second memory device of the neighboring memory devices to communicate with the die of the second memory device of the neighboring memory devices, wherein the memory device in the array of memory devices further includes a scratch pad memory port to couple external NAND memory and Dynamic Random Access Memory (DRAM).
6. The autonomous memory sub-system of claim 5 wherein the memory device in an array of memory devices has four output ports physically coupled to four respective dies of four neighboring memory devices to communicate with at least four neighboring memory devices.
7. The autonomous memory sub-system of claim 5 wherein the memory device in an array of memory devices communicates wirelessly with the at least four neighboring memory devices.
8. The autonomous memory sub-system of claim 5 wherein the condition monitoring block re-allocates memory content in the memory device in an array of memory devices after having determined neighboring memory devices from non-neighboring memory devices.
9. The autonomous memory sub-system of claim 8 wherein read-only content distributed within the memory sub-system is replicated in the memory device in an array of memory devices and the neighboring memory devices to perform parallel operations on the read-only content without incurring bus traffic by the non-neighboring memory devices.
10. An autonomous memory sub-system having an array of memory devices, wherein a memory device in the array includes a die including a memory in the die to store contents and a control engine embedded in the same die with the memory, the memory device in the array initiates instructions to disperse portions of a database to memory devices in the array and directs re-allocation of memory content to dynamically manage constrained resources, the memory device includes a first inter-die communication port physically coupled to a die of a first memory device among the array of memory devices to communicate with the die of the first memory device among the array of memory devices, and the memory device includes a second inter-die communication port physically coupled to a die of a second memory device among the array of memory devices to communicate with the die of the second memory device among the array of memory devices, wherein the memory device in the array includes a scratch pad memory port to couple external memory.
11. The autonomous memory sub-system of claim 10 wherein the constrained resources includes a bus bandwidth.
12. The autonomous memory sub-system of claim 10 wherein the memory contents of non-neighboring devices in the array is redistributed to neighboring devices to optimize the constrained resources.