IP Library › Granted Patent US 11,404,108
Granted Patent B2
US 11,404,108 · App. 17/328,751 · Granted Aug 2, 2022

Copy data in a memory system with artificial intelligence mode

Inventor: Alberto Troia (Munich, DE)
Assignee: Micron Technology, Inc.
G11C11/409G06F11/1448G06F12/0246G06K9/6256G06N3/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,404,108
App. No.
17/328,751
Granted
Aug 2, 2022
Kind
B2
Abstract

The present disclosure includes apparatuses and methods related to copying data in a memory system with an artificial intelligence (AI) mode. An apparatus can receive a command indicating that the apparatus operate in an artificial intelligence (AI) mode, a command to perform AI operations using an AI accelerator based on a status of a number of registers, and a command to copy data between memory devices that are performing AI operations. The memory system can copy neural network data, activation function data, bias data, input data, and/or output data from a first memory device to a second memory device, such that that the first memory device can use the neural network data, activation function data, bias data, input data, and/or output data in a first AI operation and the second memory device can use the neural network data, activation function data, bias data, input data, and/or output data in a second AI operation.

Claims (38)

1. An apparatus, comprising:

a first memory device coupled to a controller;

a second memory device coupled to the controller; and

the controller configured to:

receive a first command indicating that the apparatus operate in an artificial intelligence (AI) mode;

receive a second command to perform AI operations using an AI accelerator based on a status of each of a number of registers; and

receive a third command to transmit data from the first memory device to the second memory device, wherein the first memory device and the second memory device are configured to perform the AI operations using the data.

2. The apparatus of claim 1 , wherein the controller is configured to compare results of the AI operations on the first memory device to results of the AI operations on the second memory device.

3. The apparatus of claim 1 , wherein the controller is configured to receive the third command to transmit input data for a training or inference operation executed at the second memory device.

4. The apparatus of claim 1 , wherein the controller is configured to receive the third command to transmit neural network data for a training or inference operation executed at the second memory device.

5. The apparatus of claim 1 , wherein the controller is configured to receive a fourth command to transmit the data from the first memory device to a third memory device identified as a target for the data during performance of the AI operations.

6. The apparatus of claim 1 , wherein each one of the registers is configured to provide an input function, an output function, a neural network function, an activation function, or any combination thereof for the AI accelerator.

7. The apparatus of claim 1 , wherein the first command, the second command, and the third command comprise a single command.

8. A system, comprising:

a number of memory devices coupled to a controller, wherein each of the memory devices is configured as part of a neural network; and

the controller configured to:

send a first command to a first memory device of the number of memory devices to:

read data from a first memory array in the first memory device and transmit the data to a second memory array in a second memory device of the number of memory devices; and

perform an artificial intelligence (AI) operation on the first memory device using the data; and

send a second command to the second memory device to:

receive the data and write the data to the second memory array in the second memory device; and

perform the AI operation on the second memory device using the data.

9. The system of claim 8 , wherein the controller is configured to compare results of the AI operation on the first memory device to results of the AI operation on the second memory device.

10. The system of claim 8 , wherein the first command further comprises a command to execute a first training or inference operation on the first memory device.

11. The system of claim 8 , wherein the second command further comprises a command to execute a second training or inference operation on the second memory device.

12. The system of claim 8 , wherein the second command comprises a first address and a second address, the first address identifying the first memory device storing data associated with a first training or inference operation and the second address identifying the second memory device as a target for the data.

13. The system of claim 8 , wherein the controller is further configured to send the first command to read the data from the first memory array and transmit the data to a third memory array in a third memory device of the number of memory devices.

14. The system of claim 13 , wherein the controller is configured to send a third command to the third memory device to perform another AI operation on the third memory device using the data transmitted from the first memory device.

15. A method, comprising:

receiving a command that comprises a first address identifying a first memory device of a memory system and a second address identifying a second memory device of the memory system;

transmitting data from the first memory device to the second memory device in response to the command;

enabling the second memory device to perform an artificial intelligence (AI) operation by programming a register on the second memory device to enter an AI mode based at least on the first address and the second address of the command; and

performing the AI operation on the second memory device using the data transmitted from the first memory device.

16. The method of claim 15 , further comprising performing another AI operation on the first memory device.

17. The method of claim 16 , further comprising comparing results of the AI operation on the second memory device to the other AI operation on the first memory device.

18. The method of claim 15 , further comprising performing the AI operation based on a status of each one of a plurality of registers.

19. The method of claim 15 , further comprising selecting the first memory device and the second memory device to transfer the data on a bus shared by the first memory device, the second memory device, and a number of additional memory devices.

20. The method of claim 16 , further comprising performing the AI operation and the other AI operation using neural network data transmitted from the first memory device to the second memory device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2021
From: TROIA, ALBERTO
To: MICRON TECHNOLOGY, INC.
Reel/Frame 056353/0496 →
Continuity (2)
Continuation 16554924 · Aug 29, 2019
Related Publication 20210280232A1 · Sep 9, 2021
Cited By (1)
US 12,254,957