IP Library Granted Patent US 11,599,475
Granted Patent B2
US 11,599,475 · App. 17/222,642 · Granted Mar 7, 2023

Apparatuses and methods for compute enabled cache

Inventor: Richard C. Murphy (Boise, ID)
Assignee: Micron Technology, Inc.
G06F12/0864G06F9/30036G06F12/084G06F12/0811G06F12/0895G11C7/1006G11C11/4091G11C11/4096G06F2212/1012G06F2212/1044G06F2212/283G06F2212/6032G11C11/4094G11C19/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,599,475
App. No.
17/222,642
Granted
Mar 7, 2023
Kind
B2
Abstract

An example includes a compute component, a memory and a controller coupled to the memory. The controller configured to operate on a block select and a subrow select as metadata to a cache line to control placement of the cache line in the memory to allow for a compute enabled cache.

Claims (42)

1. An apparatus, comprising:

a memory device comprising a memory array and sensing circuitry comprising a plurality of sense amplifiers and a plurality of compute components to perform logical operations;

a host coupled to the memory device and comprising a cache controller, the cache controller configured to:

create a block select as metadata to a cache line to control alignment of the cache line to one or more of the plurality of compute components for processing.

2. The apparatus of claim 1 , wherein the host comprises a processing resource coupled to a last layer cache (LLC) via through silicon vias (TSVs) and wherein the cache line is moved from the LLCs to the memory device.

3. The apparatus of claim 2 , wherein the block select corresponds to a width of an interface coupling the host to the memory device.

4. The apparatus of claim 1 , wherein the memory device is a last layer cache (LLC) memory.

5. The apparatus of claim 4 , wherein the plurality of sense amplifiers is configured to access and to operate on cached data in the LLC memory without moving the cached data to a higher level in the memory.

6. The apparatus of claim 1 , wherein a controller of the memory device is configured to:

change the block select and a subrow select;

relocate the cached data transparently to a host processor of the host; and

wherein the block select and the subrow select are not part of an address space of the host processor.

7. The apparatus of claim 6 , wherein the cache controller is configured to store a copy of the block select and the subrow select with the host processor.

8. The apparatus of claim 1 , wherein the memory device is configured to:

use the block select to control alignment of cached data in the memory array; and

use a subrow select to control resource allocation in the memory array.

9. An apparatus, comprising:

a host;

a memory device coupled to the host, functioning a last layer cache (LLC) memory, comprising a memory array and a plurality of compute components, and configured to:

receive a cache line having block select metadata from the host processor; and

operate on the block select metadata to control alignment of the cache line to one or more of the plurality of compute components for processing in the LLC memory.

10. The apparatus of claim 9 , wherein the host further includes a cache controller to create the block select metadata and insert to the cache line.

11. The apparatus of claim 9 , wherein the block select metadata a is stored internal to the memory device and are transparent to an address space of a processing resource of the host.

12. The apparatus of claim 9 , wherein the memory device is configured to:

store the cache blocks in the array; and

retrieve a cache line to perform logical operations with a plurality of compute components and the plurality of sense amplifiers of the memory device.

13. A system for operating a cache memory, comprising:

a host processor; and

a last layer cache (LLC) memory coupled to the host processor via through silicon vias (TSVs), comprising a memory array and a plurality of compute components, and configured to:

receive a cache line having block select metadata; and

control alignment, utilizing the block select metadata, of the cache line to one or more of the plurality of compute components for processing.

14. The system of claim 13 , wherein the LLC memory is a three dimensional (3D) integrated memory.

15. The system of claim 14 , wherein memory banks of the LLC memory have independent TSV paths coupling the memory banks to the host processor.

16. The system of claim 14 , further comprising a cache controller configured to control the TSV paths.

17. The system of claim 14 , wherein the host processor is further configured to move the cache line having the block select metadata from a static random access memory (SRAM) of the host processor to the LLC memory.

18. An apparatus, comprising:

a memory device comprising a memory array and sensing circuitry comprising a plurality of sense amplifiers and a plurality of compute components to perform logical operations;

a host coupled to the memory device and comprising a cache controller, the cache controller configured to:

create a block select as metadata to a cache line to control alignment of cache blocks within the memory array; and

create a subrow select as metadata to the cache line to control resource allocation of a plurality of subarrays.

19. The apparatus of claim 18 , wherein the cache controller is further configured to create the subrow select as metadata to the cache line to select in which subarray, from the plurality of subarrays, the cache line is placed.

20. The apparatus of claim 19 , wherein the cache controller is further configured to create the subrow select as metadata to the cache line to select in which subarray a plurality of element of the cache line is placed.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 2, 2024
From: MICRON TECHNOLOGY, INC.
To: LODESTAR LICENSING GROUP LLC
Reel/Frame 065993/0131 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2021
From: MURPHY, RICHARD C.
To: MICRON TECHNOLOGY, INC.
Reel/Frame 055827/0622 →
Continuity (5)
Continuation 16531619 · Aug 5, 2019
Continuation 16126169 · Sep 10, 2018
Continuation 15066488 · Mar 10, 2016
Provisional Application 62167451 · May 28, 2015
Related Publication 20210224192A1 · Jul 22, 2021