Scalable system on a chip
A system including a plurality of processor cores, a plurality of graphics processing units, a plurality of peripheral circuits, and a plurality of memory controllers is configured to support scaling of the system using a unified memory architecture.
1 . A system, comprising:
a plurality of processor cores;
a plurality of graphics processing units;
a plurality of peripheral devices distinct from the processor cores and the graphics processing units;
a plurality of memory controller circuits configured to interface with a system memory; and
an interconnect fabric configured to provide communication between the memory controller circuits and the processor cores, the graphics processing units, and the peripheral devices;
wherein the processor cores, the graphics processing units, the peripheral devices and the memory controller circuits are configured to communicate via a unified memory architecture in which adjacent blocks of a given page within a unified address space defined by the unified memory architecture are distributed among the plurality of memory controller circuits; and
wherein the processor cores, the graphics processing units, the peripheral devices, the memory controller circuits, and the interconnect fabric are included in a system on a chip (SOC) integrated onto one or more co-packaged semiconductor dies.
2 . The system of claim 1 , wherein the processor cores, the graphics processing units, and the peripheral devices are configured to access any address within the unified address space defined by the unified memory architecture.
3 . The system of claim 2 , wherein the unified address space is a virtual address space distinct from a physical address space provided by the system memory.
4 . The system of claim 1 , wherein the unified memory architecture provides a common set of semantics for memory access by the processor cores, the graphics processing units, and the peripheral devices.
5 . The system of claim 4 , wherein the semantics include memory ordering properties.
6 . The system of claim 4 , wherein the semantics include quality of service attributes.
7 . The system of claim 4 , wherein the semantics include cache coherency.
8 . The system of claim 1 , wherein the memory controller circuits include respective interfaces to one or more memory devices that are mappable to random access memory.
9 . The system of claim 8 , wherein the one or more memory devices comprise dynamic random access memory (DRAM).
10 . The system of claim 1 , further comprising:
one or more levels of cache between the processor cores, the graphics processing units, the peripheral devices, and the system memory.
11 . The system of claim 10 , wherein the memory controller circuits include respective memory caches interposed between the interconnect fabric and the system memory, wherein the respective memory caches are one of the one or more levels of cache.
12 . The system of claim 1 , further comprising:
a plurality of directories configured to track a coherency state of subsets of the unified address space, wherein the plurality of directories are distributed in the system.
13 . The system of claim 12 , wherein the plurality of directories are distributed to the memory controller circuits.
14 . The system of claim 1 , wherein a given memory controller circuit of the memory controller circuits comprises a directory configured to track a plurality of cache blocks that correspond to data in a portion of the system memory to which the given memory controller circuit interfaces;
wherein the directory is configured to track which of a plurality of caches in the system are caching a given cache block of the plurality of cache blocks; and
wherein the directory is precise with respect to memory requests that have been ordered and processed at the directory even in an event that the memory requests have not yet completed in the system.
15 . The system of claim 14 , wherein the given memory controller circuit is configured to issue one or more coherency maintenance commands for the given cache block based on a memory request for the given cache block;
wherein the one or more coherency maintenance commands include a cache state for the given cache block in a corresponding cache of the plurality of caches; and
wherein the corresponding cache is configured to delay processing of a given coherency maintenance command based on the cache state in the corresponding cache not matching the cache state in the given coherency maintenance command.
16 . The system of claim 14 , wherein a first cache is configured to store the given cache block in a primary shared state and a second cache is configured to store the given cache block in a secondary shared state; and
wherein the given memory controller circuit is configured to cause the first cache to transfer the given cache block to a requestor based on a memory request and the primary shared state in the first cache.
17 . The system of claim 14 , wherein the given memory controller circuit is configured to issue one of a first coherency maintenance command and a second coherency maintenance command to a first cache of the plurality of caches based on a type of a first memory request;
wherein the first cache is configured to forward a first cache block to a requestor that issued the first memory request based on the first coherency maintenance command; and
wherein the first cache is configured to return the first cache block to the given memory controller circuit based on the second coherency maintenance command.
18 . A method, comprising:
communicating, via a unified memory architecture, among a plurality of processor cores, a plurality of graphics processing units, a plurality of peripheral devices distinct from the plurality of processor cores and the plurality of graphics processing units, and a plurality of memory controller circuits over an interconnect fabric in a system, wherein the processor cores, the graphics processing units, the peripheral devices, the memory controller circuits, and the interconnect fabric are included in a system on a chip (SOC) integrated onto one or more co-packaged semiconductor dies; and
distributing, in the SOC, adjacent blocks of a given page within a unified address space defined by the unified memory architecture among the plurality of memory controller circuits for storage in memory.
19 . The method of claim 18 , wherein the processor cores, the graphics processing units, and the peripheral devices are configured to access any address within the unified address space defined by the unified memory architecture.
20 . The method of claim 18 , wherein the unified memory architecture provides a common set of semantics for memory access by the processor cores, the graphics processing units, and the peripheral devices.