Unloaded cache bypass
Systems, apparatuses, and methods related to a memory controller for unloaded cache bypass are described. An example memory controller can be coupled to a memory device. The example memory controller can include a cache. The cache can include a cache sequence controller configured to determine a quantity of a pending cache look-up operations, determine the quantity satisfies an unloaded bypass threshold, and cause performance of a bypass memory operation that bypasses the cache and accesses the memory device.
1. An apparatus, comprising:
a memory device; and
a memory controller coupled to the memory device and configured to receive a host read request, the memory controller comprising:
a cache;
a switch coupled to the memory device; and
a cache sequence controller coupled to the cache and the switch, configured to:
responsive to receiving the host read request, determine that a quantity of pending cache look-up operations in a queue of the cache satisfies a variable unloaded bypass threshold, wherein the variable unloaded bypass threshold is varied based on a cache hit rate of cache look-up operations associated with the cache; and
cause performance of a bypass read operation that bypasses the cache and accesses the memory device via the switch responsive to determining the quantity satisfies the variable unloaded bypass threshold.
2. The apparatus of claim 1 , wherein the memory controller is configured to cause performance of a cache look-up operation associated with the cache substantially contemporaneously with the performance of the bypass read operation.
3. The apparatus of claim 2 , wherein performance of the cache look-up operation results in a cache hit, and wherein the memory controller is further to discard data read from the memory device in association with the bypass read operation.
4. The apparatus of claim 2 , wherein performance of the cache look-up operation results in a cache miss.
5. The apparatus of claim 4 , wherein the cache miss is a clean cache miss, and wherein the cache sequence controller is further to cache-in data read from the memory device in association with the bypass read operation.
6. The apparatus of claim 4 , wherein the cache miss is a dirty cache miss, and wherein:
the cache sequence controller is further to cache-in data read from the memory device in association with the bypass read operation; and
the memory controller is to cause performance of a cache write-back operation to write data from the cache to the memory device.
7. The apparatus of claim 1 , wherein memory controller includes metric logic including counters, and wherein the counters comprise a cache hit counter, write hit counter, or a combination thereof.
8. The apparatus of claim 1 , wherein the cache further comprises a cache memory and a cache controller.
9. The apparatus of claim 1 , wherein the quantity of pending cache look-up operations satisfies the variable unloaded bypass threshold when the quantity of pending cache look-up operations is less than or equal to the variable unloaded bypass threshold.
10. A system, comprising:
a memory device; and
a memory controller coupled to the memory device and configured to receive a host read request, the memory controller comprising:
a cache;
a switch coupled to the memory device; and
a cache sequence controller coupled to the cache and the switch, configured to:
responsive to receiving the host read request:
determine, based on collected metrics, that a quantity of pending cache look-up operations in a queue of the cache satisfies a variable unloaded bypass threshold, wherein the variable unloaded bypass threshold is varied based on a cache hit rate of cache look-up operations associated with the cache;
cause performance of a cache look-up operation; and
in parallel with performance of the cache look-up operation, cause initiation of a bypass read operation that bypasses the cache and accesses the memory device via the switch to read data corresponding to the host read request from the memory device.
11. The system of claim 10 , wherein the cache is configured to operate in accordance with a First-in First-out (FIFO) cache replacement policy.
12. The system of claim 10 , wherein the cache sequence controller is to cause performance of a plurality of bypass read operations when the quantity of the pending cache look-up operations in the queue is less than or equal to the variable unloaded bypass threshold.
13. The system of claim 10 , further comprising an exit threshold that is less than the variable unloaded bypass threshold, and wherein the cache sequence controller is to abstain from performance of a bypass read operation until the quantity of the pending look-up operations is less than the exit threshold.
14. The system of claim 10 , wherein:
the variable unloaded bypass threshold is decreased based on the cache hit rate being above a target hit rate; and
the variable unloaded bypass threshold is increased based on the cache hit rate being below a target hit rate.
15. A method, comprising:
determining, by a memory controller coupled to a memory device, a quantity of pending cache look-up operations in a queue associated with a cache responsive to receiving a host access request;
determining the quantity of pending cache look-up operations is less than or equal to an unloaded bypass threshold that is variable based on a cache hit rate of cache look-up operations associated with the cache; and
responsive to determining the quantity of pending cache look-up operations is less than or equal to the unloaded bypass threshold:
causing performance of a bypass read operation that bypasses the cache and accesses the memory device via a switch of the memory controller that is coupled to the memory device; and
causing performance of a cache look-up operation associated with the cache substantially contemporaneously with the performance of the bypass read operation.
16. The method of claim 15 , wherein data associated with the performance of the bypass read operation is selectively utilized based on a type of result of the cache look-up operation.
17. The method of claim 15 , wherein the unloaded bypass threshold is equal to a non-zero quantity of pending cache look-up operations.
18. The method of claim 15 , wherein the unloaded bypass threshold is equal to zero pending cache look-up operations.