Data caching
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for caching data not frequently accessed. One of the methods includes receiving a request for data from a component of a device, determining that the data satisfies an infrequency condition, in response to determining that the data satisfies the infrequency condition: determining a target cache level which defines a cache level within a cache level hierarchy of a particular cache at which to store infrequently accessed data, the target cache level being lower than a highest cache level in the cache level hierarchy, requesting and receiving the data from a memory that is not a cache of the device, and storing the data in a level of the particular cache that is at or below the target cache level in the cache level hierarchy, and providing the data to the component.
1. A computer-implemented method comprising:
receiving a request for data from a component of a device;
determining that the request for the data comprises a request for a nested page table;
in response to determining that the request for the data comprises a request for a nested page table:
determining whether the data is a particular type of data and that the data should only be stored in a cache at a level no higher than a target cache level;
in response to determining that the data is the particular type of data and that the data should only be stored in a cache at a level no higher than a target cache level:
determining the target cache level which defines a cache level within a cache level hierarchy of a particular cache at which to store data that is of the particular type of data, the target cache level being lower than a highest cache level in the cache level hierarchy;
requesting and receiving the data from a memory that is not a cache of the device; and
storing the data in a level of the particular cache that is at or below the target cache level in the cache level hierarchy; and
providing the data to the component.
2. The method of claim 1 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a processor of a device; and
providing the data to the component comprises providing the data to the processor.
3. The method of claim 1 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a memory controller of a device; and
providing the data to the component comprises providing the data to the memory controller.
4. The method of claim 1 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a memory management unit of a device; and
providing the data to the component comprises providing the data to the memory management unit.
5. The method of claim 1 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a input/output unit of a device; and
providing the data to the component comprises providing the data to the input/output unit.
6. The method of claim 1 , wherein determining the target cache level comprises automatically determining the target cache level using a cache miss rate for the particular cache.
7. The method of claim 6 , wherein automatically determining the target cache level using the cache miss rate for the particular cache comprises:
determining that the cache miss rate for the particular cache does not satisfy a threshold miss rate; and
changing the target cache level to a lower cache level in the cache level hierarchy in response to determining that the cache miss rate for the particular cache does not satisfy the threshold miss rate.
8. The method of claim 6 , wherein automatically determining the target cache level using the cache miss rate for the particular cache comprises:
determining that the cache miss rate for the particular cache satisfies a threshold miss rate; and
changing the target cache level to a lower cache level in the cache level hierarchy in response to determining that the cache miss rate for the particular cache satisfies the threshold miss rate.
9. A non-transitory computer readable storage medium storing instructions, which are executable by a data processing apparatus and, upon such execution, cause the data processing apparatus to perform operations comprising:
receiving a request for data from a component of a device;
determining that the request for the data comprises a request for a nested page table;
in response to determining that the request for the data comprises a request for a nested page table:
determining whether the data is a particular type of data and that the data should only be stored in a cache at a level no higher than a target cache level;
in response to determining that the data is the particular type of data and that the data should only be stored in a cache at a level no higher than a target cache level:
determining the target cache level which defines a cache level within a cache level hierarchy of a particular cache at which to store data that is of the particular type of data, the target cache level being lower than a highest cache level in the cache level hierarchy;
requesting and receiving the data from a memory that is not a cache of the device; and
storing the data in a level of the particular cache that is at or below the target cache level in the cache level hierarchy; and
providing the data to the component.
10. The non-transitory computer readable storage medium of claim 9 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a processor of a device; and
providing the data to the component comprises providing the data to the processor.
11. The non-transitory computer readable storage medium of claim 9 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a memory controller of a device; and
providing the data to the component comprises providing the data to the memory controller.
12. The non-transitory computer readable storage medium of claim 9 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a memory management unit of a device; and
providing the data to the component comprises providing the data to the memory management unit.
13. The non-transitory computer readable storage medium of claim 9 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a input/output unit of a device; and
providing the data to the component comprises providing the data to the input/output unit.
14. The non-transitory computer readable storage medium of claim 9 , wherein determining the target cache level comprises automatically determining the target cache level using a cache miss rate for the particular cache.
15. The non-transitory computer readable storage medium of claim 14 , wherein automatically determining the target cache level using the cache miss rate for the particular cache comprises:
determining that the cache miss rate for the particular cache does not satisfy a threshold miss rate; and
changing the target cache level to a lower cache level in the cache level hierarchy in response to determining that the cache miss rate for the particular cache does not satisfy the threshold miss rate.
16. A system, comprising:
a data processing apparatus; and
a non-transitory computer readable storage medium storing instructions, which are executable by a data processing apparatus and, upon such execution, cause the data processing apparatus to perform operations comprising:
receiving a request for data from a component of a device;
determining that the request for the data comprises a request for a nested page table;
in response to determining that the request for the data comprises a request for a nested page table:
determining whether the data is a particular type of data and that the data should only be stored in a cache at a level no higher than a target cache level;
in response to determining that the data is the particular type of data and that the data should only be stored in a cache at a level no higher than a target cache level:
determining the target cache level which defines a cache level within a cache level hierarchy of a particular cache at which to store data that is of the particular type of data, the target cache level being lower than a highest cache level in the cache level hierarchy;
requesting and receiving the data from a memory that is not a cache of the device; and
storing the data in a level of the particular cache that is at or below the target cache level in the cache level hierarchy; and
providing the data to the component.
17. The system of claim 16 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a processor of a device; and
providing the data to the component comprises providing the data to the processor.
18. The system of claim 16 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a memory controller of a device; and
providing the data to the component comprises providing the data to the memory controller.
19. The system of claim 16 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a memory management unit of a device; and
providing the data to the component comprises providing the data to the memory management unit.
20. The system of claim 16 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a input/output unit of a device; and
providing the data to the component comprises providing the data to the input/output unit.