Access pattern based optimization of memory access
A method for optimizing memory access for database operations is provided. The method may include identifying an access pattern associated with a database operation. The access pattern may include data required to perform the database operation. One or more memory pages may be generated based at least on the access pattern. The one or more memory pages may include at least a portion of the data required to perform the database operation. The one or more memory pages including at least the portion of the data required to perform the database operation may be stored in a main memory. The database operation may be performed by at least loading, from the main memory and into a cache, the one or more memory pages including at least the portion of the data required to perform the database operation. Related systems and articles of manufacture, including computer program products, are also provided.
1. A system, comprising:
at least one data processor; and
at least one memory storing instructions which, when executed by the at least one data processor, cause operations comprising:
identifying an access pattern associated with a database operation, the database operation comprising a binary search on an index comprising a sorted array, the access pattern comprising data required to perform the database operation, and the data required to perform the database operation comprising a first middle element of the sorted array;
generating, based at least on the access pattern, one or more memory pages including at least a portion of the data required to perform the database operation;
storing, in a main memory, the one or more memory pages including at least the portion of the data required to perform the database operation; and
performing the database operation by at least loading, from the main memory and into a cache, the one or more memory pages including at least the portion of the data required to perform the database operation.
2. The system of claim 1 , wherein the one or more memory pages includes the first middle element.
3. The system of claim 1 , wherein the data required to perform the database operation further comprises a second middle element of a first half interval of the sorted array and/or a third middle element of a second half interval of the sorted array.
4. The system of claim 3 , wherein the one or more memory pages further includes the second middle element and/or the third middle element.
5. The system of claim 1 , wherein the generation of the one or more memory reduces a frequency of cache misses when the one or more memory pages are loaded into the cache, and wherein the cache miss occurs due to the data required to perform the database operation being absent from the cache.
6. A computer-implemented method, comprising:
identifying an access pattern associated with a database operation, the database operation comprising a binary search on an index comprising a sorted array, the access pattern comprising data required to perform the database operation, and the data required to perform the database operation comprising a first middle element of the sorted array;
generating, based at least on the access pattern, one or more memory pages including at least a portion of the data required to perform the database operation;
storing, in a main memory, the one or more memory pages including at least the portion of the data required to perform the database operation; and
performing the database operation by at least loading, from the main memory and into a cache, the one or more memory pages including at least the portion of the data required to perform the database operation.
7. The computer-implemented method of claim 6 , wherein the one or more memory pages includes the first middle element.
8. The computer-implemented method of claim 6 , wherein the data required to perform the database operation further comprises a second middle element of a first half interval of the sorted array and/or a third middle element of a second half interval of the sorted array.
9. The computer-implemented method of claim 8 , wherein the one or more memory pages further includes the second middle element and/or the third middle element.
10. The computer-implemented method of claim 6 , wherein the generation of the one or more memory reduces a frequency of cache misses when the one or more memory pages are loaded into the cache, and wherein the cache miss occurs due to the data required to perform the database operation being absent from the cache.
11. A non-transitory computer-readable medium storing instructions, which when executed by at least one data processor, result in operations comprising:
identifying an access pattern associated with a database operation, the database operation comprising a binary search on an index comprising a sorted array, the access pattern comprising data required to perform the database operation, and the data required to perform the database operation comprising a first middle element of the sorted array;
generating, based at least on the access pattern, one or more memory pages including at least a portion of the data required to perform the database operation;
storing, in a main memory, the one or more memory pages including at least the portion of the data required to perform the database operation; and
performing the database operation by at least loading, from the main memory and into a cache, the one or more memory pages including at least the portion of the data required to perform the database operation.
12. The computer-readable medium of claim 11 , wherein the one or more memory pages includes the first middle element.
13. The computer-readable medium of claim 11 , wherein the data required to perform the database operation further comprises a second middle element of a first half interval of the sorted array and/or a third middle element of a second half interval of the sorted array.
14. The computer readable medium of claim 13 , wherein the one or more memory pages further includes the second middle element and/or the third middle element.
15. The computer-readable medium of claim 11 , wherein the generation of the one or more memory reduces a frequency of cache misses when the one or more memory pages are loaded into the cache, and wherein the cache miss occurs due to the data required to perform the database operation being absent from the cache.