IP Library › Granted Patent US 12,007,893
Granted Patent B1
US 12,007,893 · App. 18/504,966 · Granted Jun 11, 2024

Method and apparatus for adaptively managing cache pool

Inventors: Dohun Kim (Yongin-si, KR); Jinyeong Kim (Yongin-si, KR); Juhyun Kim (Yongin-si, KR)
Assignee: MetisX CO., Ltd.
G06F12/0802G06F30/27G06F2212/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,007,893
App. No.
18/504,966
Granted
Jun 11, 2024
Kind
B1
Abstract

Provided is a method for managing an adaptive cache pool, which is performed by one or more processors, and includes receiving monitoring information on a cache memory divided into a plurality of cache pools, and adjusting a cache region associated with at least one of the plurality of cache pools based on the monitoring information.

Claims (36)

1. A method for managing an adaptive cache pool, the method being performed by a processor and comprising:

receiving monitoring information on a cache memory divided into a plurality of cache pools; and

adjusting a cache region associated with at least one of the plurality of cache pools based on the monitoring information,

wherein each of the plurality of cache pools is allocated a different workload,

each workload is associated with a different data structure, and

the adjusting the cache region includes:

estimating a memory access pattern for each workload associated with the different data structure based on the monitoring information; and

adjusting the cache region associated with at least one of the plurality of cache pools based on the estimated memory access pattern for each workload.

2. The method according to claim 1 , wherein the monitoring information includes at least one of an access log to an address associated with each of the plurality of cache pools, or a cache hit-rate.

3. The method according to claim 1 , wherein the memory access pattern for each workload is estimated by inputting at least some of the monitoring information to a machine learning model.

4. The method according to claim 1 , wherein the estimating the memory access pattern includes estimating an access probability or frequency for each main memory address for each workload based on at least some of the monitoring information.

5. The method according to claim 1 , wherein the adjusting the cache region includes:

determining a target cache pool to change the cache region, based on the estimated memory access pattern for each workload; and

changing a main memory address associated with the determined target cache pool.

6. The method according to claim 1 , wherein the adjusting the cache region includes:

determining a target cache pool to change the cache region, based on the estimated memory access pattern for each workload; and

changing a cache memory capacity allocated to the determined target cache pool.

7. The method according to claim 1 , wherein cache regions associated with the plurality of cache pools are adjusted such that different data structures are associated with different cache pools.

8. The method according to claim 1 , wherein the monitoring information for the cache memory is received periodically or aperiodically, and

cache regions associated with the plurality of cache pools are adjusted periodically or aperiodically using the received monitoring information.

9. The method according to claim 1 , further comprising:

prior to receiving the monitoring information,

acquiring a type of an application requested to be executed; and

dividing the cache memory into the plurality of cache pools based on the type of the application.

10. A computer-readable non-transitory recording medium storing instructions for causing performance of the method according to claim 1 on a computer.

11. A computing device, comprising:

a cache memory; and

a processor connected to the cache memory and configured to execute at least one computer readable program for controlling the cache memory,

wherein the at least one program includes instructions for:

receiving monitoring information on the cache memory divided into a plurality of cache pools; and

adjusting a cache region associated with at least one of the plurality of cache pools based on the monitoring information,

each of the plurality of cache pools is allocated a different workload,

each workload is associated with a different data structure, and

the adjusting the cache region includes:

estimating a memory access pattern for each workload associated with the different data structure based on the monitoring information; and

adjusting the cache region associated with at least one of the plurality of cache pools based on the estimated memory access pattern for each workload.

Assignments (2)
CHANGE OF NAME Recorded Jan 13, 2025
From: METISX CO., LTD.
To: XCENA INC.
Reel/Frame 069877/0477 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2023
From: KIM, DOHUN; KIM, JINYEONG; KIM, JUHYUN
To: METISX CO., LTD.
Reel/Frame 065502/0142 →
Priority Claims (1)
KR 10-2023-0003461 · Jan 10, 2023 · national
Cited By (2)
US 12,307,115 US 12,430,041