IP Library › Granted Patent US 9,886,384
Granted Patent B2
US 9,886,384 · App. 14/931,019 · Granted Feb 6, 2018

Cache control device for prefetching using pattern analysis processor and prefetch instruction and prefetching method using cache control device

Inventors: Jun-Kyoung Kim (Suwon-si, KR); Dong-Hoon Yoo (Seongnam-si, KR); Jeong-Wook Kim (Seoul, KR); Soo-Jung Ryu (Hwaseong-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06F12/0862G06F9/383G06F12/0875G06F8/4442G06F2212/452G06F2212/6026G06F2212/6028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,886,384
App. No.
14/931,019
Granted
Feb 6, 2018
Kind
B2
Abstract

The present examples relate to prefetching, and to a cache control device for prefetching and a prefetching method using the cache control device, wherein the cache control device analyzes a memory access pattern of program code, inserts, into the program code, a prefetching command generated by encoding the analyzed access pattern, and executes the prefetching command inserted into the program code in order to prefetch data into a cache, thereby maximizing prefetching efficiency.

Claims (33)

1. A cache control device comprising:

a pattern analysis processor configured to analyze a memory access pattern of program code;

a code conversion processor configured to generate a prefetch instruction by encoding the analyzed memory access pattern, and to insert the generated prefetch instruction into the program code;

a prefetch processor configured to prefetch data into a cache, in response to an execution of the prefetch instruction inserted into the program code; and

an optimization processor configured to change a plurality of data to be simultaneously used together into a single array structure, such that the plurality of data are all prefetched together into the cache.

2. The cache control device of claim 1 , further comprising:

a prefetch table configured to store input parameters of the prefetch instruction,

wherein the prefetch processor executes the prefetch instruction inserted into the program code, based on the input parameters.

3. The cache control device of claim 1 , wherein the prefetch processor prefetches data according to a regular pattern, in response to the execution of the prefetch instruction inserted into the program code.

4. The cache control device of claim 1 , wherein the pattern analysis processor compiles the program code into binary code, and analyzes the memory access pattern by profiling the binary code.

5. The cache control device of claim 1 , wherein the prefetch instruction comprises, as the input parameters, at least one identifier (ID) for identifying a memory access pattern of the program code, a program counter (PC) to determine a data fetching time, a memory address of data to be fetched, and a number of data blocks to be fetched.

6. The cache control device of claim 1 , wherein in a case in which the prefetch instruction in the program code comprises, as an input parameter, an offset value between a base memory address and a memory address of data to be fetched, the prefetch processor obtains the memory address of the data to be fetched by adding the offset value to the base memory address.

7. The cache control device of claim 6 , wherein the prefetch processor obtains the base memory address by monitoring a data bus.

8. The cache control device of claim 1 , wherein the prefetch instruction in the program code is executed using an empty slot of a very long instruction word (VLIW).

9. A prefetch method comprising:

analyzing a memory access pattern of program code;

generating a prefetch instruction by encoding the analyzed memory access pattern;

inserting the generated prefetch instruction into the program code;

prefetching data into a cache, in response to an execution of the prefetch instruction that is inserted into the program code; and

changing into a single array structure a plurality of data to be simultaneously used such that the plurality of data are all prefetched together into the cache.

10. The prefetch method of claim 9 , wherein the generating of the prefetch instruction comprises generating a prefetch table storing input parameters of the prefetch instruction, and the prefetching of the data comprises executing the prefetch instruction inserted into the program code based on the input parameters.

11. The prefetch method of claim 9 , wherein the prefetching of the data into the cache comprises prefetching the data according to a regular pattern in response to the execution of the prefetch instruction inserted into the program code.

12. The prefetch method of claim 9 , wherein the analyzing of the memory access pattern comprises compiling the program code into binary code and analyzing the memory access pattern by profiling the binary code.

13. The prefetch method of claim 9 , wherein, in a case in which the prefetch instruction in the program code comprises, as an input parameter, an offset value between a base memory address and a memory address of data to be fetched, the prefetching of the data into the cache comprises determining the memory address of the data to be prefetched by adding the offset value to the base memory address.

14. The prefetch method of claim 13 , wherein the prefetching of the data into the cache comprises obtaining the base memory address by monitoring a data bus.

15. The prefetch method of claim 9 , wherein the prefetching of the data into the cache comprises determining a time at which to prefetch the data by monitoring a program counter.

16. A cache control device comprising:

a code conversion processor configured to generate a prefetch instruction by encoding an analyzed memory access pattern of program code, and to insert the generated prefetch instruction into the program code;

a prefetch processor configured to prefetch data into a cache, in response to an execution of the prefetch instruction inserted into the program code; and

an optimization processor configured to change a plurality of data to be simultaneously used together into a single array structure, such that the plurality of data are all prefetched together into the cache.

17. The cache control device of claim 16 , further comprising:

a prefetch table configured to store input parameters of the prefetch instruction,

wherein the prefetch processor executes the prefetch instruction inserted into the program code, based on the input parameters.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 4, 2015
From: KIM, JUN-KYOUNG; YOO, DONG-HOON; KIM, JEONG-WOOK; RYU, SOO-JUNG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 037216/0128 →
Priority Claims (1)
KR 10-2013-0050250 · May 3, 2013 · national
Continuity (2)
Continuation PCTKR2014003955 · May 2, 2014
Related Publication 20160055089A1 · Feb 25, 2016