IP Library Granted Patent US 9,916,144
Granted Patent B2
US 9,916,144 · App. 15/274,309 · Granted Mar 13, 2018

Arranging binary code based on call graph partitioning

Inventors: Tong Chen (Yorktown Heights, NY); Brian Flachs (Georgetown, TX); Brad W. Michael (Cedar Park, TX); Mark R. Nutter (Austin, TX); John K. P. O'Brien (South Salem, NY); Kathryn M. O'Brien (South Salem, NY); Tao Zhang (Englewood Cliffs, NJ)
Assignee: International Business Machines Corporation
G06F8/4442
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,916,144
App. No.
15/274,309
Granted
Mar 13, 2018
Kind
B2
Abstract

Mechanisms are provided for arranging binary code to reduce instruction cache conflict misses. These mechanisms generate a call graph of a portion of code. Nodes and edges in the call graph are weighted to generate a weighted call graph. The weighted call graph is then partitioned according to the weights, affinities between nodes of the call graph, and the size of cache lines in an instruction cache of the data processing system, so that binary code associated with one or more subsets of nodes in the call graph are combined into individual cache lines based on the partitioning. The binary code corresponding to the partitioned call graph is then output for execution in a computing device.

Claims (54)

1. A method, in a data processing system, for arranging binary code to reduce instruction cache conflict misses, comprising:

generating, by a processor of the data processing system executing a compiler, a call graph of a portion of code;

weighting, by the compiler, nodes and edges in the call graph to generate a weighted call graph;

partitioning, by the compiler, the weighted call graph according to the weights, affinities between nodes of the call graph, and the size of cache lines in an instruction cache of the data processing system, so that binary code associated with one or more subsets of nodes in the call graph are combined into individual cache lines based on the partitioning; and

outputting, by the compiler, the binary code corresponding to the partitioned call graph for execution in a computing device, wherein partitioning the weighted call graph comprises performing the following operations iteratively until an edge having a maximum weight cannot be selected from unprocessed edges of the weighted call graph:

selecting an edge from the unprocessed edges of the weighted call graph that has a maximum weight of the weights of the unprocessed edges; and

processing nodes of the selected edge.

2. The method of claim 1 , wherein each node in the call graph is weighted according to a size of code associated with the node.

3. The method of claim 2 , wherein each edge in the call graph is weighted according to an estimate of a number of calls between nodes of the edge.

4. The method of claim 3 , wherein processing nodes of the selected edge further comprises:

determining if nodes of the selected edge should be merged into a new node or not; and

merging the nodes of the selected edge into a new node in response to a determination that the nodes of the selected edge should be merged.

5. The method of claim 4 , wherein determining if nodes of the selected edge should be merged into a new node or not comprising comparing weights of the nodes of the selected edge to a predetermined size of a cache line of an instruction cache of the data processing system.

6. The method of claim 5 , wherein comparing weights of the nodes of the selected edge to the predetermined size of the cache line comprises:

comparing a sum of the weights of the nodes to the predetermined size of the cache line; and

in response to the sum of the weights of the nodes being less than or equal to the predetermined size of the cache line, merging the nodes into a new node.

7. The method of claim 6 , wherein merging the nodes into a new node further comprises:

setting a weight of the new node equal to a sum of the weights of the nodes of the selected edge;

setting, for each other node coupled by an edge to one of the nodes of the selected edge, a weight of the edge to a sum of the weights of the edges between the other node and a corresponding one of the nodes of the selected edge; and

eliminating the selected edge from the weighted call graph.

8. The method of claim 6 , wherein, in response to the sum of the weights of the nodes not being less than or equal to the predetermined size of the cache line, marking the selected edge as processed.

9. The method of claim 1 , wherein if an edge having a maximum weight in the unprocessed edges cannot be selected, any remaining procedures are combined into a single node in a single cache line.

10. A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed on a data processing system, causes the data processing system to:

generate a call graph of a portion of code;

weight nodes and edges in the call graph to generate a weighted call graph;

partition the weighted call graph according to the weights, affinities between nodes of the call graph, and the size of cache lines in an instruction cache of the data processing system, so that binary code associated with one or more subsets of nodes in the call graph are combined into individual cache lines based on the partitioning; and

output the binary code corresponding to the partitioned call graph for execution in a computing device, wherein partitioning the weighted call graph comprises performing the following operations iteratively until an edge having a maximum weight cannot be selected from unprocessed edges of the weighted call graph:

selecting an edge from the unprocessed edges of the weighted call graph that has a maximum weight of the weights of the unprocessed edges; and

processing nodes of the selected edge.

11. The computer program product of claim 10 , wherein each node in the call graph is weighted according to a size of code associated with the node.

12. The computer program product of claim 11 , wherein each edge in the call graph is weighted according to an estimate of a number of calls between nodes of the edge.

13. The computer program product of claim 12 , wherein processing nodes of the selected edge further comprises:

selecting an edge from unprocessed edges of the weighted call graph;

determining if nodes of the selected edge should be merged into a new node or not; and

merging the nodes of the selected edge into a new node in response to a determination that the nodes of the selected edge should be merged.

14. The computer program product of claim 13 , wherein determining if nodes of the selected edge should be merged into a new node or not comprising comparing weights of the nodes of the selected edge to a predetermined size of a cache line of an instruction cache of the data processing system.

15. The computer program product of claim 14 , wherein comparing weights of the nodes of the selected edge to the predetermined size of the cache line comprises:

comparing a sum of the weights of the nodes to the predetermined size of the cache line; and

in response to the sum of the weights of the nodes being less than or equal to the predetermined size of the cache line, merging the nodes into a new node.

16. The computer program product of claim 15 , wherein merging the nodes into a new node further comprises:

setting a weight of the new node equal to a sum of the weights of the nodes of the selected edge;

setting, for each other node coupled by an edge to one of the nodes of the selected edge, a weight of the edge to a sum of the weights of the edges between the other node and a corresponding one of the nodes of the selected edge; and

eliminating the selected edge from the weighted call graph.

17. The computer program product of claim 15 , wherein, in response to the sum of the weights of the nodes not being less than or equal to the predetermined size of the cache line, marking the selected edge as processed.

18. The computer program product of claim 10 , wherein if an edge having a maximum weight in the unprocessed edges cannot be selected, any remaining procedures are combined into a single node in a single cache line.

19. An apparatus, comprising:

a processor; and

a memory coupled to the processor, wherein the memory comprises instructions that configure the processor to:

generate a call graph of a portion of code;

weight nodes and edges in the call graph to generate a weighted call graph;

partition the weighted call graph according to the weights, affinities between nodes of the call graph, and the size of cache lines in an instruction cache of the data processing system, so that binary code associated with one or more subsets of nodes in the call graph are combined into individual cache lines based on the partitioning; and

output the binary code corresponding to the partitioned call graph for execution in a computing device, wherein partitioning the weighted call graph comprises performing the following operations iteratively until an edge having a maximum weight cannot be selected from unprocessed edges of the weighted call graph:

selecting an edge from the unprocessed edges of the weighted call graph that has a maximum weight of the weights of the unprocessed edges; and

processing nodes of the selected edge.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2016
From: CHEN, TONG; FLACHS, BRIAN; MICHAEL, BRAD W.; NUTTER, MARK R.; O'BRIEN, JOHN K.P.; O'BRIEN, KATHRYN M.; ZHANG, TAO
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 039845/0457 →
Continuity (2)
Continuation 12823244 · Jun 25, 2010
Related Publication 20170010873A1 · Jan 12, 2017