Two-level arbitration in a computing system
A computing system includes a first network, a second network, multiple first agents connected to the first network, multiple second agents connected to the second network, and an interface circuit interconnecting the two networks. The interface circuit includes multiple request queues, a first arbiter for selecting requests from the second agents for transactions on the first network and entering them into the request queues, and credit counters associated with the first agents. A second arbiter selects requests from the oldest entry of each request queue based on the credit counters, sends transactions over the first network, and removes the selected requests from their respective queues. This system efficiently manages communication between the first and second networks, enhancing overall system performance.
1. A computing system comprising:
a first network and a second network;
a plurality of first agents coupled to the first network;
a plurality of second agents coupled to the second network; and
an interface circuit coupled between the first network and the second network, interface circuit comprising:
a plurality of request queues;
a first arbiter configured to select a request from requests for transactions on the first network received from the plurality of second agents over the second network, and enter the selected request into a request queue of the plurality of request queues;
a plurality of credit counters associated with respective first agents of the plurality of first agents; and
a second arbiter configured to choose a request from an oldest entry of each request queue of the plurality of request queues based on the plurality of credit counters, send a transaction based on the chosen request over the first network, and remove the chosen request from its respective request queue.
2. The computing system of claim 1 , the interface circuit further comprising:
queue depth check logic configured to track respective depths of the plurality of request queues and provide information about the respective depths of the plurality of request queues to the first arbiter; and
the first arbiter further configured to select the request from the received requests for transactions based on the information from the queue depth check logic.
3. The computing system of claim 1 , the interface circuit further comprising a plurality of links configured to receive, from the plurality of second agents over the second network, the requests for transactions on the first network, wherein the plurality of request queues are associated with respective links of the plurality of links.
4. The computing system of claim 3 , the first arbiter further configured to select the request from pending requests received by links in the plurality of links that have an associated request queue having a depth less than a predetermined value.
5. The computing system of claim 3 , the first arbiter further configured to select a first request received by a first link as the selected request and enter the first request into a first request queue associated with the first link only if the first request queue has a depth less than a predetermined value;
wherein the first request is included in the requests for transactions received by the plurality of links from the plurality of second agents over the second network, the first link is included in the plurality of links, and the first request queue is included in the plurality of request queues.
6. The computing system of claim 5 , wherein the predetermined value is equal to a number of locations in the first request queue.
7. The computing system of claim 1 , the interface circuit further comprising:
address translation circuitry to translate a virtual address of the selected request into a physical address and a destination ID that identifies a destination agent on the first network for the selected request, the destination agent included in the plurality of first agents; and
the first arbiter further configured to enter the physical address and the destination ID into the request queue.
8. The computing system of claim 7 , the interface circuit further comprising:
credit check logic to tag the oldest entry of each request queue of the plurality of request queues based on the destination agent identified by the destination ID entered into the respective oldest entry and a credit counter of the plurality of credit counters associated with the destination agent.
9. The computing system of claim 8 , wherein the tag indicates whether a number of available end-to-end credits for the destination agent exceeds a predetermined threshold.
10. The computing system of claim 1 , the interface circuit further comprising:
credit check logic to tag the oldest entry of each request queue of the plurality of request queues based on a destination agent on the first network of the respective request and a credit counter associated with the destination agent, wherein the tag indicates whether a number of available end-to-end credits for the destination agent exceeds a predetermined threshold.
11. The computing system of claim 10 , the second arbiter configured to choose from only those oldest entries whose tag indicates that the destination agent has a number of available end-to-end credits that exceeds the predetermined threshold.
12. The computing system of claim 1 , the second arbiter further configured to choose from the oldest entries using a round-robin arbitration scheme for the plurality of request queues.
13. The computing system of claim 1 , wherein a first credit counter of the plurality of credit counters associated with a first agent of the plurality of first agents is initialized to zero, incremented in response to sending a first transaction to the first agent over the first network, and decremented in response to receiving a token from the first agent on a credit network of the first network.
14. The computing system of claim 13 , wherein the first credit counter comprises a first request network credit counter, the first transaction is sent over a request network of the first network and the token from the first agent represents end-to-end request credits.
15. A method to arbitrate for a first network in computing system that includes the first network and a second network, a plurality of first agents coupled to the first network, a plurality of second agents coupled to the second network, and an interface circuit coupled between the first network and the second network, the interface circuit having a plurality of request queues, a plurality of credit counters associated with respective first agents of the plurality of first agents, a first arbiter, and a second arbiter, the method comprising:
receiving, at the interface circuit, requests for transactions on the first network from the plurality of second agents over the second network;
selecting, by the first arbiter, a request from the received requests for transactions;
entering the selected request into a request queue of the plurality of request queues;
choosing, by the second arbiter, a chosen request from an oldest entry of each request queue of the plurality of request queues based on the plurality of credit counters;
sending a transaction based on the chosen request over the first network; and
remove the chosen request from its respective request queue.
16. The method of claim 15 , the interface circuit including a plurality of links associated with respective request queues of the plurality of request queues, the method further comprising:
receiving the requests for transactions at the plurality of links;
selecting the request queue for the selected request based on a link of the plurality of links that received the selected request; and
using, by the first arbiter, a round-robin arbitration scheme to select the request from pending requests received by links in the plurality of links that have an associated request queue that is not full.
17. The method of claim 15 , further comprising:
translating a virtual address of the selected request into a physical address and a destination ID that identifies a destination agent on the first network for the selected request, the destination agent included in the plurality of first agents; and
entering the physical address and the destination ID into the request queue.
18. The method of claim 15 , further comprising:
tagging the oldest entry of each request queue of the plurality of request queues based on a destination agent on the first network of the respective request and a credit counter associated with the destination agent, the destination agent included in the plurality of first agents;
wherein the tag indicates whether a number of available end-to-end credits for the destination agent exceeds a predetermined threshold.
19. The method of claim 18 , further comprising:
choosing, by the second arbiter, from only those oldest entries whose tag indicates that its destination agent has a number of available end-to-end credits that exceeds the predetermined threshold.
20. The method of claim 15 , further comprising:
initializing a first credit counter of the plurality of credit counters associated with a first agent of the plurality of first agents to zero;
incrementing the first credit counter in response to sending a first transaction to the first agent over a request network of the first network; and
decrementing the first credit counter in response to receiving a token representing an end-to-end request credit from the first agent on a credit network of the first network.