Systems and methods for controlling completion rate of commands
A controller of a memory system controls a completion rate of commands. The controller receives, from a host, command requests to be processed on a memory device. The controller processes the command requests, determines a first number of completion notifications, which are to be transmitted to the host in a first time interval, among multiple completion notifications associated with the command requests, based on a throughput credit, a set maximum credit, and the number of the multiple completion notifications. The controller transmits, to the host, the first number of completion notifications in the first time interval, and transmits a second number of completion notifications in the second time interval.
1. A data processing system comprising:
a host; and
a memory system including a controller and a memory device, the controller suitable for:
receiving, from the host, command requests to be processed on the memory device;
processing the command requests;
determining a first number of completion notifications, which are to be transmitted to the host in a first time interval, among multiple completion notifications associated with the command requests, based on a throughput credit and a number of the multiple completion notifications; and
transmitting, to the host, the first number of completion notifications in the first time interval, and transmitting, to the host, a second number of completion notifications among the multiple completion notifications in the second time interval subsequent to the first time interval,
wherein the first number of completion notifications transmitted in the first time interval and the second number of completion notifications transmitted in the second time interval comprise a target throughput for the memory controlled by the throughput credit.
2. The data processing system of claim 1 , wherein the controller determines the first number of completion notifications, the first number corresponding to at least one of a lowest value among the throughput credit, a set maximum credit, and the number of the multiple completion notifications.
3. The data processing system of claim 2 , wherein the throughput credit is adjusted by a set credit amount, based on one of the processing of the command requests and the transmitting of the first number of completion notifications and the second number of completion notifications.
4. The data processing system of claim 3 , wherein the throughput credit is increased by the set credit amount in response to the processing of the command requests.
5. The data processing system of claim 3 , wherein the throughput credit is decreased by the set credit amount in response to the transmitting of each of the first number of completion notifications and the second number of completion notifications.
6. The data processing system of claim 3 , wherein the set credit amount is adjusted, based on an average occupancy time in a queue for the multiple completion notifications.
7. The data processing system of claim 6 , wherein the set credit amount is increased when the average occupancy time is greater than a set target upper occupancy.
8. The data processing system of claim 6 , wherein the set credit amount is decreased when the average occupancy time is less than a set target lower occupancy.
9. The data processing system of claim 3 , wherein the set credit amount is increased in response to a throughput increase event.
10. The data processing system of claim 3 , wherein the set credit amount is decreased in response to a throughput decrease event.
11. A method for operating a data processing system, which includes a host and a memory system including a controller and a memory device, the method comprising:
receiving, from the host, command requests to be processed on the memory device;
processing the command requests;
determining a first number of completion notifications, which are to be transmitted to the host in a first time interval, among multiple completion notifications associated with the command requests, based on a throughput credit and a number of the multiple completion notifications; and
transmitting, to the host, the first number of completion notifications in the first time interval, and transmitting, to the host, a second number of completion notifications among the multiple completion notifications in the second time interval subsequent to the first time interval,
wherein the first number of completion notifications transmitted in the first time interval and the second number of completion notifications transmitted in the second time interval comprise a target throughput for the memory controlled by the throughput credit.
12. The method of claim 11 , wherein the determining of the first number of completion notifications comprises determining the first number of completion notifications, the first number corresponding to at least one of a lowest value among the throughput credit, a set maximum credit, and the number of the multiple completion notifications.
13. The method of claim 12 , wherein the throughput credit is adjusted by a set credit amount, based on one of the processing of the command requests and the transmitting of the first number of completion notifications and the second number of completion notifications.
14. The method of claim 13 , wherein the throughput credit is increased by the set credit amount in response to the processing of the command requests.
15. The method of claim 13 , wherein the throughput credit is decreased by the set credit amount in response to the transmitting of each of the first number of completion notifications and the second number of completion notifications.
16. The method of claim 13 , wherein the set credit amount is adjusted, based on an average occupancy time in a queue for the multiple completion notifications.
17. The method of claim 16 , wherein the set credit amount is increased when the average occupancy time is greater than a set target upper occupancy.
18. The method of claim 16 , wherein the set credit amount is decreased when the average occupancy time is less than a set target lower occupancy.
19. The method of claim 13 , wherein the set credit amount is increased in response to a throughput increase event.
20. The method of claim 13 , wherein the set credit amount is decreased in response to a throughput decrease event.