Auto unload
A system for unloading tables of a database is provided. In some aspects, the system performs operations including determining that a number of accesses to a table occurring within a time period has satisfied an access threshold. The operations may further include identifying, in response to the determining, a first timestamp indicating a most recent access to the table. The operations may further include determining whether a difference between a current timestamp and the first timestamp satisfies a first time threshold. The operations may further include comparing, in response to the difference satisfying the first time threshold, a ratio of the difference and a size of the table to a ratio threshold. The operations may further include unloading, in response to satisfying the ratio threshold, the table. The operations may further include adjusting, based on the feedback, the first time threshold and/or the ratio threshold.
1. A system, comprising:
at least one data processor; and
at least one memory storing instructions which, when executed by the at least one data processor, result in operations comprising:
determining a difference between a current timestamp and a first timestamp satisfies a first time threshold, wherein the first timestamp corresponds to a most recent access to a table;
comparing, in response to the difference satisfying the first time threshold, a ratio of the difference and a size of the table to a ratio threshold; and
unloading, in response to satisfying the ratio threshold, the table from a database.
2. The system of claim 1 , wherein the operations further comprise: retrieving feedback indicating a second time period between the unloading of the table and a reloading of the table.
3. The system of claim 2 further comprising:
calculating a second difference between a second timestamp associated with the unloading and a third timestamp associated with the reloading.
4. The system of claim 3 further comprising:
determining, based on a comparison of the second difference to a second time threshold, whether the unloading was correct.
5. The system of claim 4 , wherein the feedback comprises the determination of whether the unloading was correct.
6. The system of claim 5 , further comprising:
determining, in response to the second difference being greater than the second time threshold, that the unloading was correct; and
determining, in response to the second difference being less than the second time threshold, that the unloading was incorrect.
7. The system of claim 1 , wherein the unloading is based on a table unload priority and a table preload setting.
8. The system of claim 2 , wherein the first timestamp, the current timestamp, the first time threshold, the ratio threshold, and the feedback are inputs to a machine learning model.
9. The system of claim 8 , wherein the unloading is based on an unload decision provided by the machine learning model.
10. The system of claim 8 , further comprising:
training the machine learning model to make the decision regarding the unloading.
11. The system of claim 1 , wherein the ratio threshold is associated with a table lock delay.
12. The system of claim 1 , wherein the database is stored at a cloud server.
13. A method comprising:
determining a difference between a current timestamp and a first timestamp satisfies a first time threshold, wherein the first timestamp corresponds to a most recent access to a table;
comparing, in response to the difference satisfying the first time threshold, a ratio of the difference and a size of the table to a ratio threshold; and
unloading, in response to satisfying the ratio threshold, the table from a database.
14. The method of claim 13 , further comprising: retrieving feedback indicating a second time period between the unloading of the table and a reloading of the table.
15. The method of claim 14 further comprising:
calculating a second difference between a second timestamp associated with the unloading and a third timestamp associated with the reloading.
16. The method of claim 15 further comprising:
determining, based on a comparison of the second difference to a second time threshold, whether the unloading was correct.
17. The method of claim 16 , wherein the feedback comprises the determination of whether the unloading was correct.
18. The method of claim 17 , further comprising:
determining, in response to the second difference being greater than the second time threshold, that the unloading was correct; and
determining, in response to the second difference being less than the second time threshold, that the unloading was incorrect.
19. The method of claim 13 , wherein the unloading is based on a table unload priority and a table preload setting.
20. The method of claim 14 , wherein the first timestamp, the current timestamp, the first time threshold, the ratio threshold, and the feedback are inputs to a machine learning model, wherein the unloading is based on an unload decision provided by the machine learning model.
21. A non-transitory computer readable medium storing instructions which, when executed by at least one processor, cause operations comprising:
determining a difference between a current timestamp and a first timestamp satisfies a first time threshold, wherein the first timestamp corresponds to a most recent access to a table;
comparing, in response to the difference satisfying the first time threshold, a ratio of the difference and a size of the table to a ratio threshold; and
unloading, in response to satisfying the ratio threshold, the table from a database.