Hyper-converged infrastructure (HCI) log system
A Hyper-Converged Infrastructure (HCI) system that includes a plurality of HCI log generating components and an HCI storage system that provides at least a portion of a log database. The HCI system receives a request from a management system to store a first log bundle of the plurality of HCI log generating components and determines the at least one second log bundle that is stored in the log database is at least a size threshold. The HCI system performs a log database clean operation on the at least one second log bundle and determines that the log database clean operation on the at least one second log bundle has provided an available storage capacity in the log database that is sufficient to store the first log bundle. The HCI system then stores the first log bundle in the log database.
1. A Hyper-Converged Infrastructure (HCI) log system, comprising:
a management system; and
an HCI system that includes:
a plurality of HCI log generating components; and
an HCI storage system that provides at least a portion of a log database, wherein the HCI system is configured to:
receive a request from the management system to store a first log bundle, wherein the first log bundle includes log files generated by each of the plurality of the HCI log generating components;
determine whether at least one second log bundle that is stored in the log database is at least a size threshold
perform, in response to determining that the at least one second log bundle is at least the size threshold, a log database clean operation on the at least one second log bundle that includes:
calculating a deleted log file size of at least one log file that is included in the at least one second log bundle and that is to be deleted;
identifying a factor weight for each at least one log file that is included in the at least one second log bundle;
adding log files included in the at least one second log bundle to a delete list based on the factor weight for each log file until a delete list size of the delete list is at least the deleted log file size; and
deleting the log files included on the delete list;
determine whether the log database clean operation on the at least one second log bundle has provided an available storage capacity in the log database that is sufficient to store the first log bundle; and
store, in response to determining that the log database clean operation on the at least one second log bundle has provided an available storage capacity in the log database that is sufficient to store the first log bundle, the first log bundle in the log database.
2. The system of claim 1 , wherein the HCI system is configured to:
provide, in response to determining that the log database clean operation on the at least one second log bundle has not provided an available storage capacity in the log database that is sufficient to store the first log bundle, an insufficient log storage notification to the management system.
3. The system of claim 1 , wherein the determining that the log database clean operation on the at least one second log bundle has not provided an available storage capacity in the log database that is sufficient to store the first log bundle includes at least one of:
determining that the log database clean operation on the at least one second log bundle has not reduced the size of the at least one second log bundle such that the size of the at least one second log bundle still is at least the size threshold; and
determining that the log database clean operation on the at least one second log bundle has reduced the size of the at least one second log bundle to be below the size threshold but has not provided the available storage capacity in the log database that is sufficient to store the first log bundle.
4. The system of claim 1 , wherein the HCI system is configured to:
determine, in response to determining that the at least one second log bundle in the log database is below the size threshold, whether the log database includes the available storage capacity that is sufficient to store the first log bundle; and
store, in response to determining that the log database includes the available storage capacity that is sufficient to store the first log bundle, the first log bundle in the log database.
5. The system of claim 1 , wherein the deleted log file size of the at least one log file that is included in second log bundle and that is to be deleted is the larger of (1) the available storage capacity that is sufficient to store the first log bundle, and (2) the difference of a log file size of the at least one second log bundle and the size threshold.
6. The system of claim 1 , wherein the factor weight is based on at least one of a log component priority, a log generated time tag, a log size, and a container running status.
7. An Information Handling System (IHS), comprising:
a storage system that provides at least a portion of a log database;
a plurality of log generating components;
a processing system coupled to the storage system and the plurality of log generating components; and
a memory system that is coupled to the processing system and that includes instructions that, when executed by the processing system cause the processing system to provide a log management engine that is configured to:
receive a request to store a first log bundle, wherein the first log bundle includes log files generated by each of the plurality of log generating components;
determine whether at least one second log bundle that is stored in the log database is at least a size threshold;
perform, in response to determining that the at least one second log bundle is at least the size threshold, a log database clean operation on the at least one second log bundle that includes:
calculating a deleted log file size of at least one log file that is included in the at least one second log bundle and that is to be deleted;
identifying a factor weight for each at least one log file that is included in the at least one second log bundle;
adding log files included in the at least one second log bundle to a delete list based on the factor weight for each log file until a delete list size of the delete list is at least the deleted log file size; and
deleting the log files included on the delete list;
determine whether the log database clean operation on the at least one second log bundle has provided an available storage capacity in the log database that is sufficient to store the first log bundle; and
store, in response to determining that the log database clean operation on the at least one second log bundle has provided an available storage capacity in the log database that is sufficient to store the first log bundle, the first log bundle in the log database.
8. The IHS of claim 7 , wherein the log management engine is configured to:
provide, in response to determining that the log database clean operation on the at least one second log bundle has not provided an available storage capacity in the log database that is sufficient to store the first log bundle, an insufficient log storage notification.
9. The IHS of claim 7 , wherein the determining that the log database clean operation on the at least one second log bundle has not provided an available storage capacity in the log database that is sufficient to store the first log bundle includes at least one of:
determining that the log database clean operation on the at least one second log bundle has not reduced the size of the at least one second log bundle such that the size of the at least one second log bundle still is at least the size threshold; and
determining that the log database clean operation on the at least one second log bundle has reduced the size of the at least one second log bundle to be below the size threshold but has not provided the available storage capacity in the log database that is sufficient to store the first log bundle.
10. The IHS of claim 7 , wherein the log management engine is configured to:
determine, in response to determining that the at least one second log bundle in the log database is below the size threshold, whether the log database includes the available storage capacity that is sufficient to store the first log bundle; and
store, in response to determining that the log database includes the available storage capacity that is sufficient to store the first log bundle, the first log bundle in the log database.
11. The IHS of claim 7 , wherein the deleted log file size of the at least one log file that is included in second log bundle and that is to be deleted is the larger of (1) the available storage capacity that is sufficient to store the first log bundle, and (2) the difference of a log file size of the at least one second log bundle and the size threshold.
12. The IHS of claim 7 , wherein the factor weight is based on at least one of a log component priority, a log generated time tag, a log size, and a container running status.
13. A method for storing log files in a Hyper-Converged Infrastructure (HCI) system, comprising:
receiving, by a server device, a request to store a first log bundle in a log database a portion of which is located in a storage system of the server device, wherein the first log bundle includes log files generated by each of a plurality of HCI log generating components;
determining, by the server device, whether at least one second log bundle that is stored in the log database is at least a size threshold;
performing, by the server device in response to determining that the at least one second log bundle is at least the size threshold, a log database clean operation on the at least one second log bundle that includes:
calculating a deleted log file size of at least one log file that is included in the at least one second log bundle and that is to be deleted;
identifying a factor weight for each at least one log file that is included in the at least one second log bundle;
adding log files included in the at least one second log bundle to a delete list based on the factor weight for each log file until a delete list size of the delete list is at least the deleted log file size; and
deleting the log files included on the delete list;
determining, by the server device, whether the log database clean operation on the at least one second log bundle has provided an available storage capacity in the log database that is sufficient to store the first log bundle; and
storing, by the server device in response to determining that the log database clean operation on the at least one second log bundle has provided an available storage capacity in the log database that is sufficient to store the first log bundle, the first log bundle in the log database.
14. The method of claim 13 , further comprising:
providing, by the server device in response to determining that the log database clean operation on the at least one second log bundle has not provided an available storage capacity in the log database that is sufficient to store the first log bundle, an insufficient log storage notification.
15. The method of claim 13 , wherein the determining, by the server device, that the log database clean operation on the at least one second log bundle has not provided an available storage capacity in the log database that is sufficient to store the first log bundle includes at least one of:
determining that the log database clean operation on the at least one second log bundle has not reduced the size of the at least one second log bundle such that the size of the at least one second log bundle still is at least the size threshold; and
determining that the log database clean operation on the at least one second log bundle has reduced the size of the at least one second log bundle to be below the size threshold but has not provided the available storage capacity in the log database that is sufficient to store the first log bundle.
16. The method of claim 13 , further comprising:
determining, by the server device and in response to determining that the at least one second log bundle in the log database is below the size threshold, whether the log database includes the available storage capacity that is sufficient to store the first log bundle; and
store, by the server device and in response to determining that the log database includes the available storage capacity that is sufficient to store the first log bundle, the first log bundle in the log database.
17. The method of claim 13 , wherein the deleted log file size of the at least one log file that is included in second log bundle and that is to be deleted is the larger of (1) the available storage capacity that is sufficient to store the first log bundle, and (2) the difference of a log file size of the at least one second log bundle and the size threshold.