Method, device and computer program product for flushing metadata in multi-core system
Embodiments of the present disclosure provide a method, device and computer program product for flushing metadata in a multi-core system. The method comprises: moving a metadata identifier included in a sub-list of a first list to a corresponding sub-list of a second list, the sub-list of the first list and the corresponding sub-list of the second list being associated with the same processing unit; moving the metadata identifier from the corresponding sub-list of the second list to a third list based on a storage position of the metadata identifier; and determining metadata to be flushed from the third list to a metadata repository. By means of the method and device for flushing metadata as proposed in the present disclosure, metadata synchronization contention can be reduced, IO efficiency can be improved, response time can be decreased, and the cache hit can be increased.
1. A method of flushing metadata, comprising:
removing a metadata identifier included in a sub-list of a first list to a corresponding sub-list of a second list, the sub-list of the first list and the corresponding sub-list of the second list being associated with the same processing unit;
removing the metadata identifiers from the corresponding sub-list of the second list to a third list based on a storage position of the metadata identifier; and
determining metadata to be flushed from the third list to a metadata repository;
wherein removing the metadata identifiers from the corresponding sub-list of the second list to a third list comprises determining metadata identifiers to be removed to the third list based on at least one of a utilization efficiency of a cache associated with metadata and a predefined flush sequence of the metadata.
2. The method according to claim 1 , wherein removing a metadata identifier to a corresponding sub-list of a second list comprises:
in response to at least one of a plurality of trigger conditions being satisfied, removing the metadata identifier included in a sub-list of a first list to a corresponding sub-list of a second list, the trigger conditions comprising:
a utilization efficiency of a log system for recording metadata flushes exceeding a first threshold;
a utilization efficiency of a cache associated with metadata exceeding a second threshold; and
a predefined time interval being reached.
3. The method according to claim 1 , wherein removing the metadata identifiers from the corresponding sub-list of the second list to a third list comprises:
determining a number of metadata identifiers to be removed to the third list according to a utilization efficiency of a cache associated with metadata;
obtaining a predefined flush sequence of the metadata from a log system for recording metadata flushes; and
determining the metadata identifiers to be removed to the third list based on the predefined flush sequence of the metadata and the number.
4. The method according to claim 3 , wherein determining the metadata identifiers to be removed to the third list comprises:
determining the number of metadata to be flushed first based on the predefined flush sequence of the metadata; and
determining the metadata identifiers corresponding to the determined metadata as the metadata identifiers to be removed to the third list.
5. The method according to claim 1 , wherein determining metadata to be flushed from the third list to a metadata repository comprises:
obtaining a predefined flush sequence of the metadata from a log system for recording metadata flushes; and
grouping the metadata identifiers in the third list based on the predefined flush sequence of the metadata, each group of metadata identifiers comprising one or more metadata identifiers, metadata corresponding to the one or more metadata identifiers having a predefined flush sequence within a threshold range; and
flushing metadata corresponding to each group of metadata identifiers to the metadata repository.
6. A device for flushing metadata, comprising:
at least one processor; and
a memory coupled to the at least one processor and comprising instructions stored thereon, the instructions, when executed by the at least one processor, causing the device to perform acts comprising:
removing a metadata identifier included in a sub-list of a first list to a corresponding sub-list of a second list, the sub-list of the first list and the corresponding sub-list of the second list being associated with the same processing unit;
removing the metadata identifiers from the corresponding sub-list of the second list to a third list based on a storage position of the metadata identifier; and
determining metadata to be flushed from the third list to a metadata repository;
wherein removing the metadata identifiers from the corresponding sub-list of the second list to a third list comprises determining metadata identifiers to be removed to the third list based on at least one of a utilization efficiency of a cache associated with metadata and a predefined flush sequence of the metadata.
7. The device according to claim 6 , wherein removing a metadata identifier to a corresponding sub-list of a second list comprises:
in response to at least one of a plurality of trigger conditions being satisfied, removing the metadata identifier included in a sub-list of a first list to a corresponding sub-list of a second list, the trigger conditions comprising:
a utilization efficiency of a log system for recording metadata flushes exceeding a first threshold;
a utilization efficiency of a cache associated with metadata exceeding a second threshold; and
a predefined time interval being reached.
8. The device according to claim 6 , wherein removing the metadata identifier from the corresponding sub-list of the second list to a third list comprises:
determining the a number of metadata identifiers to be removed to the third list according to a utilization efficiency of a cache associated with metadata;
obtaining a predefined flush sequence of the metadata from a log system for recording metadata flushes; and
determining the metadata identifier to be removed to the third list based on the predefined flush sequence of the metadata and the number.
9. The device according to claim 8 , wherein determining the metadata identifiers to be removed to the third list comprises:
determining the number of metadata to be flushed first based on the predefined flush sequence of the metadata; and
determining the metadata identifiers corresponding to the determined metadata as the metadata identifiers to be removed to the third list.
10. The device according to claim 6 , wherein determining metadata to be flushed from the third list to a metadata repository comprises:
obtaining a predefined flush sequence of the metadata from a log system for recording metadata flushes; and
grouping the metadata identifiers in the third list based on the predefined flush sequence of the metadata, each group of metadata identifiers comprising one or more metadata identifiers, metadata corresponding to the one or more metadata identifiers having a predefined flush sequence within a threshold range; and
flushing metadata corresponding to each group of metadata identifiers to the metadata repository.
11. A computer program product being tangibly stored on a non-transient computer readable medium and comprising machine executable instructions which, when executed, cause a machine to perform steps of:
removing a metadata identifier included in a sub-list of a first list to a corresponding sub-list of a second list, the sub-list of the first list and the corresponding sub-list of the second list being associated with the same processing unit;
removing the metadata identifiers from the corresponding sub-list of the second list to a third list based on a storage position of the metadata identifier; and
determining metadata to be flushed from the third list to a metadata repository;
wherein removing the metadata identifiers from the corresponding sub-list of the second list to a third list comprises determining metadata identifiers to be removed to the third list based on at least one of a utilization efficiency of a cache associated with metadata and a predefined flush sequence of the metadata.
12. The computer program product according to claim 11 , wherein removing a metadata identifier to a corresponding sub-list of a second list comprises:
in response to at least one of a plurality of trigger conditions being satisfied, removing the metadata identifier included in a sub-list of a first list to a corresponding sub-list of a second list, the trigger conditions comprising:
a utilization efficiency of a log system for recording metadata flushes exceeding a first threshold;
a utilization efficiency of a cache associated with metadata exceeding a second threshold; and
a predefined time interval being reached.
13. The computer program product according to claim 11 , wherein removing the metadata identifiers from the corresponding sub-list of the second list to a third list comprises:
determining a number of metadata identifiers to be removed to the third list according to a utilization efficiency of a cache associated with metadata;
obtaining a predefined flush sequence of the metadata from a log system for recording metadata flushes; and
determining the metadata identifiers to be removed to the third list based on the predefined flush sequence of the metadata and the number.
14. The computer program product according to claim 13 , wherein determining the metadata identifiers to be removed to the third list comprises:
determining the number of metadata to be flushed first based on the predefined flush sequence of the metadata; and
determining the metadata identifiers corresponding to the determined metadata as the metadata identifiers to be removed to the third list.
15. The computer program product according to claim 11 , wherein determining metadata to be flushed from the third list to a metadata repository comprises:
obtaining a predefined flush sequence of the metadata from a log system for recording metadata flushes; and
grouping the metadata identifiers in the third list based on the predefined flush sequence of the metadata, each group of metadata identifiers comprising one or more metadata identifiers, metadata corresponding to the one or more metadata identifiers having a predefined flush sequence within a threshold range; and
flushing metadata corresponding to each group of metadata identifiers to the metadata repository.
16. The computer program product of claim 11 wherein said same processing unit comprises a first one of a plurality of processing cores of a multi-core system and wherein each of one or more other processing units comprises a different one of the plurality of processing cores of the multi-core system.
17. The computer program product of claim 16 wherein the first list comprises a plurality of sub-lists corresponding to respective ones of the processing units that comprise respective processing cores of the multi-core system, and further wherein the second list comprises a plurality of sub-lists corresponding to respective ones of the sub-lists of the first list.
18. The method of claim 1 wherein said same processing unit comprises a first one of a plurality of processing cores of a multi-core system and wherein each of one or more other processing units comprises a different one of the plurality of processing cores of the multi-core system.
19. The method of claim 18 wherein the first list comprises a plurality of sub-lists corresponding to respective ones of the processing units that comprise respective processing cores of the multi-core system, and further wherein the second list comprises a plurality of sub-lists corresponding to respective ones of the sub-lists of the first list.
20. The device of claim 6 wherein said same processing unit comprises a first one of a plurality of processing cores of a multi-core system and wherein each of one or more other processing units comprises a different one of the plurality of processing cores of the multi-core system.