Data storage method using internal and external source tracing regions of a magnetic disk and apparatus, and electronic device and readable storage medium
View Patent ↗The present disclosure discloses a data storing method, an apparatus, an electronic device and a readable storage medium, wherein the method includes: constructing a data region and an external source-tracing region in a magnetic disk of a distributed storage system in advance, wherein the data region and the external source-tracing region have a corresponding relation, and in an internal memory, simultaneously constructing an internal source-tracing region that corresponds to the external source-tracing region; when it is detected that the data region is written with a target datum, writing source-tracing information corresponding to the target datum into the internal source-tracing region; and downwardly swiping the data of the internal source-tracing region to the external source-tracing region, to store the source-tracing information of the data region by the external source-tracing region. Therefore, the data may be accurately and efficiently recovered, and the reason for data loss is timely determined.
1. A data storing method, comprising:
constructing a data region and an external source-tracing region in a magnetic disk of a distributed storage system in advance, wherein the data region and the external source-tracing region have a corresponding relation, and in an internal memory, simultaneously constructing an internal source-tracing region corresponding to the external source-tracing region;
when it is detected that the data region is written with a target datum, writing source-tracing information corresponding to the target datum into the internal source-tracing region; and
downwardly swiping data of the internal source-tracing region to the external source-tracing region, to store source-tracing information of the data region by the external source-tracing region.
2. The data storing method according to claim 1 , wherein after downwardly swiping the data of the internal source-tracing region to the external source-tracing region, the method further comprises:
when a data-consistency-test injection fault instruction is received, based on the corresponding relation, according to an address of the data region, calculating an address of the external source-tracing region; and
based on the address of the external source-tracing region, from the external source-tracing region, obtaining data-source information corresponding to data blocks in the data region.
3. The data storing method according to claim 1 , wherein after downwardly swiping the data of the internal source-tracing region to the external source-tracing region, the method further comprises:
when it is detected that a production environment has a fault, based on the corresponding relation, according to an address of the data region, calculating an address of the external source-tracing region; and
based on the address of the external source-tracing region, from the external source-tracing region, obtaining data-source information corresponding to data blocks in the data region.
4. The data storing method according to claim 1 , wherein after downwardly swiping the data of the internal source-tracing region to the external source-tracing region, the method further comprises:
scanning the data region; and
determining data-source information within the external source-tracing region that corresponds to each of blocks of data within the data region, and joining data that are physically discontinuous within the data region into a logical continuous datum, to perform a data-recovery operation.
5. The data storing method according to claims 1 , wherein after downwardly swiping the data of the internal source-tracing region to the external source-tracing region, the method further comprises:
when it is detected that a source-tracing-region recovering condition is satisfied, sending a source-tracing-region recovering instruction; and
based on the source-tracing-region recovering instruction, converting the external source-tracing region into the data region for storing a to-be-written datum.
6. The data storing method according to claim 5 , wherein when it is detected that the source-tracing-region recovering condition is satisfied, sending the source-tracing-region recovering instruction comprises:
in response to that a residual-space-capacity value of the data region is less than a preset capacity threshold, determining that the source-tracing-region recovering condition is satisfied; and in response to that the residual-space-capacity value of the data region is greater than or equal to the preset capacity threshold, determining that the source-tracing-region recovering condition is not satisfied.
7. The data storing method according to claim 5 , wherein when it is detected that the source-tracing-region recovering condition is satisfied, sending the source-tracing-region recovering instruction comprises:
in response to that a disk-space utilization ratio is greater than a preset threshold, determining that the source-tracing-region recovering condition is satisfied; and in response to that the disk-space utilization ratio is less than or equal to the preset capacity threshold, determining that the source-tracing-region recovering condition is not satisfied.
8. The data storing method according to claim 1 , wherein the source-tracing information is used to describe attribute information of a datum that is actually written.
9. The data storing method according to claim 1 , wherein the source-tracing information comprises a serial number of data writing, a value of an occupied space capacity and a storage position.
10. The data storing method according to claim 1 , wherein the data region is used to store a datum that is actually written.
11. An electronic device, wherein the electronic device comprises a processor and a memory, and the processor is configured for, when executing a computer program stored in the memory, implementing the steps of the data storing method according to claims 1 .
12. The electronic device according to claim 11 , wherein after downwardly swiping the data of the internal source-tracing region to the external source-tracing region, the method further comprises:
when a data-consistency-test injection fault instruction is received, based on the corresponding relation, according to an address of the data region, calculating an address of the external source-tracing region; and
based on the address of the external source-tracing region, from the external source-tracing region, obtaining data-source information corresponding to data blocks in the data region.
13. The electronic device according to claim 11 , wherein after downwardly swiping the data of the internal source-tracing region to the external source-tracing region, the method further comprises:
when it is detected that a production environment has a fault, based on the corresponding relation, according to an address of the data region, calculating an address of the external source-tracing region; and
based on the address of the external source-tracing region, from the external source-tracing region, obtaining data-source information corresponding to data blocks in the data region.
14. The electronic device according to claim 11 , wherein after downwardly swiping the data of the internal source-tracing region to the external source-tracing region, the method further comprises:
scanning the data region; and
determining data-source information within the external source-tracing region that corresponds to each of blocks of data within the data region, and joining data that are physically discontinuous within the data region into a logical continuous datum, to perform a data-recovery operation.
15. The electronic device according to claim 11 , wherein after downwardly swiping the data of the internal source-tracing region to the external source-tracing region, the method further comprises:
when it is detected that a source-tracing-region recovering condition is satisfied, sending a source-tracing-region recovering instruction; and
based on the source-tracing-region recovering instruction, converting the external source-tracing region into the data region for storing a to-be-written datum.
16. The electronic device according to claim 15 , wherein when it is detected that the source-tracing-region recovering condition is satisfied, sending the source-tracing-region recovering instruction comprises:
in response to that a residual-space-capacity value of the data region is less than a preset capacity threshold, determining that the source-tracing-region recovering condition is satisfied; and in response to that the residual-space-capacity value of the data region is greater than or equal to the preset capacity threshold, determining that the source-tracing-region recovering condition is not satisfied.
17. The electronic device according to claim 15 , wherein when it is detected that the source-tracing-region recovering condition is satisfied, sending the source-tracing-region recovering instruction comprises:
in response to that a disk-space utilization ratio is greater than a preset threshold, determining that the source-tracing-region recovering condition is satisfied; and in response to that the disk-space utilization ratio is less than or equal to the preset capacity threshold, determining that the source-tracing-region recovering condition is not satisfied.
18. A non-transitory readable storage medium, wherein the non-transitory readable storage medium stores a computer program, and the computer program, when executed by a processor, implements the steps of the data storing method according to claims 1 .
19. The non-transitory readable storage medium according to claim 18 , wherein after downwardly swiping the data of the internal source-tracing region to the external source-tracing region, the method further comprises:
when a data-consistency-test injection fault instruction is received, based on the corresponding relation, according to an address of the data region, calculating an address of the external source-tracing region; and
based on the address of the external source-tracing region, from the external source-tracing region, obtaining data-source information corresponding to data blocks in the data region.
20. The non-transitory readable storage medium according to claim 18 , wherein after downwardly swiping the data of the internal source-tracing region to the external source-tracing region, the method further comprises:
when it is detected that a production environment has a fault, based on the corresponding relation, according to an address of the data region, calculating an address of the external source-tracing region; and
based on the address of the external source-tracing region, from the external source-tracing region, obtaining data-source information corresponding to data blocks in the data region.