Granted Patent B2

US 11,663,165 · App. 17/077,010 · Granted May 30, 2023

Inventors: Chaojun Zhao (Chengdu, CN); Jia Huang (Chengdu, CN); Hongyuan Zeng (Chengdu, CN); Hao Wang (Chengdu, CN); Mingyi Luo (Chengdu, CN)

Assignee: EMC IP Holding Company LLC

G06F16/1744G06F16/13

Abstract

Claims (94)

1. A method for managing a file system comprising:

causing multiple data blocks to be written to a storage space of the file system, a size of each of the multiple data blocks being greater than or equal to a threshold size; and

causing creation of space fragments in the storage space, the size of each of the space fragments not exceeding the threshold size, the space fragments comprising discontinuous spaces in the storage space;

wherein the space fragments are created based on:

repeatedly compressing a plurality of given written data blocks to a target size not exceeding the threshold size so that data cannot be further written to the created plurality of space fragments thereby aging the file system for performing a test of the aged file system through a plurality of test cases, wherein each of the repeated compressing is performed at a different compression rate;

wherein the created plurality of space fragments do not comprise compressed data blocks; and

wherein repeatedly compressing given written data blocks comprises:

compressing a first data block of the multiple data blocks at a first compression rate to obtain a first compressed data block;

writing the first compressed data block to a first subspace in the storage space;

removing the first compressed data block from the first subspace;

compressing the first compressed data block at a second compression rate to obtain a second compressed data block, the first compression rate being less than the second compression rate; and

writing the second compressed data block to the first subspace to create a first space fragment.

2. The method according to claim 1 , further comprising:

writing a second data block of the multiple data blocks to a second subspace in the storage space;

compressing a third data block of the multiple data blocks at a third compression rate to obtain a third compressed data block; and

writing the third compressed data block to a third subspace in the storage space, the size of the second data block being greater than that of the third data block, and the second subspace and the third subspace being not adjacent.

3. The method according to claim 2 , further comprising:

removing the second data block from the second subspace;

compressing the third compressed data block at a fourth compression rate to obtain a fourth compressed data block, the fourth compression rate being less than the third compression rate; and

writing the fourth compressed data block to the second subspace.

4. The method according to claim 3 , further comprising:

causing the third compressed data block to be removed from the third subspace.

5. The method according to claim 1 , further comprising:

determining the performance of the file system after the space fragments are created, the performance including at least one of: a response time of the file system; an average bandwidth for the file system to read/write data; the number of read and write operations performed by the file system per second; and a failure rate of the file system.

6. An electronic device for managing a file system comprising:

at least one processing unit; and

at least one memory which is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit, wherein the instructions, when executed by the at least one processing unit, cause the electronic device to perform actions comprising:

causing multiple data blocks to be written to a storage space of the file system, a size of each of the multiple data blocks being greater than or equal to a threshold size; and

causing creation of space fragments in the storage space, the size of each of the space fragments not exceeding the threshold size, the space fragments comprising discontinuous spaces in the storage space;

wherein the space fragments are created based on:

repeatedly compressing a plurality of given written data blocks to a target size not exceeding the threshold size so that data cannot be further written to the created plurality of space fragments thereby aging the file system for performing a test of the aged file system through a plurality of test cases, wherein each of the repeated compressing is performed at a different compression rate;

wherein the created plurality of space fragments do not comprise compressed data blocks; and

wherein repeatedly compressing given written data blocks comprises:

compressing a first data block of the multiple data blocks at a first compression rate to obtain a first compressed data block;

writing the first compressed data block to a first subspace in the storage space;

removing the first compressed data block from the first subspace;

compressing the first compressed data block at a second compression rate to obtain a second compressed data block, the first compression rate being less than the second compression rate; and

writing the second compressed data block to the first subspace to create a first space fragment.

7. The electronic device according to claim 6 , wherein the size of each of the multiple data blocks is a preset size.

8. The electronic device according to claim 6 , further comprising:

writing a second data block of the multiple data blocks to a second subspace in the storage space;

compressing a third data block of the multiple data blocks at a third compression rate to obtain a third compressed data block; and

writing the third compressed data block to a third subspace in the storage space, the size of the second data block being greater than that of the third data block, and the second subspace and the third subspace being not adjacent.

9. The electronic device according to claim 8 , further comprising:

removing the second data block from the second subspace;

compressing the third compressed data block at a fourth compression rate to obtain a fourth compressed data block, the fourth compression rate being less than the third compression rate; and

writing the fourth compressed data block to the second subspace.

10. The electronic device according to claim 9 , further comprising:

causing the third compressed data block to be removed from the third subspace.

11. The electronic device according to claim 6 , further comprising:

determining the performance of the file system after the space fragments are created, the performance including at least one of: a response time of the file system; an average bandwidth for the file system to read/write data; the number of read and write operations performed by the file system per second; and a failure rate of the file system.

12. A computer program product tangibly stored in a non-transitory computer-readable medium and including machine-executable instructions for managing a file system, wherein the machine-executable instructions, when executed, cause a machine to perform steps of:

causing multiple data blocks to be written to a storage space of the file system, a size of each of the multiple data blocks being greater than or equal to a threshold size; and

causing creation of space fragments in the storage space, the size of each of the space fragments not exceeding the threshold size, the space fragments comprising discontinuous spaces in the storage space;

wherein the space fragments are created based on:

repeatedly compressing a plurality of given written data blocks to a target size not exceeding the threshold size so that data cannot be further written to the created plurality of space fragments thereby aging the file system for performing a test of the aged file system through a plurality of test cases, wherein each of the repeated compressing is performed at a different compression rate;

wherein the created plurality of space fragments do not comprise compressed data blocks; and

wherein repeatedly compressing given written data blocks comprises:

compressing a first data block of the multiple data blocks at a first compression rate to obtain a first compressed data block;

writing the first compressed data block to a first subspace in the storage space;

removing the first compressed data block from the first subspace;

compressing the first compressed data block at a second compression rate to obtain a second compressed data block, the first compression rate being less than the second compression rate; and

writing the second compressed data block to the first subspace to create a first space fragment.

13. The computer program product according to claim 12 , wherein the size of each of the multiple data blocks is a preset size.

14. The computer program product according to claim 12 , further comprising:

writing a second data block of the multiple data blocks to a second subspace in the storage space;

compressing a third data block of the multiple data blocks at a third compression rate to obtain a third compressed data block; and

writing the third compressed data block to a third subspace in the storage space, the size of the second data block being greater than that of the third data block, and the second subspace and the third subspace being not adjacent.

15. The computer program product according to claim 14 , further comprising:

removing the second data block from the second subspace;

compressing the third compressed data block at a fourth compression rate to obtain a fourth compressed data block, the fourth compression rate being less than the third compression rate; and

writing the fourth compressed data block to the second subspace.

16. The computer program product according to claim 15 , further comprising:

causing the third compressed data block to be removed from the third subspace.

17. The computer program product according to claim 12 , further comprising:

determining the performance of the file system after the space fragments are created, the performance including at least one of: a response time of the file system; an average bandwidth for the file system to read/write data; the number of read and write operations performed by the file system per second; and a failure rate of the file system.

18. The computer program product according to claim 12 , further comprising:

compressing a third data block of the multiple data blocks at a third compression rate to obtain a fourth compressed data block;

writing the fourth compressed data block to a second subspace in the storage space;

removing the fourth compressed data block from the second subspace;

compressing the fourth compressed data block at a fourth compression rate to obtain a fifth compressed data block, the third compression rate being less than the fourth compression rate; and

writing the fifth compressed data block to the second subspace to create a second space fragment.

19. The electronic device according to claim 6 , further comprising:

compressing a third data block of the multiple data blocks at a third compression rate to obtain a fourth compressed data block;

writing the fourth compressed data block to a second subspace in the storage space;

removing the fourth compressed data block from the second subspace;

compressing the fourth compressed data block at a fourth compression rate to obtain a fifth compressed data block, the third compression rate being less than the fourth compression rate; and

writing the fifth compressed data block to the second subspace to create a second space fragment.

20. The method according to claim 1 , further comprising:

compressing a third data block of the multiple data blocks at a third compression rate to obtain a fourth compressed data block;

writing the fourth compressed data block to a second subspace in the storage space;

removing the fourth compressed data block from the second subspace;

compressing the fourth compressed data block at a fourth compression rate to obtain a fifth compressed data block, the third compression rate being less than the fourth compression rate; and

writing the fifth compressed data block to the second subspace to create a second space fragment.

Assignments (9)