Read-only file system for testing de-duplication
Disclosed herein are systems, methods, and devices for testing deduplication repositories. Methods may include identifying a storage location based on a request for one or more data values associated with a read-only file system, where the read-only file system is a simulated file system, and where the storage location is identified based on a plurality of request parameters included in the request. The methods may also include generating, using a processor and responsive to the request, the one or more data values based on the plurality of request parameters and a plurality of configuration parameters, where the plurality of configuration parameters enable deterministic generation of all data values stored in the tile system. The methods may further include returning the one or more data values as a result of the request.
1. A method, comprising:
receiving a set of configuration parameters pertaining to creating a simulated file system to configure dynamic generation of data in the simulated file system, wherein the set of configuration parameters identify a compression ratio, a deduplication rate, and a total data size associated with the simulated file system;
generating the simulated file system by generating a mount point within a storage system, wherein the mount point enables access to the simulated file system by other components, including a deduplication protocol engine and a deduplication repository;
generating test data for the simulated file system based on the set of configuration parameters, the simulated file system configured to simulate a file system that is larger than the simulated file system, wherein the configuration parameters include a seed file that includes a series of unique strings of data values that form a basis of the dynamic generation of data in the simulated file system;
identifying a storage location in which to store the test data;
causing the test data to be stored and deduplicated in the simulated file system;
retrieving at least a portion of the test data in the simulated file system;
recreating the deduplicated test data; and
verifying the recreated test data of the simulated file system prior to or in place of populating an entirety of the file system.
2. The method of claim 1 , wherein the test data are generated dynamically and based on a seed specific to the simulated file system.
3. The method of claim 2 , wherein the test data are generated utilizing a deterministic function.
4. The method of claim 3 , wherein the deterministic function is configured based on a designated deduplication rate and a designated data offset associated with the simulated file system.
5. The method of claim 4 , wherein the deterministic function is configured to generate the test data based on the compression ratio, the deduplication rate, and the seed.
6. The method of claim 1 further comprising:
receiving the set of configuration parameters at a client machine.
7. The method of claim 1 , wherein at least some of the set of configuration parameters are randomly selected.
8. A device, comprising:
a communications interface communicatively coupled with a deduplication repository; and one or more processors configured to implement a simulated file system, the one or more processors being configured to:
receive a set of configuration parameters pertaining to creating the simulated file system to configure dynamic generation of data in the simulated file system, wherein the configuration parameters include a seed file that includes a series of unique strings of data values that form a basis of the dynamic generation of data in the simulated file system, wherein the set of configuration parameters identify a compression ratio, a deduplication rate, and a total data size associated with the simulated file system;
generate the simulated file system by generating a mount point within a storage system, wherein the mount point enables access to the simulated file system by other components, including a deduplication protocol engine and a deduplication repository;
generate test data for the simulated file system based on the set of configuration parameters, the simulated file system configured to simulate a file system that is larger than the simulated file system;
identify a storage location in which to store the test data;
cause the test data to be stored and deduplicated in the simulated file system;
retrieve at least a portion of the test data in the simulated file system;
recreate the deduplicated test data; and
verify the recreated test data of the simulated file system prior to or in place of populating an entirety of the file system.
9. The device of claim 8 , wherein the test data are generated dynamically and based on a seed specific to the simulated file system.
10. The device of claim 9 , wherein the test data are generated utilizing a deterministic function, wherein the deterministic function is configured to generate the test data based on the compression ratio, the deduplication rate, and the seed.
11. The device of claim 10 , wherein the deterministic function is configured based on a designated deduplication rate and a designated data offset associated with the simulated file system.