Generating a data stream with configurable compression
One example method includes receiving a mixed data stream that was created using a first data stream and a second data stream, the mixed data stream having a compressibility of N, where N is a compressibility merging parameter, and the mixed data stream has a compressibility that is between a compressibility of the first data stream and a compressibility of the second data stream, providing the mixed data stream to an application and/or hardware, observing and recording a response of the application and/or hardware to the mixed data stream, and analyzing the response of the response of the application and/or hardware to the mixed data stream.
1. A method, comprising:
receiving a mixed data stream that was generated using a first data stream and a second data stream, the mixed data stream having a compressibility of N, where N is a compressibility merging parameter, and the mixed data stream has a compressibility that is between a compressibility of the first data stream and a compressibility of the second data stream;
providing the mixed data stream as an input to an application and/or to hardware;
recording a response of the application and/or of the hardware to the mixed data stream input; and
analyzing the response of the application and/or of the hardware to the mixed data stream input.
2. The method as recited in claim 1 , wherein the mixed data stream is provided to the application, and the application is a data deduplication application.
3. The method as recited in claim 1 , wherein analyzing the response of the application and/or of the hardware comprises identifying any problems with the operation of the application and/or of the hardware.
4. The method as recited in claim 3 , wherein analyzing the response of the application and/or of the hardware comprises identifying and implementing a corrective action associated with an identified problem.
5. The method as recited in claim 1 , further comprising modifying the application and/or the hardware based on an outcome of the analyzing.
6. The method as recited in claim 1 , further comprising modifying the compressibility N of the mixed data stream.
7. The method as recited in claim 1 , wherein the mixed data stream was generated based in part on a seed, and one of the first data stream and the second data stream is incompressible.
8. The method as recited in claim 1 , wherein the mixed data stream has a particular commonality factor (CF) with respect to the first data stream and the second data stream.
9. The method as recited in claim 1 , wherein the mixed data stream comprises an interleaving of data of the first data stream with data of the second data stream.
10. The method as recited in claim 1 , wherein data in the mixed data stream embodies any one or more of the following mixes of data of the first data stream and data of the second data stream: a uniform mix; a random mix; a clustered mix; or, a normalized mix.
11. A non-transitory storage medium having stored therein computer-executable instructions which are executable by one or more hardware processors to perform operations comprising:
receiving a mixed data stream that was generated using a first data stream and a second data stream, the mixed data stream having a compressibility of N, where N is a compressibility merging parameter, and the mixed data stream has a compressibility that is between a compressibility of the first data stream and a compressibility of the second data stream;
providing the mixed data stream as an input to an application and/or to hardware;
recording a response of the application and/or of the hardware to the mixed data stream input; and
analyzing the response of the application and/or of the hardware to the mixed data stream input.
12. The non-transitory storage medium as recited in claim 11 , wherein the mixed data stream is provided to the application, and the application is a data deduplication application.
13. The non-transitory storage medium as recited in claim 11 , wherein analyzing the response of the application and/or of the hardware comprises identifying any problems with the operation of the application and/or of the hardware.
14. The non-transitory storage medium as recited in claim 13 , wherein analyzing the response of the application and/or of the hardware comprises identifying and implementing a corrective action associated with an identified problem.
15. The non-transitory storage medium as recited in claim 1 , wherein the operations further comprise modifying the application and/or the hardware based on an outcome of the analyzing.
16. The non-transitory storage medium as recited in claim 11 , wherein the operations further comprise modifying the compressibility N of the mixed data stream.
17. The non-transitory storage medium as recited in claim 11 , wherein the mixed data stream was generated based in part on a seed, and one of the first data stream and the second data stream is incompressible.
18. The non-transitory storage medium as recited in claim 11 , wherein the mixed data stream has a particular commonality factor (CF) with respect to the first data stream and the second data stream.
19. The non-transitory storage medium as recited in claim 11 , wherein the mixed data stream comprises an interleaving of data of the first data stream with data of the second data stream.
20. The non-transitory storage medium as recited in claim 11 , wherein data in the mixed data stream embodies any one or more of the following mixes of data of the first data stream and data of the second data stream: a uniform mix; a random mix; a clustered mix; or, a normalized mix.