Generating a large, non-compressible data stream
Generating non-compressible data streams is disclosed, including: receiving an initialization parameter; determining a constrained prime number, wherein the constrained prime number comprises a plurality of component values, wherein each of the plurality of component values comprises a prime number, wherein each of the plurality of component values is different; and generating a non-compressible sequence based at least in part on the initialization parameter and the constrained prime number.
1. A system, comprising:
a processor configured to:
receive an initialization parameter;
determine a first constrained prime number and a second constrained prime number, wherein a constrained prime number comprises a plurality of component values, wherein each of the plurality of component values comprises a prime number, wherein each of the plurality of component values is different; and
generate a non-compressible data stream comprising a plurality of data blocks at least in part by:
generate a first non-compressible sequence based at least in part on the initialization parameter and the first constrained prime number;
generate a second non-compressible sequence based at least in part on the initialization parameter and the second constrained prime number, wherein the first and second non-compressible sequences are each comprised of a non-repeating sequence of numbers; and
merge the first non-compressible sequence and the second non-compressible sequence to generate the non-compressible data stream comprising the plurality of data blocks, wherein values of the non-compressible data stream alternate between values of the first non-compressible sequence and values of the second non-compressible sequence; and
send the non-compressible data stream comprising the plurality of data blocks to be stored at a storage device, wherein the storage device is configured to store all of the plurality of data blocks in response to determining that none of the data blocks have been already stored at the storage device;
receive restored data associated with the non-compressible data stream from the storage device, wherein the restored data associated with the non-compressible data stream comprises the plurality of data blocks;
determine the first constrained prime number based at least in part on a difference between a first pair of non-consecutive values from the restored data associated with the non-compressible data stream;
determine the second constrained prime number based at least in part on a difference between a second pair of non-consecutive values from the restored data associated with the non-compressible data stream; and
verify an accuracy and/or reliability of the storage device, wherein to verify the accuracy and/or reliability of the storage device, the restored data associated with the non-compressible data stream is verified by using the determined first constrained prime number and the determined second constrained prime number; and
a memory coupled to the processor and configured to provide the processor with instructions.
2. The system of claim 1 , wherein each of the plurality of component values comprises a byte value.
3. The system of claim 1 , wherein each of the plurality of component values comprises a prime number from a set of prime numbers including “1” and excluding “2” in a range of 0 to 255.
4. The system of claim 1 , wherein the constrained prime number comprises a prime number from a set of prime numbers including “1” and excluding “2” in a range of 0 to 2 N −1, where N is a positive integer.
5. The system of claim 1 , wherein the constrained prime number is determined from an identified set of constrained prime numbers based at least in part on a revision parameter.
6. The system of claim 1 , wherein the restored data is verified without a master copy of the non-compressible data stream.
7. The system of claim 1 , wherein to verify the restored data associated with the non-compressible data stream by using the first constrained prime number and the second constrained prime number comprises:
determine of a first offset between the first pair of non-consecutive numbers from the restored data;
determine of a second offset between the second pair of non-consecutive numbers from the restored data; and
verify the data stream in response to determining the first offset is equal to the first constrained prime number and the second offset is equal to the second constrained prime number.
8. A method, comprising:
receiving an initialization parameter;
determining a first constrained prime number and a second constrained prime number, wherein a constrained prime number comprises a plurality of component values, wherein each of the plurality of component values comprises a prime number, wherein each of the plurality of component values is different;
generating a non-compressible data stream comprising a plurality of data blocks at least in part by:
generating, by a processor, first a non-compressible sequence based at least in part on the initialization parameter and the first constrained prime number;
generating, by the processor, a second non-compressible sequence based at least in part on the initialization parameter and the second constrained prime number, wherein the first and second non-compressible sequences are each comprised of a non-repeating sequence of numbers; and
merging, by the processor, the first non-compressible sequence and the second non-compressible sequence to generate the non-compressible data stream, wherein values of the non-compressible data stream alternate between values of the first non-compressible sequence and values of the second non-compressible sequence;
sending, by the processor, the non-compressible data stream comprising the plurality of data blocks to be stored at a storage device, wherein the storage device is configured to store all of the plurality of data blocks in response to determining that none of the data blocks have been already stored at the storage device;
receiving restored data associated with the non-compressible data stream from the storage device, wherein the restored data associated with the non-compressible data stream comprises the plurality of data blocks;
determining the first constrained prime number based at least in part on a difference between a first pair of non-consecutive values from the restored data associated with the non-compressible data stream;
determining the second constrained prime number based at least in part on a difference between a second pair of non-consecutive values from the restored data associated with the non-compressible data stream; and
verifying an accuracy and/or reliability of the storage device, wherein to verify the accuracy and/or reliability of the storage device, the restored data associated with the non-compressible data stream is verified by using the determined first constrained prime number and the determined second constrained prime number.
9. The method of claim 8 , wherein each of the plurality of component values comprises a byte value.
10. A computer program product, the computer program product embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
receiving an initialization parameter;
determining a first constrained prime number and a second constrained prime number, wherein a constrained prime number comprises a plurality of component values, wherein each of the plurality of component values comprises a prime number, wherein each of the plurality of component values is different;
generating a non-compressible data stream comprising a plurality of data blocks at least in part by:
generating a first non-compressible sequence based at least in part on the initialization parameter and the first constrained prime number;
generating a second non-compressible sequence based at least in part on the initialization parameter and the second constrained prime number, wherein the first and second non-compressible sequences are each comprised of a non-repeating sequence of numbers; and
merging the first non-compressible sequence and the second non-compressible sequence to generate the non-compressible data stream comprising the plurality of data blocks, wherein values of the non-compressible data stream alternate between values of the first non-compressible sequence and values of the second non-compressible sequence;
sending the non-compressible data stream comprising the plurality of data blocks to be stored at a storage device, wherein the storage device is configured to store all of the plurality of data blocks in response to determining that none of the data blocks have been already stored at the storage device;
receiving restored data associated with the non-compressible data stream from the storage device, wherein the restored data associated with the non-compressible data stream comprises the plurality of data blocks;
determining the first constrained prime number based at least in part on a difference between a first pair of non-consecutive values from the restored data associated with the non-compressible data stream;
determining the second constrained prime number based at least in part on a difference between a second pair of non-consecutive values from the restored data associated with the non-compressible data stream; and
verifying an accuracy and/or reliability of the storage device, wherein to verify the accuracy and/or reliability of the storage device, the restored data associated with the non-compressible data stream is verified by using the determined first constrained prime number and the determined second constrained prime number.