Data generation system and method
A data synthesis system comprising a high side computing environment and a low side computing environment. Access to the high side computing environment may be restricted to a first one or more users. The high side computing environment may comprise a first one or more datasets and one or more specification computer programs. The one or more specification computer programs may be configured to generate a data synthesis specification based on the structure of the first one or more datasets. The low side computing environment may be accessible by a second a one or more users. The low side computing environment may comprise one or more data synthesizer computer programs. The one or more data synthesizer computer programs may be configured to synthesize a second one or more datasets based on the data synthesis specification.
1. A method, performed by one or more processors, comprising:
receiving a universality indicator;
in response to the universality indicator indicating a universal uniqueness requirement, selecting a universally unique key generator, wherein the universally unique key generator is configured to generate a plurality of universally unique keys;
in response to the universality indicator not indicating a universal uniqueness requirement, selecting a locally unique key generator, wherein the locally unique key generator is configured to generate a plurality of locally unique keys; and
generating, using the selected key generator, a key for each of a plurality of data items of one or more datasets, wherein the one or more datasets is synthesized based on a data synthesis specification, wherein the data synthesis specification comprises code in a domain specific language.
2. The method of claim 1 , wherein each of the plurality of universally unique keys is a universally unique identifier.
3. The method of claim 1 , wherein the probability of a collision in a set of a billion universally unique keys, each of universally unique keys in the set being generated by a respective universally unique key generator, is less than a half.
4. The method of claim 1 , wherein the locally unique key generator is configured to receive a seed value and deterministically generate the plurality of locally unique keys based on the seed value.
5. A data synthesis system comprising:
a universally unique key generator to generate keys for synthesizing datasets;
a locally unique key generator to generate keys for synthesizing datasets;
one or more hardware processors to execute a data synthesizer computer program configured to:
receive a universality indicator;
in response to the universality indicator indicating a universal uniqueness requirement, select the universally unique key generator, wherein the universally unique key generator is configured to generate a plurality of universally unique keys;
in response to the universality indicator not indicating a universal uniqueness requirement, selecting the locally unique key generator, wherein the locally unique key generator is configured to generate a plurality of locally unique keys; and
generating, using the selected key generator, a key for each of a plurality of data items of one or more datasets, wherein the one or more datasets is synthesized based on a data synthesis specification, wherein the data synthesis specification comprises code in a domain specific language.
6. The data synthesis system of claim 5 , wherein each of the plurality of universally unique keys is a universally unique identifier.
7. The data synthesis system of claim 5 , wherein the probability of a collision in a set of a billion universally unique keys, each of universally unique keys in the set being generated by a respective universally unique key generator, is less than a half.
8. The data synthesis system of claim 5 , wherein the locally unique key generator is configured to receive a seed value and deterministically generate the plurality of locally unique keys based on the seed value.