Systems and methods for a virtual sandbox database
Various embodiments of the present technology generally relate to management of big data storage and data access control systems. In some embodiments, a data access system for use in multiple application service and multiple storage service environments comprises a sandbox database for users, wherein the sandbox database is a virtual database environment via which a user may access datasets according to one or more access policies. In some embodiments, the data access system receives a user request to access a dataset stored in a database into the sandbox environment, wherein the database is associated with the data access system. In response to the request, the data access system may retrieve the corresponding data from the database, determine any associated sandbox access policies, and generate an anonymized data table in the sandbox environment.
1. A method of operating a data access system, the method comprising:
receiving a user request from a sandbox environment to access a dataset, wherein the sandbox environment is a virtual database environment and the dataset is stored in a database associated with the data access system;
in response to the user request, retrieving at least a portion of the dataset from the database;
identifying at least one sandbox access policy associated with the user request and the dataset;
writing a sandbox version of the dataset into the sandbox environment, wherein the sandbox version of the dataset has one or more elements of the dataset disabled based at least in part on the at least one sandbox access policy associated with the user request and the dataset; and
generating a view of the sandbox dataset in the sandbox environment, wherein the view includes one or more dataset tools read from original tools associated with the dataset.
2. The method of claim 1 , wherein writing the sandbox version of the dataset into the sandbox environment comprises enabling one or more elements of the dataset in the sandbox version of the dataset.
3. The method of claim 1 , wherein writing the sandbox version of the dataset into the sandbox environment comprises disabling the one or more elements of the dataset in the sandbox version of the dataset.
4. The method of claim 1 , wherein a portion of the dataset is anonymized in the sandbox version of the dataset based on the at least one sandbox access policy.
5. The method of claim 1 , wherein:
the user request indicates a number of requested dataset elements; and
writing the sandbox version of the dataset into the sandbox environment comprises generating the sandbox version of the dataset based in part on the number of requested dataset elements.
6. The method of claim 1 , wherein:
identifying the at least one sandbox access policy is performed by a metadata service within the data access system; and
generating the view of the sandbox dataset in the sandbox environment is performed by the metadata service.
7. The method of claim 6 , wherein the metadata service provides the sandbox environment with the one or more dataset tools, wherein the one or more dataset tools are included based on the at least one sandbox access policy.
8. A computing apparatus comprising:
one or more computer-readable storage media;
a processing system operatively coupled with the one or more computer-readable storage media; and
program instructions stored on the one or more computer-readable storage media that, when read and executed by the processing system, direct the processing system to at least:
receive a user request from a sandbox environment to access a dataset, wherein the sandbox environment is a virtual database environment and the dataset is stored in a database;
in response to the user request, retrieve at least a portion of the dataset from the database;
identify at least one sandbox access policy associated with the user request and the dataset;
write a sandbox version of the dataset into the sandbox environment, wherein the sandbox version of the dataset has one or more elements of the dataset disabled based at least in part on the at least one sandbox access policy associated with the user request and the dataset; and
generate a view of the sandbox dataset in the sandbox environment, wherein the view includes one or more dataset tools read from original tools associated with the dataset.
9. The computing apparatus of claim 8 , wherein, to write the sandbox version of the dataset into the sandbox environment, the program instructions direct the processing system to enable one or more elements of the dataset in the sandbox version of the dataset.
10. The computing apparatus of claim 8 , wherein, to write the sandbox version of the dataset into the sandbox environment, the program instructions direct the processing system to disable the one or more elements of the dataset in the sandbox version of the dataset.
11. The computing apparatus of claim 8 , wherein a portion of the dataset is anonymized in the sandbox version of the dataset based on the at least one sandbox access policy.
12. The computing apparatus of claim 8 , wherein:
the user request indicates a number of requested dataset elements; and
writing the sandbox version of the dataset into the sandbox environment comprises generating the sandbox version of the dataset based in part on the number of requested dataset elements.
13. The computing apparatus of claim 8 , wherein:
identifying the at least one sandbox access policy is performed in a metadata service within a data access system; and
generating the view of the sandbox dataset in the sandbox environment is performed in the metadata service.
14. The computing apparatus of claim 13 , wherein the metadata service provides the sandbox environment with the one or more dataset tools, wherein the one or more dataset tools are included based on the at least one sandbox access policy.
15. One or more non-transitory computer-readable storage media having program instructions stored thereon to facilitate data access environments comprising multiple application services and multiple storage services that, when read and executed by a processing system, direct the processing system to at least:
receive a user request from a sandbox environment to access a dataset, wherein the sandbox environment is a virtual database environment and the dataset is stored in a database associated with a data access system;
in response to the user request, retrieve at least a portion of the dataset from the database;
identify at least one sandbox access policy associated with the user request and the dataset;
writing a sandbox version of the dataset into the sandbox environment, wherein the sandbox version of the dataset has one or more elements of the dataset disabled based at least in part on the at least one sandbox access policy associated with the user request and the dataset; and
generate a view of the sandbox dataset in the sandbox environment, wherein the view includes one or more dataset tools read from original tools associated with the dataset.
16. The one or more non-transitory computer-readable storage media of claim 15 , wherein, to write the sandbox version of the dataset into the sandbox environment, the program instructions direct the processing system to enable one or more elements of the dataset in the sandbox version of the dataset.
17. The one or more non-transitory computer-readable storage media of claim 15 , wherein, to write the sandbox version of the dataset into the sandbox environment, the program instructions direct the processing system to disable the one or more elements of the dataset in the sandbox version of the dataset.
18. The one or more non-transitory computer-readable storage media of claim 15 , wherein a portion of the dataset is anonymized in the sandbox version of the dataset based on the at least one sandbox access policy.
19. The one or more non-transitory computer-readable storage media of claim 15 , wherein:
the user request indicates a number of requested dataset elements; and
writing the sandbox version of the dataset into the sandbox environment comprises generating the sandbox version of the dataset based in part on the number of requested dataset elements.
20. The one or more non-transitory computer-readable storage media of claim 15 , wherein:
identifying the at least one sandbox access policy is performed in a metadata service within the data access system; and
generating the view of the sandbox dataset in the sandbox environment is performed in the metadata service.