Data certification process for updates to data in cloud database platform
Methods, systems, and apparatuses for providing access to records of a database stored on a database server in a cloud database platform are described herein. A data sharing platform may determine a shared view definition for access to the database. The data sharing platform may determine rules that specify criteria that limit access to the records stored by the database. The one or more first rules may be received via a user interface. The data sharing platform may perform, based on the rules, a data access certification process on the records stored by the database to generate a table of certification results. The data sharing platform may generate, based on the table of certification results, and without modifying the records stored by the database, a limited consumer view definition. Based on updates to the records, a new limited consumer view definition may be generated.
1. A data sharing platform configured to provide access to records of a database stored on a database server, the data sharing platform comprising:
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the data sharing platform to:
perform, based on one or more first rules, associated with consumer permissions to access the database via a cloud database platform, a data access certification process on the records stored by the database to generate a first table of certification results;
generate, based on the first table of certification results, and without modifying the records stored by the database, a limited consumer view definition configured to provide, via one or more virtual warehouses of the cloud database platform, access to a first portion of the records in compliance with the one or more first rules and exclude a second portion of the records not in compliance with the one or more first rules;
detect an update to at least one record of the records stored by the database;
perform the data access certification process on the updated at least one record to generate a second table of certification results;
generate, based on the first table of certification results and the second table of certification results, an updated limited consumer view definition different from the limited consumer view definition; and
cause a first virtual warehouse, of the one or more virtual warehouses, to execute a query on the records in compliance with the one or more first rules via the updated limited consumer view definition.
2. The data sharing platform of claim 1 , wherein the instructions, when executed by the one or more processors, cause the data sharing platform to detect the update by causing the data sharing platform to:
receive, via the cloud database platform, an indication of the update.
3. The data sharing platform of claim 1 , wherein the update comprises removal of a first record of the records stored by the database.
4. The data sharing platform of claim 3 , wherein the instructions, when executed by the one or more processors, cause the data sharing platform to generate the updated limited consumer view definition based on a comparison of the first table of certification results and the second table of certification results.
5. The data sharing platform of claim 1 , wherein at least one of the one or more first rules prevent one or more of:
output of invalid values;
output of values outside of a predefined range; or
output of values that do not match a regular expression pattern.
6. The data sharing platform of claim 1 , wherein at least one of the one or more first rules prevent output of data outside a time period specified by the at least one of the one or more first rules.
7. The data sharing platform of claim 1 , wherein at least one of the one or more first rules is configured to cause output of an alert based on a determination that more than a predetermined percentage of the records is not output based on the one or more first rules.
8. A method for providing access to records of a database stored on a database server, the method comprising:
performing, based on one or more first rules associated with consumer permissions to access the database via a cloud database platform, a data access certification process on the records stored by the database to generate a first table of certification results;
generating, based on the first table of certification results, and without modifying the records stored by the database, a limited consumer view definition configured to provide, via one or more virtual warehouses of the cloud database platform, access to a first portion of the records in compliance with the one or more first rules and exclude a second portion of the records not in compliance with the one or more first rules;
detecting an update to at least one record of the records stored by the database;
performing the data access certification process on the updated at least one record to generate a second table of certification results;
generating, based on the first table of certification results and the second table of certification results, an updated limited consumer view definition different from the limited consumer view definition; and
causing a first virtual warehouse, of the one or more virtual warehouses, to execute a query on the records in compliance with the one or more first rules via the updated limited consumer view definition.
9. The method of claim 8 , wherein detecting the update comprises:
receiving, via the cloud database platform, an indication of the update.
10. The method of claim 8 , wherein the update comprises removal of a first record of the records stored by the database.
11. The method of claim 10 , wherein generating the updated limited consumer view definition is based on a comparison of the first table of certification results and the second table of certification results.
12. The method of claim 8 , wherein at least one of the one or more first rules prevent one or more of:
output of invalid values;
output of values outside of a predefined range; or
output of values that do not match a regular expression pattern.
13. The method of claim 8 , wherein at least one of the one or more first rules prevent output of data outside a time period specified by the at least one of the one or more first rules.
14. The method of claim 8 , wherein at least one of the one or more first rules is configured to cause output of an alert based on a determination that more than a predetermined percentage of the records is not output based on the one or more first rules.
15. One or more non-transitory computer-readable media comprising instructions that, when executed by one or more processors of a data sharing platform, cause the data sharing platform to provide access to records of a database stored on a database server by causing the data sharing platform to:
perform, based on one or more first rules associated with consumer permissions to access the database via a cloud database platform, a data access certification process on the records stored by the database to generate a first table of certification results;
generate, based on the first table of certification results, and without modifying the records stored by the database, a limited consumer view definition configured to provide, via one or more virtual warehouses of the cloud database platform, access to a first portion of the records in compliance with the one or more first rules and exclude a second portion of the records not in compliance with the one or more first rules;
detect an update to at least one record of the records stored by the database;
perform the data access certification process on the updated at least one record to generate a second table of certification results;
generate, based on the first table of certification results and the second table of certification results, an updated limited consumer view definition different from the limited consumer view definition; and
cause a first virtual warehouse, of the one or more virtual warehouses, to execute a query on the records in compliance with the one or more first rules via the updated limited consumer view definition.
16. The non-transitory computer-readable media of claim 15 , wherein the instructions, when executed by the one or more processors, cause the data sharing platform to detect the update by causing the data sharing platform to:
receive, via the cloud database platform, an indication of the update.
17. The non-transitory computer-readable media of claim 15 , wherein the update comprises removal of a first record of the records stored by the database.
18. The non-transitory computer-readable media of claim 17 , wherein the instructions, when executed by the one or more processors, cause the data sharing platform to generate the updated limited consumer view definition based on a comparison of the first table of certification results and the second table of certification results.
19. The non-transitory computer-readable media of claim 15 , wherein at least one of the one or more first rules prevent one or more of:
output of invalid values;
output of values outside of a predefined range; or
output of values that do not match a regular expression pattern.
20. The non-transitory computer-readable media of claim 15 , wherein at least one of the one or more first rules prevent output of data outside a time period specified by the at least one of the one or more first rules.