Identity resolution and data enrichment application framework
Techniques for identity resolution and data enrichment include instantiating, at an account of a data consumer, an identity resolution application using an installer stored procedure. A data object is configured, at the account of the data consumer, to share log data generated by the identity resolution application with an account of a data provider. The identity resolution application is enabled, at the account of the data consumer, for an identity resolution process using source data based on an instruction originating from the account of the data provider. The instruction is based on the configuring of the data object.
1. A system comprising:
at least one hardware processor; and
at least one memory storing instructions that cause the at least one hardware processor to perform operations comprising:
instantiating, at an account of a data consumer, an identity resolution application using an installer stored procedure;
configuring, at the account of the data consumer, a data object to share log data generated by the identity resolution application with an account of a data provider;
enabling, at the account of the data consumer, the identity resolution application for an identity resolution process using source data based on an instruction originating from the account of the data provider, the instruction based on the configuring of the data object; and
performing the identity resolution process at the account of the data consumer using the source data based at least on granting a record enrichment stored procedure of the identity resolution application, a write access privilege to a result data table being stored at the account of the data consumer.
2. The system of claim 1 , wherein the operations to configure the data object further comprise:
configuring the data object as an outbound share, the outbound share designating a share at the account of the data provider as a receiving share to receive the log data.
3. The system of claim 1 , wherein the operations to enable the identity resolution application further comprise:
enabling, at the account of the data consumer, a record enrichment stored procedure of the identity resolution application for the identity resolution process based on the instruction.
4. The system of claim 3 , the operations further comprising:
accessing using the record enrichment stored procedure, the source data from the account of the data provider, the source data associated with the identity resolution process.
5. The system of claim 1 , the operations further comprising:
performing the identity resolution process at the account of the data consumer using the source data based on:
granting the record enrichment stored procedure, first read access privileges to an input data table stored at the account of the data consumer; and
granting the record enrichment stored procedure, second read access privileges to the source data managed by the account of the data provider.
6. The system of claim 5 , the operations further comprising:
retrieving by the record enrichment stored procedure, personally identifiable information (PII) from the input data table, using the first read access privileges.
7. The system of claim 6 , the operations further comprising:
generating, by the record enrichment stored procedure, a secure identifier of a user associated with the PII based on the source data.
8. The system of claim 7 , the operations further comprising:
updating, by the record enrichment stored procedure, the result data table with the secure identifier using the write access privilege.
9. The system of claim 1 , the operations further comprising:
generating an application log of the identity resolution application as the log data, the application log being based on one or more functions performed by the identity resolution application during the identity resolution process.
10. The system of claim 9 , the operations further comprising:
generating at the account of the data consumer, a hash of the application log using a hash function associated with the account of the data provider;
revising the application log with the hash to generate a revised application log; and
sharing the revised application log with a log verification procedure at the account of the data provider using the data object.
11. A method comprising:
performing, by at least one hardware processor, operations comprising:
instantiating, at an account of a data consumer, an identity resolution application using an installer stored procedure;
configuring, at the account of the data consumer, a data object to share log data generated by the identity resolution application with an account of a data provider;
enabling, at the account of the data consumer, the identity resolution application for an identity resolution process using source data based on an instruction originating from the account of the data provider, the instruction based on the configuring of the data object; and
performing the identity resolution process at the account of the data consumer using the source data based at least on granting a record enrichment stored procedure of the identity resolution application, a write access privilege to a result data table being stored at the account of the data consumer.
12. The method of claim 11 , wherein the configuring of the data object further comprises:
configuring the data object as an outbound share, the outbound share designating a share at the account of the data provider as a receiving share to receive the log data.
13. The method of claim 11 , wherein the enabling of the identity resolution application further comprises:
enabling, at the account of the data consumer, a record enrichment stored procedure of the identity resolution application for the identity resolution process based on the instruction.
14. The method of claim 13 , further comprising:
accessing using the record enrichment stored procedure, the source data from the account of the data provider, the source data associated with the identity resolution process.
15. The method of claim 11 , further comprising:
performing the identity resolution process at the account of the data consumer using the source data based on:
granting the record enrichment stored procedure, first read access privileges to an input data table stored at the account of the data consumer; and
granting the record enrichment stored procedure, second read access privileges to the source data managed by the account of the data provider.
16. The method of claim 15 , further comprising:
retrieving by the record enrichment stored procedure, personally identifiable information (PII) from the input data table, using the first read access privileges.
17. The method of claim 16 , further comprising:
generating, by the record enrichment stored procedure, a secure identifier of a user associated with the PII based on the source data.
18. The method of claim 17 , further comprising:
updating, by the record enrichment stored procedure, the result data table with the secure identifier using the write access privilege.
19. The method of claim 11 , further comprising:
generating an application log of the identity resolution application as the log data, the application log being based on one or more functions performed by the identity resolution application during the identity resolution process.
20. The method of claim 19 , further comprising:
generating at the account of the data consumer, a hash of the application log using a hash function associated with the account of the data provider;
revising the application log with the hash to generate a revised application log; and
sharing the revised application log with a log verification procedure at the account of the data provider using the data object.
21. A computer-storage medium comprising instructions that, when executed by one or more processors of a machine, configure the machine to perform operations comprising:
instantiating, at an account of a data consumer, an identity resolution application using an installer stored procedure;
configuring, at the account of the data consumer, a data object to share log data generated by the identity resolution application with an account of a data provider;
enabling, at the account of the data consumer, the identity resolution application for an identity resolution process using source data based on an instruction originating from the account of the data provider, the instruction based on the configuring of the data object; and
performing the identity resolution process at the account of the data consumer using the source data based at least on granting a record enrichment stored procedure of the identity resolution application, a write access privilege to a result data table being stored at the account of the data consumer.
22. The computer-storage medium of claim 21 , wherein the operations to configure the data object further comprise:
configuring the data object as an outbound share, the outbound share designating a share at the account of the data provider as a receiving share to receive the log data.
23. The computer-storage medium of claim 21 , wherein the operations to enable the identity resolution application further comprise:
enabling, at the account of the data consumer, a record enrichment stored procedure of the identity resolution application for the identity resolution process based on the instruction.
24. The computer-storage medium of claim 23 , the operations further comprising:
accessing using the record enrichment stored procedure, the source data from the account of the data provider, the source data associated with the identity resolution process.
25. The computer-storage medium of claim 21 , the operations further comprising:
performing the identity resolution process at the account of the data consumer using the source data based on:
granting the record enrichment stored procedure, first read access privileges to an input data table stored at the account of the data consumer; and
granting the record enrichment stored procedure, second read access privileges to the source data managed by the account of the data provider.
26. The computer-storage medium of claim 25 , the operations further comprising:
retrieving by the record enrichment stored procedure, personally identifiable information (PII) from the input data table, using the first read access privileges.
27. The computer-storage medium of claim 26 , the operations further comprising:
generating, by the record enrichment stored procedure, a secure identifier of a user associated with the PII based on the source data.
28. The computer-storage medium of claim 27 , the operations further comprising:
updating, by the record enrichment stored procedure, the result data table with the secure identifier using the write access privilege.
29. The computer-storage medium of claim 21 , the operations further comprising:
generating an application log of the identity resolution application as the log data, the application log being based on one or more functions performed by the identity resolution application during the identity resolution process.
30. The computer-storage medium of claim 29 , the operations further comprising:
generating at the account of the data consumer, a hash of the application log using a hash function associated with the account of the data provider;
revising the application log with the hash to generate a revised application log; and
sharing the revised application log with a log verification procedure at the account of the data provider using the data object.