End-to-end tagging and tracking of event signals subject to privacy policies
Systems, devices, and methods are provided for end-to-end tagging and tracking of event signals subject to privacy policies. User events comprising event source data may be collected. A user may be associated with a segment, and the segment may be mapped to data lineage information corresponding to the events that were used to determine that the user is in segment. A segment cache may be generated comprising portions that correspond to different data lineages subject to different privacy policies. Bid requests may be received and processed according to applicable privacy policies.
1. A system, comprising:
one or more processors; and
memory storing executable instructions that, as a result of execution by the one or more processors, cause the system to:
determine first event data associated with a first user, the first event data comprising a first data source;
determine, based on the first event data, the first user is associated with a first segment;
determine second event data associated with the first user, the second event data comprising a second data source;
determine, based on the second event data, the first user is associated with the first segment;
determine a first mapping that associates the first segment with the first data source and the second data source;
determine, based on a first privacy policy, a first portion of a segment cache, the first portion comprising a second mapping of the first data source to the first segment; and
generate the second portion of the segment cache, the second portion comprising a third mapping of the second data source to the first segment.
2. The system of claim 1 , wherein executable instructions include further instructions that, as a result of execution by the one or more processors, further cause the system to:
receive a first bid request;
determine, from the first bid request, the first user and a first bid context;
determine, based on the first bid context, the first privacy policy is applicable to the first portion of the segment cache; and
determine, based on the first privacy policy, that access to the first portion of the segment cache is restricted.
3. The system of claim 2 , wherein executable instructions include further instructions that, as a result of execution by the one or more processors, further cause the system to:
determine, based on the first privacy policy, that access to the second portion of the segment cache is permitted;
determine, based on the second portion of the segment cache, that the first user is associated with the first segment; and
provide a first bid response that includes the first segment.
4. The system of claim 2 , wherein the first bid request is associated with a first operating system and the first event data is associated with a second operating system.
5. The system of claim 2 , wherein the first and second portions of the segment cache are generated based on the first privacy policy being added.
6. The system of claim 1 , wherein executable instructions include further instructions that, as a result of execution by the one or more processors, further cause the system to:
determine third event data associated with the first user, the third event data comprising the first data source;
determine, based on the third event data, the first user is associated with a second segment;
determine a fourth mapping that associates the second segment to the first data source; and
wherein the second mapping further maps the first data source to the second segment.
7. The system of claim 1 , wherein:
the first portion of the segment cache is associated with one or more privacy policies; and
use of the second portion of the segment cache to process bid requests is unrestricted.
8. The system of claim 1 , wherein the segment cache is an in-memory data structure.
9. The system of claim 1 , wherein the first privacy policy allows usage of first-party segments and disallows usage of third-party segments.
10. A non-transitory computer-readable storage medium storing executable instructions that, as a result of being executed by one or more processors of a computer system, cause the computer system to at least:
determine first event data associated with a first user, the first event data comprising a first data source;
determine, based on the first event data, the first user is associated with a first segment;
determine second event data associated with the first user, the second event data comprising a second data source;
determine, based on the second event data, the first user is associated with the first segment;
determine a first mapping that associates the first segment with the first data source and the second data source;
determine, based on a first privacy policy, a first portion of a segment cache, the first portion comprising a second mapping of the first data source to the first segment; and
generate a second portion of the segment cache, the second portion comprising a third mapping of the second data source to the first segment.
11. The non-transitory computer-readable storage medium of claim 10 , wherein the instructions, as a result of being executed by the one or more processors of the computer system, further cause the system to:
receive a first bid request;
determine, from the first bid request, the first user and a first bid context;
determine, based on the first bid context, a first privacy policy is applicable to the first portion of the segment cache; and
determine, based on the first privacy policy, that access to the first portion of the segment cache is restricted.
12. The non-transitory computer-readable storage medium of claim 10 , wherein the instructions, as a result of being executed by the one or more processors of the computer system, further cause the system to:
determine, based on the first privacy policy, that access to the second portion of the segment cache is permitted;
determine, based on the second portion of the segment cache, that the first user is associated with the first segment; and
provide a first bid response that includes the first segment.
13. The non-transitory computer-readable storage medium of claim 12 , wherein the first event data is comprises an operating system version.
14. The non-transitory computer-readable storage medium of claim 10 , wherein the first and second portions of the segment cache are generated based on the first privacy policy being added.
15. The non-transitory computer-readable storage medium of claim 10 , wherein the instructions, as a result of being executed by the one or more processors of the computer system, further cause the system to:
determine third event data associated with the first user, the third event data comprising the first data source;
determine, based on the third event data, the first user is associated with a second segment;
determine a fourth mapping that associates the second segment to the first data source; and
wherein the second mapping further maps the first data source to the second segment.
16. The non-transitory computer-readable storage medium of claim 10 , wherein:
the first portion of the segment cache is associated with restricted first-party segments; and
the second portion of the segment cache is associated with unrestricted first-party segments.
17. The non-transitory computer-readable storage medium of claim 10 , wherein the first privacy policy allows usage of first-party segments and disallows usage of third-party segments.
18. The non-transitory computer-readable storage medium of claim 10 , wherein the first event data and the second event data are persisted in a database.