Privacy compliant insights platform incorporating data signals from various sources
The present disclosure relates to techniques for determining insights from disparate data sets provided from multiple different data sources in a manner that complies with applicable privacy and data protection regulations. More particularly, the present disclosure relates to a computer-implemented privacy compliant data insights and audience activation platform incorporating data signals from various sources.
1 . A computerized system configured for privacy-compliant behavioral analytics within a data network, the data network including a plurality of computerized signal provider systems, the computerized system comprising:
at least one processor;
memory communicatively coupled to the at least one processor;
wherein the at least one processor is configured for executing a plurality of instructions stored in the memory for:
initiating a Signal Encryptor System locally within a first signal provider cloud environment of a first signal provider system of the plurality of computerized signal provider systems;
identifying, by the Signal Encryptor System, personally identifiable information (PII) within a first set of device signal data records;
generating provider-specific encrypted identifiers that are unique to both a specific end-user and the first signal provider system using a hashing algorithm to ensure that a single physical user is represented by non-matching identifiers across different signal provider systems to prevent cross-platform persistent tracking;
accessing a plurality of disparate datasets comprising de-identified mobile signal data, point-of-interest (POI) data, application download data, and Internet of Things (IoT) data;
grooming the plurality of disparate datasets by discarding non-conforming data points, processing records of the disparate datasets via a data classification layer of a distributed processing system, and normalizing high-precision geolocation coordinates into physical address data, wherein normalizing high-precision geolocation coordinates includes executing a conversion of raw latitude and longitude coordinates into physical addresses or geo-spatial polygons to convert raw coordinates into specific business identity points of interest;
performing a stateless real-time recalculation of linkage associations between records of the groomed datasets in response to an ad-hoc query, wherein stateless includes performing the recalculation without storing persistent identity linkages between queries, wherein the recalculation is executed utilizing the distributed processing system, the distributed processing system comprising a cloud of a plurality of GPU-enabled nodes configured to process mass associations across high-volume datasets during a query lifecycle;
verifying the human authenticity of the mobile signal data by correlating real-time hardware-level state data, including at least one of accelerometer readings or battery status, with digital application engagement to identify active mobile devices based on whether the correlated data satisfies one or more authenticity criteria indicative of human-operated device activity;
flagging a mobile signal as a non-human signal by analyzing the hardware-level state data to determine if hardware readings or application engagement indicate abnormal activity patterns that satisfy one or more anomaly criteria indicative of automated or non-human activity;
identifying a household association between a mobile device signal from the mobile signal data and an IoT device signal from the IoT data by detecting overlapping encrypted IP addresses during a specified nighttime time interval;
executing a time-series analysis on the linkage associations to automatically detect anomalous activity and relevant statistical changes in retail visitation patterns between two or more different periods of time;
providing an interactive data mapping presentation graphical user interface (GUI) to cause the computerized system to visually display the linkage associations;
providing an interactive audience activation GUI for defining a destination activation endpoint and assigning rule-based economic metadata to a customized audience of de-identified records, the economic metadata defining pricing structures governing an export of data;
generating a decryption request including a subset of the provider-specific encrypted identifiers and instructions for the first signal provider system to transmit decrypted data records directly to the destination activation endpoint;
maintaining the at least one processor in a state blind to the PII and decryption keys throughout a transmission lifecycle; and
dynamically creating the linkage associations via a deterministic matching system to avoid persistent storage of identity linkages within the memory.
2 . The computerized system of claim 1 , wherein the Signal Encryptor System is deployed local to each of the plurality of signal provider systems such that raw PII data never leaves an originating cloud environment of a respective signal provider.
3 . The computerized system of claim 1 , wherein the system is configured to generate unified behavioral insights by interrogating the datasets via user-specified filter criteria selected through an interactive graphical user interface.
4 . The computerized system of claim 1 , wherein the specific business identity points of interest are derived from external databases comprising publicly known or licensed information integrated with the distributed processing system.
5 . The computerized system of claim 1 , wherein the rule-based economic metadata defines a pricing model based on a count of decrypted identifiers delivered to the destination activation endpoint.
6 . The computerized system of claim 1 , wherein the interactive audience activation GUI is further configured for selecting a delivery format for the customized audience of de-identified records.
7 . The computerized system of claim 1 , wherein the household association is verified by determining a deterministic match between a mobile device and an IoT device based on a shared physical address and IP address history.
8 . The computerized system of claim 1 , wherein the distributed processing system is configured to handle multiple concurrent query threads, each performing independent stateless recalculations without storing persistent identity linkages between queries.
9 . The computerized system of claim 1 , wherein the Signal Encryptor System maintains encryption keys exclusively at the signal provider systems to ensure continued isolation of PII data.
10 . The computerized system of claim 1 , wherein the interactive data mapping presentation GUI includes a visualization of geographic heat maps colorized based on a density of identified linkage associations.
11 . A computer-implemented method for privacy-compliant behavioral analytics within a data network including a plurality of computerized signal provider systems, the method comprising causing at least one processor to execute a plurality of instructions stored in a non-transient memory for:
initiating a Signal Encryptor System locally within a first signal provider cloud environment of a first signal provider system of the plurality of computerized signal provider systems;
identifying, by the Signal Encryptor System, personally identifiable information (PII) within a first set of device signal data records;
generating provider-specific encrypted identifiers that are unique to both a specific end-user and the first signal provider system using a hashing algorithm to ensure that a single physical user is represented by non-matching identifiers across different signal provider systems to prevent cross-platform persistent tracking;
accessing a plurality of disparate datasets comprising de-identified mobile signal data, point-of-interest (POI) data, application download data, and Internet of Things (IoT) data;
grooming the plurality of disparate datasets by discarding non-conforming data points, processing records of the disparate datasets via a data classification layer of a distributed processing system, and normalizing high-precision geolocation coordinates into physical address data, wherein normalizing high-precision geolocation coordinates includes executing a conversion of raw latitude and longitude coordinates into physical addresses or geo-spatial polygons to convert raw coordinates into specific business identity points of interest;
performing a stateless real-time recalculation of linkage associations between records of the groomed datasets in response to an ad-hoc query, wherein stateless includes performing the recalculation without storing persistent identity linkages between queries, wherein the recalculation is executed utilizing the distributed processing system, the distributed processing system comprising a cloud of a plurality of GPU-enabled nodes configured to process mass associations across high-volume datasets during a query lifecycle;
verifying the human authenticity of the mobile signal data by correlating real-time hardware-level state data, including at least one of accelerometer readings or battery status, with digital application engagement to identify active mobile devices based on whether the correlated data satisfies one or more authenticity criteria indicative of human-operated device activity;
flagging a mobile signal as a non-human signal by analyzing the hardware-level state data to determine if hardware readings or application engagement indicate abnormal activity patterns that satisfy one or more anomaly criteria indicative of automated or non-human activity;
identifying a household association between a mobile device signal from the mobile signal data and an IoT device signal from the IoT data by detecting overlapping encrypted IP addresses during a specified nighttime time interval;
executing a time-series analysis on the linkage associations to automatically detect anomalous activity and relevant statistical changes in retail visitation patterns between two or more different periods of time;
providing an interactive data mapping presentation graphical user interface (GUI) to cause a computerized system to visually display the linkage associations;
providing an interactive audience activation GUI for defining a destination activation endpoint and assigning rule-based economic metadata to a customized audience of de-identified records, the economic metadata defining pricing structures governing an export of data;
generating a decryption request including a subset of the provider-specific encrypted identifiers and instructions for the first signal provider system to transmit decrypted data records directly to the destination activation endpoint;
maintaining the at least one processor in a state blind to the PII and decryption keys throughout a transmission lifecycle; and
dynamically creating the linkage associations via a deterministic matching system to avoid persistent storage of identity linkages within the non-transient memory.
12 . The method of claim 11 , further comprising deploying the Signal Encryptor System local to each of the plurality of signal provider systems such that raw PII data never leaves an originating cloud environment.
13 . The method of claim 11 , further comprising generating unified behavioral insights by interrogating the datasets via user-specified filter criteria selected through an interactive graphical user interface.
14 . The method of claim 11 , further comprising integrating external databases comprising publicly known or licensed information with the distributed processing system to convert geolocation coordinates into specific business identity points of interest.
15 . The method of claim 11 , further comprising defining a pricing model for the first signal provider system based on a count of decrypted identifiers delivered to the destination activation endpoint.
16 . The method of claim 11 , further comprising receiving user input via the interactive audience activation GUI to select a delivery format for the customized audience records.
17 . The method of claim 11 , further comprising verifying the household association by determining a deterministic match between a mobile device and an Internet of Things (IoT) device based on a shared address and IP history.
18 . The method of claim 11 , further comprising processing multiple concurrent query threads in the distributed processing system, wherein each thread performs an independent stateless recalculation without storing persistent identity linkages between queries.
19 . The method of claim 11 , further comprising maintaining encryption keys exclusively at the signal provider systems within the Signal Encryptor System.
20 . The method of claim 11 , further comprising generating a visualization of geographic heat maps colorized by a density of linkage associations via the interactive data mapping presentation GUI.
21 . A non-transitory computer-readable medium having computer-readable code embodied therein for use in behavioral analytics within a data network including a plurality of computerized signal provider systems, the computer-readable code being executable by at least one processor of a computerized system to perform a method comprising:
initiating a Signal Encryptor System locally within a first signal provider cloud environment of a first signal provider system of the plurality of computerized signal provider systems;
identifying, by the Signal Encryptor System, personally identifiable information (PII) within a first set of device signal data records;
generating provider-specific encrypted identifiers that are unique to both a specific end-user and the first signal provider system using a hashing algorithm to ensure that a single physical user is represented by non-matching identifiers across different signal provider systems to prevent cross-platform persistent tracking;
accessing a plurality of disparate datasets comprising de-identified mobile signal data, point-of-interest (POI) data, application download data, and Internet of Things (IoT) data;
grooming the plurality of disparate datasets by discarding non-conforming data points, processing records of the disparate datasets via a data classification layer of a distributed processing system, and normalizing high-precision geolocation coordinates into physical address data, wherein normalizing high-precision geolocation coordinates includes executing a conversion of raw latitude and longitude coordinates into physical addresses or geo-spatial polygons to convert raw coordinates into specific business identity points of interest;
performing a stateless real-time recalculation of linkage associations between records of the groomed datasets in response to an ad-hoc query, wherein stateless includes performing the recalculation without storing persistent identity linkages between queries, wherein the recalculation is executed utilizing the distributed processing system, the distributed processing system comprising a cloud of a plurality of GPU-enabled nodes configured to process mass associations across high-volume datasets during a query lifecycle;
verifying the human authenticity of the mobile signal data by correlating real-time hardware-level state data, including at least one of accelerometer readings or battery status, with digital application engagement to identify active mobile devices based on whether the correlated data satisfies one or more authenticity criteria indicative of human-operated device activity;
flagging a mobile signal as a non-human signal by analyzing the hardware-level state data to determine if hardware readings or application engagement indicate abnormal activity patterns that satisfy one or more anomaly criteria indicative of automated or non-human activity;
identifying a household association between a mobile device signal and an Internet of Things (IoT) device signal by detecting overlapping encrypted IP addresses during a specified nighttime time interval;
executing a time-series analysis on the linkage associations to automatically detect anomalous activity and relevant statistical changes in retail visitation patterns between two or more different periods of time;
providing an interactive data mapping presentation graphical user interface (GUI) to cause the computerized system to visually display the linkage associations;
providing an interactive audience activation GUI for defining a destination activation endpoint and assigning rule-based economic metadata to a customized audience of de-identified records, the economic metadata defining pricing structures governing an export of data;
generating a decryption request including a subset of the provider-specific encrypted identifiers and instructions for the first signal provider system to transmit decrypted data records directly to the destination activation endpoint;
maintaining the at least one processor in a state blind to the PII and decryption keys throughout a transmission lifecycle; and
dynamically creating the linkage associations via a deterministic matching system to avoid persistent storage of identity linkages within the non-transitory computer-readable medium.