Data governance utilizing pattern based signet control
A data governance system includes a signet template generator engine, a signet specification enforcement, and a pattern based signet controller. The signet template generator engine generates a signet template by applying at least one signet to raw data received from a data producer. The at least one signet is designated with a consent level and includes at least one data field designated with a consent identifier. The signet specification enforcement engine analyzes the consent level of the at least one signet and the consent identifier of the at least one data field, and outputs first filtered data based on the consent identifier of the at least one data field. The pattern based signet controller generates second filtered data based on the consent level of the at least one signet, and outputs a combination of the first filter data and the second filtered data as final data.
1 . A data governance system comprising:
a memory having computer readable instructions; and
a processor for executing the computer readable instructions, the computer readable instructions when executed cause the processor to perform operations comprising:
controlling a signet template generator (STG) engine configured to generate a signet template by applying at least one signet to raw data received from a data producer, the at least one signet being designated with a consent level and including at least one data field designated with a consent identifier;
controlling a signet specification enforcement (SPE) engine in signal communication with the STG engine to receive the signet template, wherein the SPE engine is configured to analyze the consent level of the at least one signet and the consent identifier of the at least one data field, and wherein the SPE engine is configured to output first filtered data based on the consent identifier of the at least one data field;
controlling a pattern based signet controller (PBSC) in signal communication with the SPE engine, wherein the PBSC is configured to generate second filtered data based on the consent level of the at least one signet, and wherein the PBSC is configured to output a combination of the first filtered data and the second filtered data as final data to an external remote server for external access; and
controlling a data security module configured to obtain historical data associated with the at least one signet and configured to perform a signet verification process based on the historical data,
wherein the signet verification process includes detecting an anomaly with the at least one signet in response to determining at least one of the consent level does not match the previously designated consent level and the consent identifier does not match the previously designated consent identifier.
2 . The data governance system of claim 1 , wherein the first filtered data restricts output of the at least one data field to the PBSC based on the consent identifier.
3 . The data governance system of claim 2 , wherein the second filtered data restricts output of the at least one signet to the external remote server based on the consent level.
4 . The data governance system of claim 1 , wherein the historical data indicates a previously designated consent level of the at least one signet and a previously designated consent identifier of the at least one data field.
5 . The data governance system of claim 1 , wherein the PBSC is configured to store at least one rubric pattern associated with at least one insight used to generate the at least one signet applied to the raw data and exclude the at least one insight from the final data based on the at least one rubric pattern.
6 . A computer-implemented method comprising:
receiving raw data from a data producer;
generating, by a signet template generator (STG) engine, a signet template by applying at least one signet to the raw data, the at least one signet being designated with a consent level and including at least one data field designated with a consent identifier;
analyzing, by a signet specification enforcement (SPE) engine, the consent level of the at least one signet and the consent identifier of the at least one data field;
outputting, by the SPE engine, first filtered data based on the consent identifier of the at least one data field;
generating, by a pattern based signet controller (PBSC), second filtered data based on the consent level of the at least one signet;
providing historical data associated with the at least one signet to a data security module;
performing, by the data security module, a signet verification process based on the historical data that indicates a previously designated consent level of the at least one signet and a previously designated consent identifier of the at least one data field, wherein the signet verification process comprises detecting an anomaly with the at least one signet in response to determining at least one of the consent level does not match the previously designated consent level and the consent identifier does not match the previously designated consent identifier; and
outputting, by the PBSC, a combination of the first filtered data and the second filtered data as final data to an external remote server for external access.
7 . The computer-implemented method of claim 6 , further comprising filtering the first filtered data by restricting output of the at least one data field to the PBSC based on the consent identifier.
8 . The computer-implemented method of claim 7 , further comprising filtering the second filtered data by restricting output of the at least one signet to the external remote server based on the consent level.
9 . The computer-implemented method of claim 6 , further comprising:
storing in the PBSC at least one rubric pattern associated with at least one insight used to generate the at least one signet applied to the raw data; and
excluding the at least one insight from the final data based on the at least one rubric pattern.
10 . A computer program product to control a computing system to perform data governance, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by an electronic computer processor to control the computing system to perform operations comprising:
receiving raw data from a data producer;
generating, by a signet template generator (STG) engine, a signet template by applying at least one signet to the raw data, the at least one signet being designated with a consent level and including at least one data field designated with a consent identifier;
analyzing, by a signet specification enforcement (SPE) engine, the consent level of the at least one signet and the consent identifier of the at least one data field;
outputting, by the SPE engine, first filtered data based on the consent identifier of the at least one data field;
generating, by a pattern based signet controller (PBSC), second filtered data based on the consent level of the at least one signet;
providing historical data associated with the at least one signet to a data security module;
performing, by the data security module, a signet verification process based on the historical data that indicates a previously designated consent level of the at least one signet and a previously designated consent identifier of the at least one data field, wherein the signet verification process comprises detecting an anomaly with the at least one signet in response to determining at least one of the consent level does not match the previously designated consent level and the consent identifier does not match the previously designated consent identifier; and
outputting, by the PBSC, a combination of the first filtered data and the second filtered data as final data to an external remote server for external access.
11 . The computer program product of claim 10 , further comprising filtering the first filtered data by restricting output of the at least one data field to the PBSC based on the consent identifier.
12 . The computer program product of claim 11 , further comprising filtering the second filtered data by restricting output of the at least one signet to the external remote server based on the consent level.
13 . The computer program product of claim 10 , wherein the signet verification process comprises:
generating, by the data security module, an alert in response to detecting the anomaly.