Adaptive redaction and data releasability systems using dynamic parameters and user defined rule sets
Methods, systems and computer program products are provided to automate redaction of data and metadata. Without modification of the underlying source code, a user may modify, add or remove rules and/or templates for governing redaction of data and metadata of source artifacts. Additionally, the system may automatically infer relationships between modified metadata parameters from application updates and normalized metadata parameters. In some cases, the system may add metadata to the redacted work products for compliance or other purposes. Additionally, redacted work products may comprise redacted source artifacts and a list of rules and/or templates applied to the source artifacts during redaction.
1. A computer implemented method of automating redaction of data and metadata of source artifacts in electronic format comprising:
receiving, from a client device, a request to redact data and metadata of source artifacts based on pre-defined rules and/or templates that govern redaction of the data and the metadata;
extracting metadata parameters from the source artifacts using a language parser, and mapping the extracted metadata parameters to normalized metadata parameters that are operated on by the redaction engine, wherein extracted metadata parameters of a same parameter type are mapped to a same normalized metadata parameter; and
applying the predefined rules and/or the templates to the source artifacts to generate, by the redaction engine, a redacted product.
2. The method of claim 1 , further comprising:
determining at least one metadata parameter has been modified, when the metadata parameter is not mapped to a corresponding normalized metadata parameter; and
inferring an identity of the modified metadata parameter, and automatically mapping the modified metadata parameter to the corresponding normalized metadata parameter.
3. The method of claim 2 , further comprising:
inferring the identity of the modified metadata parameter based on similarity to an unmatched normalized parameter, an order of parameters in a header, or characteristics of a value of the modified metadata parameter.
4. The method of claim 3 , further comprising:
providing a notification to a user when the identity of the modified metadata parameter is not inferred.
5. The method of claim 1 , further comprising:
compressing the redacted product.
6. The method of claim 1 , wherein the source artifacts comprise text, image, or video and corresponding metadata associated with the text, image, or video source artifacts.
7. The method of claim 1 , wherein the redaction engine may be integrated into a host application configured to access the source artifacts.
8. The method of claim 1 , further comprising:
adding new metadata or new data to the redacted product according to a data addition rule.
9. The method of claim 1 , further comprising:
receiving a command to change a pre-defined rule or a template; and
updating the pre-defined rule or the template without modifying underlying source code of the redaction engine.
10. The method of claim 9 , further comprising:
sending a notification to an administrator to approve or deny the command.
11. The method of claim 1 , wherein sets of predefined rules and templates are associated with redaction processes to create redacted products for specific users.
12. A system for automating redaction of data and metadata of source artifacts in electronic format comprising one or more processors configured to:
receive, from a client device, a request to redact data and metadata of source artifacts based on pre-defined rules and/or templates that govern redaction of the data and the metadata;
extract metadata parameters from the source artifacts using a language parser, and map the extracted metadata parameters to normalized metadata parameters that are operated on by the redaction engine, wherein extracted metadata parameters of a same parameter type are mapped to a same normalized metadata parameter; and
apply the predefined rules and/or the templates to the source artifacts to generate, by the redaction engine, a redacted product.
13. The system of claim 12 , wherein the one or more processors are further configured to:
determine that at least one metadata parameter has been modified, when the metadata parameter is not mapped to a corresponding normalized metadata parameter; and
infer an identity of the modified metadata parameter, and automatically map the modified metadata parameter to the corresponding normalized metadata parameter.
14. The system of claim 13 , wherein the one or more processors are further configured to:
infer the identity of the modified metadata parameter based on similarity to an unmatched normalized parameter, an order of parameters in a header, or characteristics of a value of the modified metadata parameter.
15. The system of claim 14 , wherein the one or more processors are further configured to:
provide a notification to a user when the identity of the modified metadata parameter is not inferred.
16. The system of claim 12 , wherein the one or more processors are further configured to:
compress the redacted product.
17. The system of claim 12 , wherein the source artifacts comprise text, image, or video and corresponding metadata associated with the text, image, or video source artifacts.
18. The system of claim 12 , wherein the redaction engine may be integrated into a host application configured to access the source artifacts.
19. The system of claim 12 , wherein the one or more processors are further configured to:
add new metadata or new data to the redacted product according to a data addition rule.
20. The system of claim 12 , wherein the one or more processors are further configured to:
receive a command to change a pre-defined rule or a template; and
update the pre-defined rule or the template without modifying underlying source code of the redaction engine.
21. The system of claim 20 , wherein the one or more processors are further configured to:
send a notification to an administrator to approve or deny the command.
22. The system of claim 12 , wherein sets of predefined rules and templates are associated with redaction processes to create redacted products for specific users.
23. A computer program product for automating redaction of data and metadata of source artifacts in electronic format, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by one or more processors to:
receive, from a client device, a request to redact data and metadata of source artifacts based on pre-defined rules and/or templates that govern redaction of the data and the metadata;
extract metadata parameters from the source artifacts using a language parser, and map the extracted metadata parameters to normalized metadata parameters that are operated on by the redaction engine, wherein extracted metadata parameters of a same parameter type are mapped to a same normalized metadata parameter; and
apply the predefined rules and/or the templates to the source artifacts to generate, by the redaction engine, a redacted product.