Tokenization systems and methods for redaction
A tokenization system receives a request for redaction of sensitive textual content in a document, identifies a portion of the document as the sensitive textual content, and edits the document, including replacing the sensitive textual content thus identified with tokens, each token having a token value and a pattern that identifies a start and an end of the token value. The editing produces a transformed version of the document with the tokens and without the sensitive textual content. The tokenization system may then communicates the transformed version of the document with the tokens and without the sensitive textual content to the client computing system, an automated recognition service, or a redaction plug-in to a frontend application.
1 . A method for securing data, the method comprising:
receiving, by a tokenization system from a client computing system, a request for redaction of sensitive textual content in a document;
identifying, by the tokenization system, a portion of the document as the sensitive textual content;
generating, by the tokenization system, patterned tokens to replace the sensitive textual content, each patterned token comprising:
a token value; and
a human-readable visual marker pair, the visual marker pair comprising a first marker that identifies a start of the token value, the visual marker pair further comprising a second marker that identifies an end of the token value, the human-readable visual marker pair having a sequence repeating at the beginning and the end of each token value among the patterned tokens, the sequence being distinct from other patterns in the document; and
editing, by the tokenization system, the document, the editing including replacing the sensitive textual content thus identified with the patterned tokens, the editing producing a transformed version of the document with the patterned tokens and without the sensitive textual content, thereby enabling subsequent reveal of the sensitive textual content using the patterned tokens.
2 . The method according to claim 1 , wherein the patterned tokens comprise a self-describing token.
3 . The method according to claim 2 , wherein the self-describing token contains a protection strategy that specifies a technique for generating or formatting a surrogate for an actual value and for mapping between the surrogate and the actual value.
4 . The method according to claim 1 , further comprising:
marking the patterned tokens with the visual markers; and
presenting the visual markers with the transformed version of the document through a user interface so that changes made to the document are visible to a user through the user interface.
5 . The method according to claim 1 , wherein the pattern comprises brackets, wherein the start comprises a first of the brackets, and wherein the end comprises a second of the brackets.
6 . The method according to claim 1 , wherein the sensitive textual content is stored in a secure data vault.
7 . The method according to claim 1 , further comprising:
communicating the transformed version of the document with the tokens and without the sensitive textual content to the client computing system, an automated recognition service, or a redaction plug-in to a frontend application.
8 . A tokenization system for securing data, the tokenization system comprising:
a processor;
a non-transitory computer-readable medium; and
stored instructions translatable by the processor for:
receiving, from a client computing system, a request for redaction of sensitive textual content in a document;
identifying a portion of the document as the sensitive textual content;
generating patterned tokens to replace the sensitive textual content, each patterned token comprising:
a token value; and
a human-readable visual marker pair, the visual marker pair comprising a first marker that identifies a start of the token value, the visual marker pair further comprising a second marker that identifies an end of the token value, the human-readable visual marker pair having a sequence repeating at the beginning and the end of each token value among the patterned tokens, the sequence being distinct from other patterns in the document; and
editing the document, the editing including replacing the sensitive textual content thus identified with the patterned tokens, the editing producing a transformed version of the document with the patterned tokens and without the sensitive textual content, thereby enabling subsequent reveal of the sensitive textual content using the patterned tokens.
9 . The tokenization system of claim 8 , wherein the patterned tokens comprise a self-describing token.
10 . The tokenization system of claim 9 , wherein the self-describing token contains a protection strategy that specifies a technique for generating or formatting a surrogate for an actual value and for mapping between the surrogate and the actual value.
11 . A computer program product for tokenization, the computer program product comprising a non) The tokenization system of claim 8 , wherein the stored instructions are further translatable by the processor for:
marking the patterned tokens with the visual markers; and
presenting the visual markers with the transformed version of the document through a user interface so that changes made to the document are visible to a user through the user interface.
12 . The tokenization system of claim 8 , wherein the pattern comprises brackets, wherein the start comprises a first of the brackets, and wherein the end comprises a second of the brackets.
13 . The tokenization system of claim 8 , wherein the sensitive textual content is stored in a secure data vault.
14 . The tokenization system of claim 8 , wherein the stored instructions are further translatable by the processor for:
communicating the transformed version of the document with the patterned tokens and without the sensitive textual content to the client computing system, an automated recognition service, or a redaction plug-in to a frontend application.
15 . A computer program product for tokenization, the computer program product comprising a non-transitory computer-readable medium storing instructions translatable by a processor of a tokenization system for:
receiving, from a client computing system, a request for redaction of sensitive textual content in a document;
identifying a portion of the document as the sensitive textual content;
generating patterned tokens to replace the sensitive textual content, each patterned token comprising:
a token value; and
a human-readable visual marker pair, the visual marker pair comprising a first marker that identifies a start of the token value, the visual marker pair further comprising a second marker that identifies an end of the token value, the human-readable visual marker pair having a sequence repeating at the beginning and the end of each token value among the patterned tokens, the sequence being distinct from other patterns in the document; and
editing the document, the editing including replacing the sensitive textual content thus identified with the patterned tokens, the editing producing a transformed version of the document with the patterned tokens and without the sensitive textual content, thereby enabling subsequent reveal of the sensitive textual content using the patterned tokens.
16 . The computer program product of claim 15 , wherein the patterned tokens comprise a self-describing token.
17 . The computer program product of claim 16 , wherein the self-describing token contains a protection strategy that specifies a technique for generating or formatting a surrogate for an actual value and for mapping between the surrogate and the actual value.
18 . A computer program product for tokenization, the computer program product comprising a non) The computer program product of claim 15 , wherein the instructions are further translatable by the processor for:
marking the patterned tokens with the visual markers; and
presenting the visual markers with the transformed version of the document through a user interface so that changes made to the document are visible to a user through the user interface.
19 . The computer program product of claim 15 , wherein the pattern comprises brackets, wherein the start comprises a first of the brackets, and wherein the end comprises a second of the brackets.
20 . The computer program product of claim 15 , wherein the instructions are further translatable by the processor for:
communicating the transformed version of the document with the patterned tokens and without the sensitive textual content to the client computing system, an automated recognition service, or a redaction plug-in to a frontend application.