Detection and removal of predefined sensitive information types from electronic documents
Automated and semi-automated document redaction technology is disclosed herein. In certain example embodiments, ‘context-aware’ redaction is provided. Automated techniques are used to identify a set of potentially sensitive item(s) within a document. The potentially sensitive item(s) are filtered based on contextual information, such an entity identifier (e.g. person identifier, person group identifier identifying a group of multiple people, organization identifier etc.), resulting in a filtered set of redaction candidate(s). The filtered redaction candidate(s) may, for example, be redacted from the document automatically, or outputted as suggestions in an assisted redaction tool, e.g. via a document redaction graphical user interface. Other example embodiments consider selective redaction when uploading and/or downloading documents via a proxy server, to prevent intended or unintended release of potentially sensitive information, e.g. in a web browsing context.
1. A computer-implemented method comprising:
obtaining an electronic document and an entity identifier associated with the electronic document;
identifying, in the electronic document, a group of redaction candidates, each redaction candidate of the group of redaction candidates comprising a document portion associated with one of a plurality of sensitive information categories, a first redaction candidate of the group of redaction candidates being associated with a particular sensitive information category of the plurality of sensitive information categories and matches the entity identifier itself and a second redaction candidate of the group of redaction candidates being associated with the particular sensitive information category and does not match the entity identifier itself;
filtering, from the group of redaction candidates, ones of the redaction candidates that match the entity identifier itself, resulting in a group of filtered redaction candidates that excludes at least the first redaction candidate based on the first redaction candidate matching the entity identifier itself;
removing only the group of filtered redaction candidates from the electronic document, resulting in a redacted document comprising the first redaction candidate and not the second redaction candidate; and
outputting the redacted document comprising the first redaction candidate;
wherein:
the method is performed by a proxy server; the obtaining of the electronic document comprises:
receiving, from a client device, a download request associated with the entity identifier;
in response to the receiving of the download request, transmitting a proxied download request from the proxy server to an upstream server; and
receiving from the upstream server at the proxy server the electronic document in response to the proxied download request; and
the method further comprises transmitting the redacted document from the proxy server to the client device.
2. The method of claim 1 , further comprising receiving a document search request comprising the entity identifier, wherein the electronic document is obtained from computer-readable storage via a document search based on the entity identifier.
3. The method of claim 1 , wherein the entity identifier comprises a user identifier associated with the client device.
4. The method of claim 1 , wherein the method is performed by a web proxy server and the download request is received from a web browser executed on the client device.
5. The method of claim 1 , wherein:
the obtaining of the electronic document comprises receiving, from a client device, a message comprising the electronic document, the message being associated with the entity identifier; and
the method further comprises transmitting to an upstream server a proxied message comprising the redacted document.
6. The method of claim 5 , wherein the entity identifier comprises a user identifier associated with the client device.
7. The method of claim 5 , wherein the wherein the method is performed by a web proxy server and the message is received from a web browser executed on the client device.
8. The method of claim 7 , wherein:
the obtaining of the electronic document further comprises:
receiving, at the web proxy server and from the client device, a content request comprising a resource identifier;
in response to the content request, retrieving, at the web proxy server, web content associated with the resource identifier;
generating, based on the web content, modified web content comprising proxy client code, wherein the proxy client code is added to the web content to generate the modified web content; and
transmitting the modified web content to the client device, whereby the proxy client code is executed on the client device; and
the method further comprises:
detecting, in the message comprising the electronic document, marker data inserted by the client proxy code executed on the client device, wherein the identifying of the group of redaction candidates, the filtering of the group of redaction candidates, and the removing of the group of filtered redaction candidates from the electronic document are performed in response to the detecting of the marker data.
9. The method of claim 1 , further comprising:
outputting, via a graphical user interface, an indication of the group of filtered redaction candidates including the second redaction candidate; and
receiving input via the graphical user interface to modify the group of filtered redaction candidates.
10. The method of claim 9 , wherein the outputting of the indication of the group of filtered redaction candidates comprises displaying the electronic document via the graphical user interface, wherein the indication of the group of filtered redaction candidates comprises a visual marker marking the group of filtered candidates within the electronic document.
11. The method of claim 9 , comprising outputting, in association with the indication of the second redaction candidate, an indication of the particular sensitive information category.
12. The method of claim 1 , wherein the entity identifier is a person identifier or a person group identifier, wherein the particular sensitive information category is a predefined personal information category.
13. A proxy server comprising:
at least one memory configured to store computer-readable instructions;
at least one processor coupled to the at least one memory and configured to execute the computer-readable instructions, the computer-readable instructions configured, upon execution on the at least one processor, to cause the at least one processor to:
receive, at the proxy server and from a client device, a content request comprising a resource identifier;
in response to the content request, retrieve web content associated with the resource identifier;
generating, based on the web content, modified web content comprising proxy client code, wherein the proxy client code is added to the web content to generate the modified web content; and
transmitting the modified web content to the client device, whereby the proxy client code is executed on the client device;
receive, at the proxy server and from the client device, an upload request comprising a document;
detect, in the upload request, marker data inserted by the client proxy code executed on the client device;
responsive to the detecting of the marker data in the upload request, cause redaction from the document, resulting in a redacted document;
generate a proxied upload request comprising the redacted document; and
transmit the proxied upload request to an upstream server.
14. The proxy server of claim 13 , wherein the computer-readable instructions are further configured to cause the at least one processor to determine an entity identifier based on the upload request, wherein the redaction of the document is based on the entity identifier.
15. The proxy server of claim 14 , wherein the redaction comprises removing sensitive information from the document that does not match the entity identifier.
16. A non-transitory computer-readable storage medium configured to store computer-readable instructions, the computer-readable instructions configured, upon execution on at least one processor, to cause the at least one processor to implement operations comprising:
receiving a message from a client device;
determining an entity identifier associated with the message;
obtaining an electronic document associated with the message; and
identifying, in the electronic document, a group of redaction candidates, each redaction candidate of the group of redaction candidates comprising a document portion associated with one of a plurality of sensitive information categories, a first redaction candidate of the group of redaction candidates being associated with a particular sensitive information category of the plurality of sensitive information categories and matches the entity identifier itself and a second redaction candidate of the group of redaction candidates being associated with the particular sensitive information category and does not match the entity identifier itself;
filtering, from the group of redaction candidates, ones of the redaction candidates that match the entity identifier itself, resulting in a group of filtered redaction candidates that excludes at least the first redaction candidate based on the first redaction candidate matching the entity identifier itself; and
removing only the group of filtered redaction candidates from the electronic document, resulting in a redacted document comprising the first redaction candidate and not the second redaction candidate; wherein:
the method is performed by a proxy server; the obtaining of the electronic document comprises:
receiving, from a client device, a download request associated with the entity identifier;
in response to the receiving of the download request, transmitting a proxied download request from the proxy server to an upstream server; and
receiving from the upstream server at the proxy server the electronic document in response to the proxied download request; and
the method further comprises transmitting the redacted document from the proxy server to the client device.
17. The computer-readable storage medium of claim 16 , wherein:
the message is a download request, and the obtaining of the electronic document comprises transmitting a proxied download request corresponding to the message to an upstream server, and receiving the electronic document from the upstream server in response to the proxied download request, said operations further comprising transmitting to the client device a response comprising the redacted document; or
the message comprises the document, said operations further comprising transmitting to an upstream server a proxied message comprising the redacted document.
18. The computer-readable storage medium of claim 16 , wherein the message comprises a search request indicating the entity identifier and the electronic document is obtained from document storage via a document search performed based on the search request.
19. The computer-readable storage medium of claim 16 , wherein the entity identifier is a user identifier associated with the message or with the client device, wherein the particular sensitive information category is a predefined personal information category.