IP Library › Granted Patent US 12,321,492
Granted Patent B2
US 12,321,492 · App. 16/458,462 · Granted Jun 3, 2025

Cognitive iterative minimization of personally identifiable information in electronic documents

Inventors: Kristen M. Summers (Takoma Park, MD); Stephen A. Boxwell (Columbus, OH); Keith G. Frost (Delaware, OH); Kyle M. Brake (Dublin, OH); Stanley J. Vernier (Grove City, OH)
Assignee: International Business Machines Corporation
G06F21/6254G06F40/295G06F40/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,321,492
App. No.
16/458,462
Filed
Jul 1, 2019
Granted
Jun 3, 2025
Kind
B2
Art Unit
2178
USPC
726/26
Abstract

Mechanisms are provided to minimize personally identifiable information (PII) in an electronic document. An iterative personally identifiable information minimization (IPIIM) engine receives an electronic document comprising natural language content having a mention of a protected entity and obfuscates the mention of the protected entity to thereby generate a minimized natural language content. A question answering system processes the minimized natural language content to generate a listing of candidate answers and corresponding confidence scores and the IPIIM engine determines whether or not the minimized natural language content is sufficiently obfuscated based on the listing of candidate answers and corresponding confidence scores. In response to determining that the minimized natural language content is sufficiently obfuscated, the minimized natural language content is provided for processing by a requestor computing device.

Claims (49)

1. A method, in a data processing system comprising at least one processor and at least one memory, the at least one memory comprising instructions executed by the at least one processor to cause the at least one processor to minimize personally identifiable information (PII) in an electronic document, the method comprising:

receiving, by an iterative personally identifiable information minimization (IPIIM) engine executing in the data processing system, the electronic document comprising natural language content having a mention of a protected entity;

applying, by the IPIIM engine, natural language processing and analytic analysis on the natural language content to obfuscate the mention of the protected entity and thereby generate a first minimized natural language content, wherein the obfuscated mention of the protected entity is indicated to be a focus in the first minimized natural language content;

automatically processing, by a question answering computing system, the first minimized natural language content, as input to the question answering computing system, to generate a first listing of one or more candidate answers and corresponding confidence scores, wherein the one or more candidate answers specify predictions of the protected entity, in the mention of the protected entity, prior to the obfuscation of the mention of the protected entity, and wherein the question answering computing system comprises artificial intelligence computer logic configured to predict an answer corresponding to the focus of the input to the question answering computing system;

determining, by the IPIIM engine, whether or not the first minimized natural language content is sufficiently obfuscated based on the first listing of one or more candidate answers and corresponding confidence scores, wherein the first minimized natural language content is determined to not be sufficiently obfuscated in response to a correct identity of the protected entity being present in a candidate answer, of the one or more candidate answers, which has a corresponding confidence score equal to or above a predetermined threshold confidence score; and

in response to determining that the first minimized natural language content is sufficiently obfuscated, providing the first minimized natural language content as a final minimized natural language content of the electronic document for processing by a requestor computing device.

2. The method of claim 1 , further comprising, in response to determining that the first minimized natural language content is not sufficiently obfuscated, iteratively performing additional minimizations of elements present in the natural language content to increase obfuscation/minimization of elements in the natural language content until a sufficient level of obfuscation is achieved to cause the question answering system to not include the correct identity of the protected entity in the first listing of one or more candidate answers with a corresponding confidence score equal to or higher than a predetermined threshold confidence score.

3. The method of claim 1 , further comprising, in response to determining that the first minimized natural language content is not sufficiently obfuscated:

automatically performing obfuscation of one or more additional elements of the first minimized natural language content to generate second minimized natural language content, wherein the obfuscation of the one or more additional elements comprises designating each of the one or more additional elements as foci for answer generation by the question answering computing system;

processing, by the question answering computing system, the second minimized natural language content to generate a second listing of one or more candidate answers and corresponding confidence scores;

determining, by the IPIIM engine, whether or not the second minimized natural language content is sufficiently obfuscated based on the second listing of one or more candidate answers and corresponding confidence scores; and

in response to determining that the second minimized natural language content is sufficiently obfuscated, providing the second minimized natural language content as a final minimized natural language content of the electronic document for processing by the requestor computing device.

4. The method of claim 1 , further comprising receiving a listing of protected entities whose identities are to be protected in content of electronic documents, wherein applying, by the IPIIM engine, natural language processing and analytic analysis on the natural language content to obfuscate the mention of the protected entity and thereby generate the first minimized natural language content comprises identifying mentions in the natural language content that match an entity in the listing of protected entities.

5. The method of claim 1 , wherein processing, by the question answering computing system, the first minimized natural language content to generate the first listing of one or more candidate answers and corresponding confidence scores comprises:

generating a first input question based on the first minimized natural language content; and

processing the first input question by the question answering computing system at least by applying one or more queries to a reference document corpus to generate the first listing of one or more candidate answers.

6. The method of claim 1 , wherein the requestor computing device is a cognitive computing system that performs operations on the final minimized natural language content without exposing an identity of the protected entity.

7. The method of claim 6 , wherein the operation performed by the cognitive computing system includes one of an application development operation for developing an application or a debugging operation for debugging an application that operates on the natural language content of the electronic document.

8. The method of claim 1 , wherein the requestor computing device comprises a cognitive decision support system that performs operations for generating a decision support output, and wherein the requestor computing device performs, in an application development environment of the requestor computing device, an application development operation for developing an application of the cognitive decision support system based on processing of the final minimized natural language content of the electronic document by the cognitive decision support system, without exposing an identity of the protected entity to the application development environment.

9. A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed by a data processing system, causes the data processing system to:

receive, by an iterative personally identifiable information minimization (IPIIM) engine executing in the data processing system, an electronic document comprising natural language content having a mention of a protected entity;

apply, by the IPIIM engine, natural language processing and analytic analysis on the natural language content to obfuscate the mention of the protected entity and thereby generate a first minimized natural language content, wherein the obfuscated mention of the protected entity is indicated to be a focus in the first minimized natural language content;

automatically process, by a question answering computing system, the first minimized natural language content, as input to the question answering computing system, to generate a first listing of one or more candidate answers and corresponding confidence scores, wherein the one or more candidate answers specify predictions of the protected entity, in the mention of the protected entity, prior to the obfuscation of the mention of the protected entity, and wherein the question answering computing system comprises artificial intelligence computer logic configured to predict an answer corresponding to the focus of the input to the question answering computing system;

determine, by the IPIIM engine, whether or not the first minimized natural language content is sufficiently obfuscated based on the first listing of one or more candidate answers and corresponding confidence scores, wherein the first minimized natural language content is determined to not be sufficiently obfuscated in response to a correct identity of the protected entity being present in a candidate answer, of the one or more candidate answers, which has a corresponding confidence score equal to or above a predetermined threshold confidence score; and

in response to determining that the first minimized natural language content is sufficiently obfuscated, provide the first minimized natural language content as a final minimized natural language content of the electronic document for processing by a requestor computing device.

10. The computer program product of claim 9 , wherein the computer readable program further causes the data processing system, in response to determining that the first minimized natural language content is not sufficiently obfuscated, to iteratively perform additional minimizations of elements present in the natural language content to increase obfuscation/minimization of elements in the natural language content until a sufficient level of obfuscation is achieved to cause the question answering computing system to not include the correct identity of the protected entity in the first listing of one or more candidate answers with a corresponding confidence score equal to or higher than a predetermined threshold confidence score.

11. The computer program product of claim 9 , wherein the computer readable program further causes the data processing system, in response to determining that the first minimized natural language content is not sufficiently obfuscated, to:

automatically perform obfuscation of one or more additional elements of the first minimized natural language content to generate second minimized natural language content, wherein the obfuscation of the one or more additional elements comprises designating each of the one or more additional elements as foci for answer generation by the question answering computing system;

process, by the question answering computing system, the second minimized natural language content to generate a second listing of one or more candidate answers and corresponding confidence scores;

determine, by the IPIIM engine, whether or not the second minimized natural language content is sufficiently obfuscated based on the second listing of one or more candidate answers and corresponding confidence scores; and

in response to determining that the second minimized natural language content is sufficiently obfuscated, provide the second minimized natural language content as a final minimized natural language content of the electronic document for processing by the requestor computing device.

12. The computer program product of claim 9 , wherein the computer readable program further causes the data processing system to receive a listing of protected entities whose identities are to be protected in content of electronic documents, wherein applying, by the IPIIM engine, natural language processing and analytic analysis on the natural language content to obfuscate the mention of the protected entity and thereby generate the first minimized natural language content comprises identifying mentions in the natural language content that match an entity in the listing of protected entities.

13. The computer program product of claim 9 , wherein processing, by the question answering computing system, the first minimized natural language content to generate the first listing of one or more candidate answers and corresponding confidence scores comprises:

generating a first input question based on the first minimized natural language content; and

processing the first input question by the question answering computing system at least by applying one or more queries to a reference document corpus to generate the first listing of one or more candidate answers.

14. The computer program product of claim 9 , wherein the requestor computing device is a cognitive computing system that performs operations on the final minimized natural language content without exposing an identity of the protected entity.

15. The computer program product of claim 14 , wherein the operation performed by the cognitive computing system includes one of an application development operation for developing an application or a debugging operation for debugging an application that operates on the natural language content of the electronic document.

16. The computer program product of claim 9 , wherein the requestor computing device comprises a cognitive decision support system that performs operations for generating a decision support output, and wherein the requestor computing device performs, in an application development environment of the requestor computing device, an application development operation for developing an application of the cognitive decision support system based on processing of the final natural language content of the minimized electronic document by the cognitive decision support system, without exposing an identity of the protected entity to the application development environment.

17. An apparatus comprising:

a processor; and

a memory coupled to the processor, wherein the memory comprises instructions which, when executed by the processor, cause the processor to:

receive, by an iterative personally identifiable information minimization (IPIIM) engine executing on the processor, an electronic document comprising natural language content having a mention of a protected entity;

apply, by the IPIIM engine, natural language processing and analytic analysis on the natural language content to obfuscate the mention of the protected entity and thereby generate a first minimized natural language content, wherein the obfuscated mention of the protected entity is indicated to be a focus in the first minimized natural language content;

automatically process, by a question answering computing system, the first minimized natural language content, as input to the question answering computing system, to generate a first listing of one or more candidate answers and corresponding confidence scores, wherein the one or more candidate answers specify predictions of the protected entity, in the mention of the protected entity, prior to the obfuscation of the mention of the protected entity, and wherein the question answering computing system comprises artificial intelligence computer logic configured to predict an answer corresponding to the focus of the input to the question answering computing system;

determine, by the IPIIM engine, whether or not the first minimized natural language content is sufficiently obfuscated based on the first listing of one or more candidate answers and corresponding confidence scores, wherein the first minimized natural language content is determined to not be sufficiently obfuscated in response to a correct identity of the protected entity being present in a candidate answer, of the one or more candidate answers, which has a corresponding confidence score equal to or above a predetermined threshold confidence score; and

in response to determining that the first minimized natural language content is sufficiently obfuscated, provide the first minimized natural language content as a final minimized natural language content of the electronic document for processing by a requestor computing device.

18. The apparatus of claim 17 , wherein the instructions further cause the processor, in response to determining that the first minimized natural language content is not sufficiently obfuscated, to iteratively perform additional minimizations of elements present in the natural language content to increase obfuscation/minimization of elements in the natural language content until a sufficient level of obfuscation is achieved to cause the question answering computing system to not include the correct identity of the protected entity in the first listing of one or more candidate answers with a corresponding confidence score equal to or higher than a predetermined threshold confidence score.

19. The apparatus of claim 17 , wherein the instructions further cause the processor to receive a listing of protected entities whose identities are to be protected in content of electronic documents, wherein applying, by the IPIIM engine, natural language processing and analytic analysis on the natural language content to obfuscate the mention of the protected entity and thereby generate the first minimized natural language content comprises identifying mentions in the natural language content that match an entity in the listing of protected entities.

20. The method of claim 1 , wherein the question answering computing system comprises a multi-focus factoid question answering system comprising artificial intelligence computer logic configured to predict entity identities for a plurality of foci in an input to the question answering computing system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 1, 2019
From: SUMMERS, KRISTEN M.; BOXWELL, STEPHEN A.; FROST, KEITH G.; BRAKE, KYLE M.; VERNIER, STANLEY J.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 049640/0602 →
Continuity (1)
Related Publication 20210004485A1 · Jan 7, 2021
References Cited (29)
US 6668325B1 · Collberg · 2003 [cited by examiner]
US 8930178B2 · Pestian et al. · 2015 [cited by applicant]
US 9965548B2 · Haggar et al. · 2018 [cited by applicant]
US 10095727B2 · Waltinger · 2018 [cited by applicant]
US 20080016372A1 · Staddon et al. · 2008 [cited by applicant]
US 20090164878A1 · Cottrille · 2009 [cited by applicant]
US 20100070396A1 · Schrichte · 2010 [cited by applicant]
US 20100306854A1 · Neergaard · 2010 [cited by examiner]
US 20110125734A1 · Duboue et al. · 2011 [cited by applicant]
US 20110247081A1 · Shelton · 2011 [cited by applicant]
US 20140317049A1 · DeRoller · 2014 [cited by applicant]
US 20150039579A1 · Clark et al. · 2015 [cited by applicant]
US 20150100564A1 · Clark · 2015 [cited by examiner]
US 20160110352A1 · Bendersky et al. · 2016 [cited by applicant]
US 20170351663A1 · Sordoni et al. · 2017 [cited by applicant]
CN 104699741A · 2015 [cited by applicant]
CN 105144205A · 2015 [cited by applicant]
Boxwell, Stephen A. et al., “Determining Answers to a Question that Includes Multiple Foci”, filed May 2, 2018, U.S. Appl. No. 15/969,154. [cited by applicant]
Boxwell, Stephen A. et al., “Efficient Resolution of Syntactic Patterns in Question and Answer Pairs in an N-Ary Focus Cognitive QA System”, filed Oct. 23, 2018, U.S. Appl. No. 16/168,718. [cited by applicant]
Boxwell, Stephen A. et al., “Identification of Multiple Foci for Topic Summaries in a Question Answering System”, filed Nov. 7, 2018, U.S. Appl. No. 16/182,877. [cited by applicant]
High, Rob, “The Era of Cognitive Systems: An Inside Look at IBM Watson and How it Works”, IBM Corporation, Redbooks, Dec. 12, 2012, 16 pages. [cited by applicant]
Kargupta, Hillol et al., “Privacy Sensitive Distributed Data Mining from Multi-party Data”, International Conference on Intelligence and Security Informatics. Springer, Berlin, Heidelberg, 2003, pp. 336-342. [cited by applicant]
Nagaraj, Kalyan et al., “Identification of network communities and assessment of privacy using hybrid algorithm”, 2017 2nd International Conference on Computational Systems and Information Technology for Sustainable Sol… [cited by applicant]
Perez-Lainez, Rebeca et al., “Anonimytext: Anonimization of Unstructed Documents”, Proceedings of the International Conference on Knowledge Discovery and Information Retrieval, Oct. 6-8, 2009. First International Joint … [cited by applicant]
Ruch, Patrick et al., “Medical Document Anonymization with a Semantic Lexicon”, Proceedings of the AMIA Symposium. American Medical Informatics Association, 2000, pp. 729-733. [cited by applicant]
Szarvas, Gyorgy et al., “State-of-the-art Anonymization of Medical Records Using an Iterative Machine Learning Framework”, Journal of the American Medical Informatics Association 14.5 (2007): 574-580. [cited by applicant]
Yuan, Michael J., “Watson and Healthcare, How natural language processing and semantic search could revolutionize clinical decision support”, IBM Corporation, developerWorks, http://www.ibm.com/developerworks/industry/l… [cited by applicant]
Chinese Patent Office, “Second Office Action issued,” Jul. 6, 2024, 18 Pages, Application No. 202010332591.8. [cited by applicant]
Notification of the Third Office Action dated Sep. 24, 2024 received from the National Intellectual Property Administration, PRC for Application No. 202010332591.8, 11 pages. [cited by applicant]