IP Library Granted Patent US 10,846,485
Granted Patent B2
US 10,846,485 · App. 16/577,793 · Granted Nov 24, 2020

Machine learning model modification and natural language processing

Inventors: David Bacarella (Schaumburg, IL); James H. Barnebee, IV (Winter Park, FL); Nicholas Lawrence (Milwaukee, WI); Sumit Patel (Austin, TX)
Assignee: International Business Machines Corporation
G06F40/40G06F16/3334G06F16/367G06F16/9024G06F40/20G06F40/216G06F40/226G06F40/295G06F40/30G06N5/02G06N5/022G06N5/043G06N20/00H04L9/0637H04L67/104
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,846,485
App. No.
16/577,793
Granted
Nov 24, 2020
Kind
B2
Abstract

A system, computer program product, and method are provided to automate a framework for knowledge graph based persistence of data, and to resolve temporal changes and uncertainties in the knowledge graph. Natural language understanding, together with one or more machine learning models (MLMs), is used to extract data from unstructured information, including entities and entity relationships. The extracted data is populated into a knowledge graph. As the KG is subject to change, the KG is used to create new and retrain existing machine learning models (MLMs). Weighting is applied to the populated data in the form of veracity value. Blockchain technology is applied to the populated data to ensure reliability of the data and to provide auditability to assess changes to the data.

Claims (48)

1. A computer system comprising:

an artificial intelligence platform, in communication with a processing unit;

a knowledge engine operatively coupled to the processing unit to train a machine learning model (MLM), the knowledge engine configured to:

receive natural language (NL) input and query the input against a first knowledge graph (KG), and extract one or more triplets from the first KG;

apply a selected MLM to a second KG different from the first KG, and extract one or more triplets from the second KG, wherein each triplet includes a subject, object, and a relationship;

for each extracted triplet:

obtain a blockchain (BC) identifier associated with each triplet; and

identify a triplet veracity value from a corresponding BC ledger;

detect a modification of the first KG from the extracted one or more triplets from the second KG;

evaluate the detected modification, including employ the obtained BC identifier to assess veracity of the detected modification; and

establish a link between the first KG and the second KG, wherein the link creates a relationship between the first KG and the second KG.

2. The system of claim 1 , further comprising the knowledge engine to:

identify one or more entities and relationships present in the first KG and absent from the selected MLM; and

create the identified entities and relationships as consumable data.

3. The system of claim 2 , further comprising the knowledge engine to stream the consumable data to update the structure of the selected MLM, and store the updated selected MLM as a new MLM.

4. The system of claim 1 , further comprising the knowledge engine to compare the linked first KG and second KG, the comparison comprising an evaluation of corresponding one or more veracity value components.

5. The system of claim 4 , wherein a conflict between two or more data elements in the linked first KG and second KG are identified and selectively replaced based on at least one of the one or more veracity value components.

6. A computer program product to process natural language (NL), the computer program product comprising a computer readable storage device having program code embodied therewith, the program code executable by a processing unit to:

receive NL input and query the input against a first knowledge graph (KG), and extract one or more triplets from the first KG;

apply a selected machine learning model (MLM) to a second KG different from the first KG, and extract one or more triplets from the second KG, wherein each triplet includes a subject, object, and a relationship, and for each extracted triplet:

obtain a blockchain (BC) identifier associated with each triplet; and

identify a triplet veracity value from a corresponding BC ledger;

detect a modification of the first KG from the extracted one or more triplets from the second KG;

evaluate the detected modification, including employ the obtained BC identifier to assess veracity of the detected modification; and

establish a link between the first KG and the second KG, wherein the link creates a relationship between the first KG and the second KG.

7. The computer program product of claim 6 , further comprising the program code to:

identify one or more entities and relationships present in the first KG and absent from the selected MLM; and

create the identified entities and relationships as consumable data.

8. The computer program product of claim 7 , further comprising the program code to stream the consumable data to update the structure of the selected MLM, and store the updated selected MLM as a new MLM.

9. The computer program product of claim 6 , further comprising the program code to compare the linked first KG and second KG, the comparison comprising an evaluation of corresponding one or more veracity value components.

10. The computer program product of claim 9 , wherein a conflict between two or more data elements in the linked first KG and second KG are identified and selectively replaced based on at least one of the one or more veracity value components.

11. A method for processing natural language (NL), comprising:

receiving NL input and querying the input against a first knowledge graph (KG), and extracting one or more triplets from the first KG;

applying a selected machine learning model (MLM) to a second KG different from the first KG, and extracting one or more triplets from the second KG, wherein each triplet includes a subject, object, and a relationship, and for each extracted triplet:

obtaining a blockchain (BC) identifier associated with each triplet; and

identifying a triplet veracity value from a corresponding BC ledger;

detecting a modification of the first KG from the extracted one or more triplets from the second KG;

evaluating the detected modification, including employing the obtained BC identifier to assess veracity of the detected modification; and

establishing a link between the first KG and the second KG, wherein the link creates a relationship between the first KG and the second KG.

12. The method of claim 11 , further comprising:

identifying one or more entities and relationships present in the first KG and absent from the selected MLM; and

creating the identified entities and relationships as consumable data.

13. The method of claim 12 , further comprising streaming the consumable data to update the structure of the selected MLM, and storing the updated selected MLM as a new MLM.

14. The method of claim 11 , further comprising comparing the linked first KG and second KG, the comparison comprising an evaluation of corresponding one or more veracity value components.

15. The method of claim 14 , wherein a conflict between two or more data elements in the linked first KG and second KG is identified and selectively replaced based on at least one of the one or more veracity value components.

16. The system of claim 1 , wherein the link maintains a structure of the first KG and the second KG.

17. The computer program product of claim 6 , wherein the link maintains a structure of the first KG and the second KG.

18. The method of claim 11 , wherein the link maintains a structure of the first KG and the second KG.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2019
From: BACARELLA, DAVID; BARNEBEE, JAMES H., IV; LAWRENCE, NICHOLAS; PATEL, SUMIT
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 050447/0628 →
Continuity (2)
Continuation 15866706 · Jan 10, 2018
Related Publication 20200019613A1 · Jan 16, 2020
Cited By (2)
US 12,596,767 US 12,639,475