IP Library Granted Patent US 10,242,320
Granted Patent B1
US 10,242,320 · App. 15/957,838 · Granted Mar 26, 2019

Machine assisted learning of entities

Inventors: Alexander Hussam Elkholy (Seattle, WA); Balasubramanian Kandaswamy (Redmond, WA); Steven Matt Gustafson (Sammamish, WA); Hussein S. Al-Olimat (Dayton, OH)
Assignee: Maana, Inc.
G06N20/00G06F16/93G06F17/274G06F17/278G06F17/30011G06N99/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,242,320
App. No.
15/957,838
Granted
Mar 26, 2019
Kind
B1
Abstract

A data model is traversed to determine concept characteristics associated with concepts that may be associated with entities. Associated documents may be evaluated to identify document characteristics associated with the entities. Entity models may be trained based on the concept characteristics and the document characteristics with each entity model being associated with a confidence value. Results for one or more queries based on the documents and the entity models may be provided. The results may reference the documents that may be associated with the entities. Some entity models may produce results that have a confidence value below a threshold value. Accordingly, the entity models that provide low confidence results may be re-trained.

Claims (104)

1. A method for managing data using one or more processors, included in one or more network computers, to execute instructions for implementing a modeling platform server that performs actions, comprising:

instantiating a data engine that performs actions including:

providing a data model that includes one or more concepts and one or more relations between the concepts, wherein each concept is a node in the data model and each relation is an edge in the data model; and

providing one or more documents that include one or more entities, wherein the one or more entities are associated with the one or more concepts; and

instantiating a training engine that performs actions, including:

traversing the data model to determine one or more concept characteristics associated with the one or more concepts that are associated with the one or more entities;

evaluating the one or more documents to identify one or more document characteristics associated with the one or more entities; and

training one or more entity models based on the one or more concept characteristics and the one or more document characteristics, wherein each entity model is associated with a confidence value; and

instantiating a query engine to perform actions including:

resolving results for one or more queries based on the one or more documents and the one or more entity models, wherein the results reference the one or more documents that are associated with the one or more entities; and

determining one or more entity models that are associated with a confidence value that is below a threshold value for the results; and

providing the one or more determined entity models to the training engine for re-training.

2. The method of claim 1 , wherein training the one or more entity models, further comprises, determining the one or more concept characteristics, or the one or more document characteristics based on input from one or more users.

3. The method of claim 1 , wherein determining the one or more concept characteristics, further comprises, determining one or more of additional related entities, confirmed entities, disconfirmed entities, semantic features, or characteristics associated with other related concepts.

4. The method of claim 1 , wherein evaluating the one or more documents, further comprises, dividing the one or more documents into one or more of words, parts-of-speech, sentences, paragraphs, pages, sections, chapters, versions, or volumes.

5. The method of claim 1 , wherein training the one or more entity models, further comprises:

traversing one or more other data models that are related to the one or more documents;

linking the one or more entities to the one or more other data models; and

linking the one or more entities to the data model.

6. The method of claim 1 , wherein providing the results based on the one or more documents and the one or more entity models, further comprises:

determining the one or more entities that are associated with the results; and

associating the one or more determined entities with the one or more documents, wherein the one or more associated documents are one or more source documents that are associated with the one or more determined entities.

7. The method of claim 1 , wherein training the one or more entity models, further comprises, modifying the data model based on the training of the one or more entity models, wherein the modifications include one or more of adding concepts, removing concepts, adding relations, or removing relations.

8. A system for managing data over a network, comprising:

a network computer, comprising:

a transceiver that communicates over the network;

a memory that stores at least instructions; and

one or more processors that execute instructions that perform actions, including:

instantiating a data engine that performs actions including:

providing a data model that includes one or more concepts and one or more relations between the concepts, wherein each concept is a node in the data model and each relation is an edge in the data model; and

providing one or more documents that include one or more entities, wherein the one or more entities are associated with the one or more concepts; and

instantiating a training engine that performs actions, including:

traversing the data model to determine one or more concept characteristics associated with the one or more concepts that are associated with the one or more entities;

evaluating the one or more documents to identify one or more document characteristics associated with the one or more entities; and

training one or more entity models based on the one or more concept characteristics and the one or more document characteristics, wherein each entity model is associated with a confidence value; and

instantiating a query engine to perform actions including:

resolving results for one or more queries based on the one or more documents and the one or more entity models, wherein the results reference the one or more documents that are associated with the one or more entities; and

determining one or more entity models that are associated with a confidence value that is below a threshold value for the results; and

providing the one or more determined entity models to the training engine for re-training; and

a client computer, comprising:

another transceiver that communicates over the network;

another memory that stores at least instructions; and

one or more processors that execute instructions that perform actions, including:

displaying the result on a hardware display.

9. The system of claim 8 , wherein training the one or more entity models, further comprises, determining the one or more concept characteristics, or the one or more document characteristics based on input from one or more users.

10. The system of claim 8 , wherein determining the one or more concept characteristics, further comprises, determining one or more of additional related entities, confirmed entities, disconfirmed entities, semantic features, or characteristics associated with other related concepts.

11. The system of claim 8 , wherein evaluating the one or more documents, further comprises, dividing the one or more documents into one or more of words, parts-of-speech, sentences, paragraphs, pages, sections, chapters, versions, or volumes.

12. The system of claim 8 , wherein training the one or more entity models, further comprises:

traversing one or more other data models that are related to the one or more documents;

linking the one or more entities to the one or more other data models; and

linking the one or more entities to the data model.

13. The system of claim 8 , wherein providing the results based on the one or more documents and the one or more entity models, further comprises:

determining the one or more entities that are associated with the results; and

associating the one or more determined entities with the one or more documents, wherein the one or more associated documents are one or more source documents that are associated with the one or more determined entities.

14. The system of claim 8 , wherein training the one or more entity models, further comprises, modifying the data model based on the training of the one or more entity models, wherein the modifications include one or more of adding concepts, removing concepts, adding relations, or removing relations.

15. A processor readable non-transitory storage media that includes instructions for managing data, wherein execution of the instructions by one or more hardware processors performs actions, comprising:

instantiating a data engine that performs actions including:

providing a data model that includes one or more concepts and one or more relations between the concepts, wherein each concept is a node in the data model and each relation is an edge in the data model; and

providing one or more documents that include one or more entities, wherein the one or more entities are associated with the one or more concepts; and

instantiating a training engine that performs actions, including:

traversing the data model to determine one or more concept characteristics associated with the one or more concepts that are associated with the one or more entities;

evaluating the one or more documents to identify one or more document characteristics associated with the one or more entities; and

training one or more entity models based on the one or more concept characteristics and the one or more document characteristics, wherein each entity model is associated with a confidence value; and

instantiating a query engine to perform actions including:

resolving results for one or more queries based on the one or more documents and the one or more entity models, wherein the results reference the one or more documents that are associated with the one or more entities; and

determining one or more entity models that are associated with a confidence value that is below a threshold value for the results; and

providing the one or more determined entity models to the training engine for re-training.

16. The media of claim 15 , wherein training the one or more entity models, further comprises, determining the one or more concept characteristics, or the one or more document characteristics based on input from one or more users.

17. The media of claim 15 , wherein determining the one or more concept characteristics, further comprises, determining one or more of additional related entities, confirmed entities, disconfirmed entities, semantic features, or characteristics associated with other related concepts.

18. The media of claim 15 , wherein evaluating the one or more documents, further comprises, dividing the one or more documents into one or more of words, parts-of-speech, sentences, paragraphs, pages, sections, chapters, versions, or volumes.

19. The media of claim 15 , wherein training the one or more entity models, further comprises:

traversing one or more other data models that are related to the one or more documents;

linking the one or more entities to the one or more other data models; and

linking the one or more entities to the data model.

20. The media of claim 15 , wherein providing the results based on the one or more documents and the one or more entity models, further comprises:

determining the one or more entities that are associated with the results; and

associating the one or more determined entities with the one or more documents, wherein the one or more associated documents are one or more source documents that are associated with the one or more determined entities.

21. The media of claim 15 , wherein training the one or more entity models, further comprises, modifying the data model based on the training of the one or more entity models, wherein the modifications include one or more of adding concepts, removing concepts, adding relations, or removing relations.

22. A network computer for managing data, comprising:

a transceiver that communicates over the network;

a memory that stores at least instructions; and

one or more processors that execute instructions that perform actions, including:

instantiating a data engine that performs actions including:

providing a data model that includes one or more concepts and one or more relations between the concepts, wherein each concept is a node in the data model and each relation is an edge in the data model; and

providing one or more documents that include one or more entities, wherein the one or more entities are associated with the one or more concepts; and

instantiating a training engine that performs actions, including:

traversing the data model to determine one or more concept characteristics associated with the one or more concepts that are associated with the one or more entities;

evaluating the one or more documents to identify one or more document characteristics associated with the one or more entities; and

training one or more entity models based on the one or more concept characteristics and the one or more document characteristics, wherein each entity model is associated with a confidence value; and

instantiating a query engine to perform actions including:

resolving results for one or more queries based on the one or more documents and the one or more entity models, wherein the results reference the one or more documents that are associated with the one or more entities; and

determining one or more entity models that are associated with a confidence value that is below a threshold value for the results; and

providing the one or more determined entity models to the training engine for re-training.

23. The network computer of claim 22 , wherein training the one or more entity models, further comprises, determining the one or more concept characteristics, or the one or more document characteristics based on input from one or more users.

24. The network computer of claim 22 , wherein determining the one or more concept characteristics, further comprises, determining one or more of additional related entities, confirmed entities, disconfirmed entities, semantic features, or characteristics associated with other related concepts.

25. The network computer of claim 22 , wherein evaluating the one or more documents, further comprises, dividing the one or more documents into one or more of words, parts-of-speech, sentences, paragraphs, pages, sections, chapters, versions, or volumes.

26. The network computer of claim 22 , wherein training the one or more entity models, further comprises:

traversing one or more other data models that are related to the one or more documents;

linking the one or more entities to the one or more other data models; and

linking the one or more entities to the data model.

27. The network computer of claim 22 , wherein providing the results based on the one or more documents and the one or more entity models, further comprises:

determining the one or more entities that are associated with the results; and

associating the one or more determined entities with the one or more documents, wherein the one or more associated documents are one or more source documents that are associated with the one or more determined entities.

28. The network computer of claim 22 , wherein training the one or more entity models, further comprises, modifying the data model based on the training of the one or more entity models, wherein the modifications include one or more of adding concepts, removing concepts, adding relations, or removing relations.

Assignments (7)
CHANGE OF NAME Recorded Jun 16, 2025
From: SPARKCOGNITION, INC.
To: AVATHON, INC.
Reel/Frame 071646/0135 →
MERGER Recorded Jun 16, 2025
From: SPARKCOGNITION Q, INC.
To: SPARKCOGNITION, INC.
Reel/Frame 071421/0898 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Nov 4, 2024
From: ORIX GROWTH CAPITAL, LLC
To: SPARKCOGNITION, INC.
Reel/Frame 069300/0567 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Nov 4, 2024
From: ORIX GROWTH CAPITAL, LLC
To: SPARKCOGNITION Q, INC.
Reel/Frame 069436/0870 →
SECURITY INTEREST Recorded Apr 21, 2022
From: SPARKCOGNITION Q, INC.
To: ORIX GROWTH CAPITAL, LLC
Reel/Frame 059672/0175 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 21, 2021
From: MAANA, INC.
To: SPARKCOGNITION Q, INC.
Reel/Frame 056935/0540 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2018
From: ELKHOLY, ALEXANDER HUSSAM; KANDASWAMY, BALASUBRAMANIAN; GUSTAFSON, STEVEN MATT; AL-OLIMAT, HUSSEIN S.
To: MAANA, INC.
Reel/Frame 045594/0041 →
Cited By (2)
US 12,399,905 US 12,626,065