IP Library Granted Patent US 11,392,628
Granted Patent B1
US 11,392,628 · App. 16/565,315 · Granted Jul 19, 2022

Custom tags based on word embedding vector spaces

Inventor: Gokhuldass Mohandas (Palo Alto, CA)
Assignee: Ciitizen, LLC
G06F16/3334G06F40/295G06N20/00G16H10/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,392,628
App. No.
16/565,315
Granted
Jul 19, 2022
Kind
B1
Abstract

Some embodiments provide a non-transitory machine-readable medium that stores a program. The program receives a plurality of sets of words. Each set of words in the plurality of sets of words includes a word annotated as being an entity having a same custom entity type. The program further determines a plurality of word embeddings in a word embedding space for the plurality of annotated words. The program also defines a region in the word embedding space based on the received plurality of word embeddings. The program further receives a set of words. The program also determines a word embedding for a subset of the set of words. The program further determines whether the word embedding falls within the defined region in the word embedding space. Upon determining that the word embedding falls within the defined region in the word embedding space, the program also determines that the subset of the set of words represents an entity having the custom entity type.

Claims (54)

1. A non-transitory machine-readable medium storing a program executable by at least one processing unit of a device, the program comprising sets of instructions for:

receiving a plurality of sets of words, each set of words in the plurality of sets of words comprising a word annotated as being an entity having a same custom entity type, wherein the custom entity type is a custom-defined tag within a word embedding space, wherein the word embedding space is an n-dimensional vector space;

determining a plurality of word embeddings in the word embedding space for the plurality of annotated words, wherein at least one of the plurality of word embeddings in the word embedding space is a first vector representation of at least one of the annotated words;

receiving a set of words;

determining a word embedding for a subset of the set of words, wherein the word embedding is second vector representation of the subset of the set of words;

determining whether the word embedding falls within the defined region in the word embedding space; and

upon determining that the word embedding falls within the defined region in the word embedding space, determining that the subset of the set of words represents an entity having the custom entity type, wherein the entity is capable of having a plurality of custom-defined tags comprising at least the custom-defined tag.

2. The non-transitory machine-readable medium of claim 1 , wherein the plurality of word embeddings is a first plurality of word embeddings, wherein the custom entity type is a first custom entity type, wherein the region in the word embedding space is a first region in the word embedding space, wherein the program further comprises sets of instructions for:

receiving a second plurality of word embeddings in the word embedding space, each word embedding in the second plurality of word embeddings associated with a second custom entity type; and

defining a second region in the word embedding space based on the received second plurality of word embeddings.

3. The non-transitory machine-readable medium of claim 2 , wherein the entity is a first entity, wherein the program further comprises sets of instructions for:

determining whether the word embedding falls within the second defined region in the word embedding space;

upon determining that the word embedding falls within the second defined region in the word embedding space, determining that the subset of the set of words represents a second entity having the second custom entity type.

4. The non-transitory machine-readable medium of claim 1 , wherein defining the region in the word embedding space comprises generating a convex hull in the word embedding space based on the received plurality of word embeddings.

5. The non-transitory machine-readable medium of claim 4 , wherein determining whether the word embedding falls within the defined region in the word embedding space comprises determining whether the word embedding falls within a defined threshold distance of the convex hull.

6. The non-transitory machine-readable medium of claim 1 , wherein the set of words comprises raw unstructured text from a document in a medical record of a patient.

7. The non-transitory machine-readable medium of claim 1 , wherein the set of words comprises a set of words included in a textual description of a concept for an entry in a knowledge base.

8. A method comprising:

receiving a plurality of sets of words, each set of words in the plurality of sets of words comprising a word annotated as being an entity having a same custom entity type, wherein the custom entity type is a custom-defined tag within a word embedding space, wherein the word embedding space is an n-dimensional vector space;

determining a plurality of word embeddings in the word embedding space for the plurality of annotated words, wherein at least one of the plurality of word embeddings in the word embedding space is a first vector representation of at least one of the annotated words;

defining a region in the word embedding space based on the received plurality of word embeddings;

receiving a set of words;

determining a word embedding for a subset of the set of words, wherein the word embedding is second vector representation of the subset of the set of words;

determining whether the word embedding falls within the defined region in the word embedding space; and

upon determining that the word embedding falls within the defined region in the word embedding space, determining that the subset of the set of words represents an entity having the custom entity type, wherein the entity is capable of having a plurality of custom-defined tags comprising at least the custom-defined tag.

9. The method of claim 8 , wherein the plurality of word embeddings is a first plurality of word embeddings, wherein the custom entity type is a first custom entity type, wherein the region in the word embedding space is a first region in the word embedding space, wherein the method further comprises:

receiving a second plurality of word embeddings in the word embedding space, each word embedding in the second plurality of word embeddings associated with a second custom entity type; and

defining a second region in the word embedding space based on the received second plurality of word embeddings.

10. The method of claim 9 , wherein the entity is a first entity, wherein the method further comprises:

determining whether the word embedding falls within the second defined region in the word embedding space;

upon determining that the word embedding falls within the second defined region in the word embedding space, determining that the subset of the set of words represents a second entity having the second custom entity type.

11. The method of claim 8 , wherein defining the region in the word embedding space comprises generating a convex hull in the word embedding space based on the received plurality of word embeddings.

12. The method of claim 11 , wherein determining whether the word embedding falls within the defined region in the word embedding space comprises determining whether the word embedding falls within a defined threshold distance of the convex hull.

13. The method of claim 8 , wherein the set of words comprises raw unstructured text from a document in a medical record of a patient.

14. The method of claim 8 , wherein the set of words comprises a set of words included in a textual description of a concept for an entry in a knowledge base.

15. A system comprising:

a set of processing units; and

a non-transitory machine-readable medium storing instructions that when executed by at least one processing unit in the set of processing units cause the at least one processing unit to:

receive a plurality of sets of words, each set of words in the plurality of sets of words comprising a word annotated as being an entity having a same custom entity type, wherein the custom entity type is a custom-defined tag within a word embedding space, wherein the word embedding space is an n-dimensional vector space;

determine a plurality of word embeddings in the word embedding space for the plurality of annotated words, wherein at least one of the plurality of word embeddings in the word embedding space is a first vector representation of at least one of the annotated words;

define a region in the word embedding space based on the received plurality of word embeddings;

receive a set of words;

determine a word embedding for a subset of the set of words, wherein the word embedding is second vector representation of the subset of the set of words;

determine whether the word embedding falls within the defined region in the word embedding space; and

upon determining that the word embedding falls within the defined region in the word embedding space, determine that the subset of the set of words represents an entity having the custom entity type, wherein the entity is capable of having a plurality of custom-defined tags comprising at least the custom-defined tag.

16. The system of claim 15 , wherein the plurality of word embeddings is a first plurality of word embeddings, wherein the custom entity type is a first custom entity type, wherein the region in the word embedding space is a first region in the word embedding space, wherein the instructions further cause the at least one processing unit to:

receive a second plurality of word embeddings in the word embedding space, each word embedding in the second plurality of word embeddings associated with a second custom entity type; and

define a second region in the word embedding space based on the received second plurality of word embeddings.

17. The system of claim 16 , wherein the entity is a first entity, wherein the instructions further cause the at least one processing unit to:

determine whether the word embedding falls within the second defined region in the word embedding space;

upon determining that the word embedding falls within the second defined region in the word embedding space, determine that the subset of the set of words represents a second entity having the second custom entity type.

18. The system of claim 15 , wherein defining the region in the word embedding space comprises generating a convex hull in the word embedding space based on the received plurality of word embeddings.

19. The system of claim 18 , wherein determining whether the word embedding falls within the defined region in the word embedding space comprises determining whether the word embedding falls within a defined threshold distance of the convex hull.

20. The system of claim 15 , wherein the set of words comprises raw unstructured text from a document in a medical record of a patient.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2024
From: INVITAE CORPORATION; CIITIZEN, LLC
To: CITIZEN HEALTH, INC.
Reel/Frame 066087/0060 →
RELEASE OF SECURITY INTEREST AT R/F 63787/0148 Recorded Dec 14, 2023
From: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION
To: CIITIZEN, LLC
Reel/Frame 066017/0791 →
SECURITY INTEREST Recorded Mar 7, 2023
From: CIITIZEN, LLC
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 062907/0924 →
RELEASE OF SECURITY INTEREST Recorded Mar 2, 2023
From: PERCEPTIVE CREDIT HOLDINGS III, LP
To: CIITIZEN, LLC
Reel/Frame 062861/0976 →
MERGER AND CHANGE OF NAME Recorded Oct 22, 2021
From: CIITIZEN CORPORATION; CAYMAN MERGER SUB B LLC
To: CIITIZEN, LLC
Reel/Frame 057881/0810 →
SECURITY INTEREST Recorded Oct 22, 2021
From: CIITIZEN, LLC
To: PERCEPTIVE CREDIT HOLDINGS III, LP
Reel/Frame 057877/0241 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2020
From: MOHANDAS, GOKHULDASS
To: CIITIZEN CORP.
Reel/Frame 051469/0476 →