IP Library Granted Patent US 10,796,107
Granted Patent B2
US 10,796,107 · App. 16/232,984 · Granted Oct 6, 2020

Unified embeddings for translation

Inventor: Terry Kong (Sunnyvale, CA)
Assignee: SoundHound, Inc.
G06F40/58G06F40/295G06K9/6232G06K9/6256
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,796,107
App. No.
16/232,984
Granted
Oct 6, 2020
Kind
B2
Abstract

A method of training word embeddings is provided. The method includes determining anchors, each comprising a first word in a first domain and a second word in a second domain, training word embeddings for the first and second domains, and training a transform for transforming word embedding vectors in the first domain to word embedding vectors in the second domain, wherein the training minimizes a loss function that includes an anchor loss for each anchor, such that for each anchor, the anchor loss is based on a distance between the anchor's second word's embedding vector and the transform of the anchor's first word's embedding vector, and for each anchor, the anchor loss for the respective anchor is zero when the distance between the respective anchor's second word's embedding vector and the transform of the respective anchor's first word's embedding vector is less than a specific tolerance.

Claims (48)

1. A method of training word embeddings, the method comprising:

determining a plurality of anchors, each anchor comprising a first word in a first domain and a second word in a second domain;

training (1) a word embedding for the first domain;

training (2) a word embedding for the second domain; and

training (3) a transform for transforming word embedding vectors in the first domain to word embedding vectors in the second domain, wherein:

the training minimizes a loss function that includes an anchor loss for each anchor;

for each respective anchor of the plurality of anchors, the anchor loss for the respective anchor is based on a distance between the respective anchor's second word's embedding vector and the transform of the respective anchor's first word's embedding vector; and

for each respective anchor of the plurality of anchors, the anchor loss for the respective anchor is zero when the distance between the respective anchor's second word's embedding vector and the transform of the respective anchor's first word's embedding vector is less than a specific tolerance.

2. The method of claim 1 , wherein the first domain comprises words in a first language and the second domain comprises words in a second language.

3. The method of claim 1 , further comprising translating a word in the first domain to a word in the second domain by:

projecting, using the word embedding for the first domain, the first word in the first domain to a first word embedding vector in the first domain;

transforming, using the trained transform, the first word embedding vector in the first domain to a second word embedding vector in the second domain; and

identifying a word in the second domain having a projection, using the word embedding for the second domain, that is closest to the second word embedding vector in the second domain.

4. The method of claim 1 , wherein at least one anchor of the plurality of anchors represents a named entity.

5. The method of claim 1 , further comprising:

determining a further plurality of anchors, each anchor of the further plurality of anchors, comprising a first word in the first domain and a second word in a third domain,

wherein for each respective anchor of the further plurality of anchors, the anchor loss for the respective anchor is zero when the distance between the respective anchor's second word's embedding vector and the transform of the respective anchor's first word's embedding vectors is less than the specific tolerance.

6. The method of claim 1 , wherein the loss function gives a first weight to a first anchor of the plurality of anchors and a second weight to a second anchor of the plurality of anchors.

7. A non-transitory computer-readable recording medium having a computer program recorded thereon, the computer program, when executed by one or more processors of a computer system, causes the computer system to perform a method comprising:

determining a plurality of anchors, each anchor comprising a first word in a first domain and a second word in a second domain;

training (1) a word embedding for the first domain;

training (2) a word embedding for the second domain; and

training (3) a transform for transforming word embedding vectors in the first domain to word embedding vectors in the second domain, wherein:

the training minimizes a loss function that includes an anchor loss for each anchor;

for each respective anchor of the plurality of anchors, the anchor loss for the respective anchor is based on a distance between the respective anchor's second word's embedding vector and the transform of the respective anchor's first word's embedding vector; and

for each respective anchor of the plurality of anchors, the anchor loss for the respective anchor is zero when the distance between the respective anchor's second word's embedding vector and the transform of the respective anchor's first word's embedding vector is less than a specific tolerance.

8. The non-transitory computer-readable recording medium of claim 7 , wherein the first domain comprises words in a first language and the second domain comprises words in a second language.

9. The non-transitory computer-readable recording medium of claim 7 , wherein the method further comprises translating a word in the first domain to a word in the second domain by:

projecting, using the word embedding for the first domain, the first word in the first domain to a first word embedding vector in the first domain;

transforming, using the trained transform, the first word embedding vector in the first domain to a second word embedding vector in the second domain; and

identifying a word in the second domain having a projection, using the word embedding for the second domain, that is closest to the second word embedding vector in the second domain.

10. The non-transitory computer-readable recording medium of claim 7 , wherein at least one anchor of the plurality of anchors represents a named entity.

11. The non-transitory computer-readable recording medium of claim 7 , wherein the method further comprises:

determining a further plurality of anchors, each anchor of the further plurality of anchors, comprising a first word in the first domain and a second word in a third domain,

wherein for each respective anchor of the further plurality of anchors, the anchor loss for the respective anchor is zero when the distance between the respective anchor's second word's embedding vector and the transform of the respective anchor's first word's embedding vectors is less than the specific tolerance.

12. The non-transitory computer-readable recording medium of claim 7 , wherein the loss function gives a first weight to a first anchor of the plurality of anchors and a second weight to a second anchor of the plurality of anchors.

13. A method of translating a word in a first domain to a word in a second domain using a trained transform, the method comprising:

projecting, using a word embedding for a first domain, the word in the first domain to a word embedding vector in the first domain;

transforming, using the trained transform, the word embedding vector in the first domain to a word embedding vector in the second domain; and

identifying a word in the second domain having a projection, using a word embedding for the second domain, that is closest to the word embedding vector in the second domain,

wherein the trained transform is trained by:

determining a plurality of anchors, each anchor comprising a first word in the first domain and a second word in the second domain;

training (1) the word embedding for the first domain;

training (2) the word embedding for the second domain; and

training (3) a transform for transforming word embedding vectors in the first domain to word embedding vectors in the second domain, wherein:

the training minimizes a loss function that includes an anchor loss for each anchor;

for each respective anchor of the plurality of anchors, the anchor loss for the respective anchor is based on a distance between the respective anchor's second word's embedding vector and the transform of the respective anchor's first word's embedding vector; and

for each respective anchor of the plurality of anchors, the anchor loss for the respective anchor is zero when the distance between the respective anchor's second word's embedding vector and the transform of the respective anchor's first word's embedding vector is less than a specific tolerance.

Assignments (11)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Dec 3, 2024
From: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 069480/0312 →
SECURITY INTEREST Recorded Aug 9, 2024
From: SOUNDHOUND, INC.
To: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
Reel/Frame 068526/0413 →
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2024
From: ACP POST OAK CREDIT II LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
Reel/Frame 067698/0845 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: SOUNDHOUND AI IP HOLDING, LLC
To: SOUNDHOUND AI IP, LLC
Reel/Frame 064205/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2023
From: SOUNDHOUND, INC.
To: SOUNDHOUND AI IP HOLDING, LLC
Reel/Frame 064083/0484 →
RELEASE OF SECURITY INTEREST Recorded Apr 21, 2023
From: FIRST-CITIZENS BANK & TRUST COMPANY, AS AGENT
To: SOUNDHOUND, INC.
Reel/Frame 063411/0396 →
RELEASE OF SECURITY INTEREST Recorded Apr 19, 2023
From: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 063380/0625 →
SECURITY INTEREST Recorded Apr 17, 2023
From: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
To: ACP POST OAK CREDIT II LLC
Reel/Frame 063349/0355 →
CORRECTIVE ASSIGNMENT TO CORRECT THE COVER SHEET PREVIOUSLY RECORDED AT REEL: 056627 FRAME: 0772. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Apr 12, 2023
From: SOUNDHOUND, INC.
To: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
Reel/Frame 063336/0146 →
SECURITY INTEREST Recorded Jun 18, 2021
From: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 056627/0772 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2018
From: KONG, TERRY
To: SOUNDHOUND, INC.
Reel/Frame 047862/0416 →