IP Library Granted Patent US 11,935,029
Granted Patent B2
US 11,935,029 · App. 16/121,967 · Granted Mar 19, 2024

Classification by natural language grammar slots across domains

Inventors: Joe Aung (San Jose, CA); Jonah Probell (Alviso, CA)
Assignee: SoundHound, Inc.
G06Q20/24G06F9/547G06F16/285G06F40/205G06F40/211G06F40/253G06F40/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,935,029
App. No.
16/121,967
Granted
Mar 19, 2024
Kind
B2
Abstract

A virtual assistant processes natural language expressions according to grammar rules created by domain providers. The virtual assistant uniquely identifies each of a multiplicity of users and stores values of grammar slots filled by natural language expressions from each user. The virtual assistant stores histories of slot values and computes statistics from the history. The virtual assistant provider, or a classification client, provides values of attributes of users as labels for a machine learning classification algorithm. The algorithm processes the grammar slot values and labels to compute probability distributions for unknown attribute values of users. A network effect of users and domain grammars make the virtual assistant useful and provides increasing amounts of data that improve classification accuracy and usefulness.

Claims (42)

1. A computer-implemented method comprising:

determining grammar slot values by parsing natural language expressions from a multiplicity of users according to a grammar;

storing the grammar slot values associated with the multiplicity of users in a database of personal information;

storing parameter values associated with the multiplicity of users in the database;

at a first time, computing a parameter value of a particular user based on the stored grammar slot values and based on a model trained on the parameter values of other users; and

in response to a request for classification of the particular user at a second time,

providing the computed parameter value to a network-connected device;

incrementing a credit count based on the request

incrementing a credit accumulator for each classification request; and

providing a payment to the domain provider in proportion to the value of the credit accumulator;

determining second grammar slot values by parsing the natural language expressions according to a second grammar, the second grammar being provided by a second domain provider;

in response to the classification request, adding a second increment to a second credit accumulator; and

providing a payment to the second domain provider in proportion to the value of the second credit accumulator.

2. The method of claim 1 wherein classification requests are received and parameter values are provided through a web API interface.

3. The method of claim 1 wherein computing the parameter value comprises computing the parameter value based on a probability.

4. The method of claim 1 wherein computing the parameter value comprises computing the parameter value based on a probability for each of multiple attribute labels.

5. The method of claim 1 further comprising:

charging a classification client to increase the credit count.

6. The method of claim 1 wherein the grammar is provided by a domain provider that is not a virtual assistant provider.

7. The method of claim 1 further comprising:

storing, for the particular user, a historical value for the slot.

8. The method of claim 7 further comprising:

storing a timestamp associated with the historical value.

9. A computer system, comprising:

a processor; and

system memory coupled to the processor and storing instructions to cause the processor to:

determine grammar slot values by parsing natural language expressions from a multiplicity of users according to a grammar;

store the grammar slot values associated with the multiplicity of users in a database of personal information;

store parameter values associated with the multiplicity of users in the database;

at a first time, compute a parameter value of a particular user based on the grammar slot values and based on a model trained on the parameter values of other users; and

in response to a request for classification of the particular user at a second time,

provide the computed parameter value to a network-connected device;

increment a credit count based on the request;

increment a credit accumulator for each classification request; and

provide a payment to the domain provider in proportion to the value of the credit accumulator;

determine second grammar slot values by parsing the natural language expressions according to a second grammar, the second grammar being provided by a second domain provider;

in response to the classification request, add a second increment to a second credit accumulator; and

provide a payment to the second domain provider in proportion to the value of the second credit accumulator.

10. The computer system of claim 9 further comprising instructions configured to:

receive the grammar from a domain provider that is not a virtual assistant provider prior to determining grammar slot values.

11. The computer system of claim 9 further comprising instructions configured to store, for the particular user, a historical value for the slot.

12. The computer system of claim 11 further comprising instructions configured to store, for the particular user, a timestamp associated with the historical value.

Assignments (12)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Dec 3, 2024
From: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 069480/0312 →
SECURITY INTEREST Recorded Aug 9, 2024
From: SOUNDHOUND, INC.
To: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
Reel/Frame 068526/0413 →
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2024
From: ACP POST OAK CREDIT II LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
Reel/Frame 067698/0845 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: SOUNDHOUND AI IP HOLDING, LLC
To: SOUNDHOUND AI IP, LLC
Reel/Frame 064205/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2023
From: SOUNDHOUND, INC.
To: SOUNDHOUND AI IP HOLDING, LLC
Reel/Frame 064083/0484 →
RELEASE OF SECURITY INTEREST Recorded Apr 21, 2023
From: FIRST-CITIZENS BANK & TRUST COMPANY, AS AGENT
To: SOUNDHOUND, INC.
Reel/Frame 063411/0396 →
RELEASE OF SECURITY INTEREST Recorded Apr 19, 2023
From: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 063380/0625 →
SECURITY INTEREST Recorded Apr 17, 2023
From: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
To: ACP POST OAK CREDIT II LLC
Reel/Frame 063349/0355 →
CORRECTIVE ASSIGNMENT TO CORRECT THE COVER SHEET PREVIOUSLY RECORDED AT REEL: 056627 FRAME: 0772. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Apr 12, 2023
From: SOUNDHOUND, INC.
To: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
Reel/Frame 063336/0146 →
SECURITY INTEREST Recorded Jun 18, 2021
From: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 056627/0772 →
SECURITY INTEREST Recorded Apr 1, 2021
From: SOUNDHOUND, INC.
To: SILICON VALLEY BANK
Reel/Frame 055807/0539 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2018
From: AUNG, JOE; PROBELL, JONAH
To: SOUNDHOUND, INC.
Reel/Frame 047008/0208 →