IP Library Granted Patent US 11,144,731
Granted Patent B2
US 11,144,731 · App. 16/128,227 · Granted Oct 12, 2021

Modular virtual assistant platform

Inventors: Pranav Singh (Sunnyvale, CA); Keyvan Mohajer (Los Gatos, CA); Kamyar Mohajer (San Jose, CA); Bernard Mont-Reynaud (Sunnyvale, CA)
Assignee: SoundHound, Inc.
G06F40/40G06Q20/102G06Q30/0283G10L15/30G06F40/211
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,144,731
App. No.
16/128,227
Granted
Oct 12, 2021
Kind
B2
Abstract

A platform provides for developers of applications, such as devices, with natural language interfaces to configure the availability of vertical domain modules in applications. Modules can include grammars for parsing natural language expressions and interfaces to data sources. Third party developers can create modules with pricing models for their usage or access to their data. Device developers can browse or search available modules and test their performance for specific queries. The platform provides for devices users to access the chosen modules as configured by device developers and for charging and payment between users, application developers, and module developers.

Claims (30)

1. A platform for providing natural language modules for an assistant, the platform comprising:

a browsing interface showing, for at least one module:

a module name;

a module developer; and

an example natural language query that the at least one module can parse; and

a payment infrastructure for an account for the module developer,

wherein an application developer can select a plurality of modules for integration into the assistant and, if the example natural language query is provided to the assistant, the platform provides a payment to the account.

2. The platform of claim 1 further comprising:

an interface for the application developer to define a custom phrase to invoke natural language module code.

3. The platform of claim 1 further comprising:

an interface for the application developer to choose a text-to-speech synthesizer for spoken responses.

4. The platform of claim 1 further comprising:

an interface to generate code to run the natural language module on test hardware.

5. A natural language processing system comprising:

an interface enabled to receive natural language module code from module developers;

a network interface to a computer network enabled to receive natural language queries and send responses;

a command processor for interpreting received natural language queries according to the natural language module code to produce responses; and

a payment infrastructure to calculate charges, according to pricing models associated with the natural language modules, for interpreting natural language queries and pay a portion of the charges to the module developers.

6. The system of claim 5 further comprising:

the interface enabled to allow module developers to configure the pricing models associated with the natural language modules.

7. The system of claim 5 further comprising:

a test module that executes the natural language module code to simulate the ability of the natural language module code to interpret a test query.

8. A distributed system environment for natural language processing, the system environment comprising:

a command processor for the functionality of an automobile that interprets natural language queries according to a plurality of private natural language modules; and

a payment infrastructure connected to the command processor through a network, the payment infrastructure comprising a charge calculation module that:

in response to the command processor interpreting a natural language expression, settles a charge between an automobile manufacturer and a query interpretation service provider.

9. The system environment of claim 8 wherein the network is intermittent between the command processor and the payment infrastructure, and the command processor buffers a charge until the network is available.

10. The system environment of claim 8 further comprising:

an interface for an application developer to configure which natural language modules at a natural language module store are available in the remote computer system.

11. The system of claim 8 , wherein the charge calculation module settling the charge comprises the charge calculation settling the charge on a per-query basis and is settled in units of credits.

Assignments (11)
SECURITY INTEREST Recorded Aug 9, 2024
From: SOUNDHOUND, INC.
To: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
Reel/Frame 068526/0413 →
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2024
From: ACP POST OAK CREDIT II LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
Reel/Frame 067698/0845 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: SOUNDHOUND AI IP HOLDING, LLC
To: SOUNDHOUND AI IP, LLC
Reel/Frame 064205/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2023
From: SOUNDHOUND, INC.
To: SOUNDHOUND AI IP HOLDING, LLC
Reel/Frame 064083/0484 →
RELEASE OF SECURITY INTEREST Recorded Apr 21, 2023
From: FIRST-CITIZENS BANK & TRUST COMPANY, AS AGENT
To: SOUNDHOUND, INC.
Reel/Frame 063411/0396 →
RELEASE OF SECURITY INTEREST Recorded Apr 19, 2023
From: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 063380/0625 →
SECURITY INTEREST Recorded Apr 17, 2023
From: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
To: ACP POST OAK CREDIT II LLC
Reel/Frame 063349/0355 →
CORRECTIVE ASSIGNMENT TO CORRECT THE COVER SHEET PREVIOUSLY RECORDED AT REEL: 056627 FRAME: 0772. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Apr 12, 2023
From: SOUNDHOUND, INC.
To: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
Reel/Frame 063336/0146 →
SECURITY INTEREST Recorded Jun 18, 2021
From: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 056627/0772 →
SECURITY INTEREST Recorded Apr 1, 2021
From: SOUNDHOUND, INC.
To: SILICON VALLEY BANK
Reel/Frame 055807/0539 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 11, 2018
From: MOHAJER, KEYVAN; MOHAJER, KAMYAR; MONT-REYNAUD, BERNARD; SINGH, PRANAV
To: SOUNDHOUND INC.
Reel/Frame 046844/0286 →