IP Library Granted Patent US 11,836,453
Granted Patent B2
US 11,836,453 · App. 17/383,097 · Granted Dec 5, 2023

Virtual assistant domain functionality

Inventors: Kamyar Mohajer (San Jose, CA); Keyvan Mohajer (Los Gatos, CA); Bernard Mont-Reynaud (Sunnyvale, CA); Pranav Singh (Sunnyvale, CA)
Assignee: SoundHound, Inc.
G06F40/40G06Q20/102G06Q30/0283G10L15/30G06F40/211
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,836,453
App. No.
17/383,097
Granted
Dec 5, 2023
Kind
B2
Abstract

Aspects include methods, systems, and computer-program products providing virtual assistant domain functionality. A natural language query including one or more words is received. A collection of natural language modules is accessed. The collection natural language modules are configured to process sets of natural language queries. A natural language module, from the collection of natural language modules, is identified to interpret the natural language query. An interpretation of the natural language query is computed using the identified natural language module. A response to the natural language query is returned using the computed interpretation.

Claims (50)

1. A method comprising:

receiving a natural language query as a text string including one or more words;

accessing a collection of natural language processing modules, natural language processing modules being configured to process distinct sets of natural language queries;

identifying a plurality of competing natural language processing modules, from the collection of natural language processing modules, to interpret the text string;

computing a plurality of interpretations of the text string using the identified natural language processing modules;

choosing the highest-ranking interpretation of the plurality of interpretations; and

returning a response to the natural language query using the highest-ranking interpretation.

2. The method of claim 1 , wherein returning a response to the natural language query comprises generating a composite response including:

performing a command corresponding to the highest-ranking interpretation; and

outputting a command response for a user.

3. The method of claim 2 , wherein outputting a command response comprises outputting a spoken response.

4. The method of claim 1 , wherein identifying a plurality of natural language processing modules comprises identifying a natural language processing module in a domain associated with the one or more words.

5. The method of claim 1 , wherein receiving a natural language query comprises receiving a natural language query in an automobile.

6. The method of claim 1 , wherein identifying a plurality of natural language processing modules comprises comparing the received natural language query to the sets of natural language queries corresponding to the natural language processing modules.

7. The method of claim 1 , further comprising accessing context information associated with the received natural language query; and

wherein identifying a plurality of natural language processing modules comprises identifying the natural language processing module based on the context information.

8. The method of claim 1 , wherein computing a plurality of interpretations of the text string comprises computing interpretations of the one or more words using the identified natural language processing modules.

9. A computer system comprising:

a processor; and

system memory coupled to the processor and storing instructions configured to cause the processor to:

receive a natural language query as a text string including one or more words;

access a collection of natural language processing modules, natural language processing modules being configured to process distinct sets of natural language queries;

identify a plurality of competing natural language processing modules, from the collection of natural language processing modules, to interpret the text string;

compute a plurality of interpretations of the text string using the identified natural language processing modules;

choose the highest-ranking interpretation of the plurality of interpretations; and

return a response to the natural language query using the highest-ranking interpretation.

10. The computer system of claim 9 , wherein instructions configured to return a response to the natural language query comprise instructions configured to generate a composite response including:

perform a command corresponding to the highest-ranking interpretation; and

output a command response for a user.

11. The computer system of claim 9 , wherein instructions configured to receive a natural language query comprises instructions configured to receive a natural language query at an automobile.

12. The computer system of claim 9 , wherein instructions configured to identify a plurality of natural language processing modules comprise instructions configured to compare the received natural language query to the sets of natural language queries corresponding to the natural language processing modules.

13. The computer system of claim 9 , further comprising instructions configured to access context information associated with the received natural language query; and

wherein instructions configured to identify a plurality of natural language processing modules comprise instructions configured to identify the natural language processing module based on the context information.

14. A method comprising:

receiving a natural language query as a text string including one or more words from a vehicle occupant;

accessing a collection of natural language processing modules at the vehicle, natural language processing modules being configured to process distinct sets of natural language queries;

identifying a plurality of natural language processing modules, from the collection of natural language processing modules, to interpret the text string;

computing a plurality of interpretations of the text string using the identified natural language processing modules;

choosing the highest-ranking interpretation of the plurality of interpretations; and

returning a response to the natural language query within the vehicle using the highest-ranking interpretation.

15. The method of claim 14 , wherein receiving a natural language query comprises receiving a query from the vehicle occupant requesting a 3 rd party service;

wherein computing a plurality of interpretations of the text string comprises interpreting the natural language query with a car manufacturer specific module; and

wherein using the highest-ranking interpretation comprises requesting the 3 rd party service.

16. The method of claim 14 , wherein using the highest-ranking interpretation to return a response to the natural language query comprises generating a composite response including:

performing a command corresponding to the highest-ranking interpretation; and

outputting a command response within the vehicle.

17. The method of claim 14 , wherein identifying a plurality of natural language processing modules comprises comparing the received natural language query to the sets of natural language queries corresponding to the natural language processing modules.

18. The method of claim 14 , further comprising accessing context information associated with the received natural language query; and

wherein identifying a plurality of natural language processing modules comprises identifying the natural language processing module based on the context information.

19. The method of claim 14 , wherein computing a plurality of interpretations of the text string comprises computing interpretations of the one or more words.

Assignments (7)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Dec 3, 2024
From: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 069480/0312 →
SECURITY INTEREST Recorded Aug 9, 2024
From: SOUNDHOUND, INC.
To: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
Reel/Frame 068526/0413 →
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2024
From: ACP POST OAK CREDIT II LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
Reel/Frame 067698/0845 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: SOUNDHOUND AI IP HOLDING, LLC
To: SOUNDHOUND AI IP, LLC
Reel/Frame 064205/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2023
From: SOUNDHOUND, INC.
To: SOUNDHOUND AI IP HOLDING, LLC
Reel/Frame 064083/0484 →
SECURITY INTEREST Recorded Apr 17, 2023
From: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
To: ACP POST OAK CREDIT II LLC
Reel/Frame 063349/0355 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2021
From: MOHAJER, KEYVAN; MOHAJER, KAMYAR; MONT-REYNAUD, BERNARD; SINGH, PRANAV
To: SOUNDHOUND, INC.
Reel/Frame 056950/0009 →