IP Library Granted Patent US 11,829,724
Granted Patent B1
US 11,829,724 · App. 17/377,375 · Granted Nov 28, 2023

Using semantic grammar extensibility for collective artificial intelligence

Inventors: Bernard Mont-Reynaud (Sunnyvale, CA); Christopher S. Wilson (Sunnyvale, CA); Keyvan Mohajer (Los Gatos, CA)
Assignee: SOUNDHOUND AI IP, LLC
G06F40/30G06F8/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,829,724
App. No.
17/377,375
Granted
Nov 28, 2023
Kind
B1
Abstract

Support for natural language expressions is provided by the use of semantic grammars that describe the structure of expressions in that grammar and that construct the meaning of a corresponding natural language expression. A semantic grammar extension mechanism is provided, which allows one semantic grammar to be used in the place of another semantic grammar. This enriches the expressivity of semantic grammars in a simple, natural, and decoupled manner.

Claims (54)

1. A computer-implemented method comprising:

storing a first semantic grammar and a second semantic grammar, wherein each semantic grammar has a semantic type and a grammar pattern;

receiving an indication that the second semantic grammar extends the first semantic grammar; and

creating a merged semantic grammar that interprets a natural language expression based on a combination of the first semantic grammar and the second semantic grammar;

wherein an invocation of the first semantic grammar within a rule of a second semantic grammar invokes the merged semantic grammar.

2. The computer-implemented method of claim 1 , further comprising:

receiving from a user a natural language expression; and

interpreting the natural language expression using the merged semantic grammar.

3. The computer-implemented method of claim 2 , further comprising:

based on the interpretation, generating output comprising at least one of a graphical output and an auditory output.

4. The computer-implemented method of claim 2 , wherein interpreting the natural language expression comprises:

responsive to the expression having a second interpretation according to the second grammar, deriving an interpretation of the expression according to the merged semantic grammar from the second interpretation by first casting values from the second semantic type to the merged semantic type.

5. The computer-implemented method of claim 1 , wherein creating the merged grammar comprises linking static code libraries for the first semantic grammar and the second semantic grammar.

6. The computer-implemented method of claim 1 , wherein creating the merged grammar comprises jointly compiling the first semantic grammar and the second semantic grammar.

7. The computer-implemented method of claim 1 , wherein creating the merged grammar comprises jointly optimizing the combination of the first semantic grammar and the second semantic grammar.

8. The computer-implemented method of claim 1 , wherein creating the merged grammar comprises dynamically loading a code library for the second semantic grammar.

9. The computer-implemented method of claim 1 , wherein creating the merged grammar adds a rule to the second semantic grammar.

10. The computer-implemented method of claim 1 , wherein:

the first semantic grammar is received from a first developer; and

the second semantic grammar is received from a second developer.

11. The computer-implemented method of claim 1 , wherein at least one of the first semantic grammar and the second semantic grammar includes a weight for a sub-expression, the interpreting the natural language expression further comprising selecting an interpretation using the weight.

12. A non-transitory computer-readable storage medium storing instructions executable by a computer processor, the instructions comprising:

instructions for processing a first semantic grammar and a second semantic grammar, wherein each semantic grammar has a semantic type and a grammar pattern describing natural language expressions that the semantic grammar can interpret;

instructions for processing an indication that the second semantic grammar extends the first semantic grammar; and

instructions for processing a merged semantic grammar that interprets a natural language expression based on a combination of the first semantic grammar and the second semantic grammar;

wherein an invocation of the first semantic grammar within a rule of a second semantic grammar invokes the merged semantic grammar.

13. The non-transitory computer-readable storage medium of claim 12 , the instructions further comprising:

instructions for receiving from a user a natural language expression; and

instructions for interpreting the natural language expression using the merged semantic grammar.

14. The non-transitory computer-readable storage medium of claim 12 , wherein the merged grammar adds a rule to the second semantic grammar.

15. The non-transitory computer-readable storage medium of claim 12 , wherein:

the first semantic grammar and the second semantic grammar are from independent developers.

16. The non-transitory computer-readable storage medium of claim 12 , wherein invocation of the merged semantic grammar is conditional based on parameters.

17. The non-transitory computer-readable storage medium of claim 16 , wherein at least one parameter identifies an application receiving the natural language expression.

18. A non-transitory computer readable medium storing computer processor instructions for:

accessing a first semantic grammar and a second semantic grammar, wherein each semantic grammar has a grammar pattern, and wherein the second semantic grammar is compatible with the first semantic grammar;

accessing an indication that the second semantic grammar extends the first semantic grammar; and

accessing a merged semantic grammar that interprets a natural language expression based on a combination of the first semantic grammar and the second semantic grammar;

wherein an invocation of the first semantic grammar within a rule of a second semantic grammar invokes the merged semantic grammar.

19. The non-transitory computer readable medium of claim 18 , the stored computer processor instructions additionally for:

receiving from a user a natural language expression; and

interpreting the natural language expression using the merged semantic grammar.

20. The non-transitory computer readable medium of claim 19 , the stored computer processor instructions additionally for:

based on the interpretation, generating an auditory output.

21. The non-transitory computer readable medium of claim 19 , wherein interpreting the natural language expression comprises:

responsive to the expression having a second interpretation according to the second grammar, deriving an interpretation of the expression according to the merged semantic grammar from the second interpretation by casting values from a semantic type of the second semantic grammar to a semantic type of the merged semantic grammar.

22. The non-transitory computer readable medium of claim 18 , wherein creating the merged grammar is jointly compiled with the first semantic grammar and the second semantic grammar.

23. The non-transitory computer readable medium of claim 18 , wherein the merged grammar is optimized as a combination of the first semantic grammar and the second semantic grammar.

24. The non-transitory computer readable medium of claim 18 , wherein creating the merged semantic grammar comprises a call to dynamically load a code library for the second semantic grammar.

25. The non-transitory computer readable medium of claim 18 , wherein the merged grammar adds a rule to the second semantic grammar.

26. The non-transitory computer readable medium of claim 18 , wherein:

the first semantic grammar is from a first developer; and

the second semantic grammar is from a second developer.

27. The non-transitory computer readable medium of claim 18 , wherein at least one of the first semantic grammar and the second semantic grammar includes a weight for a sub-expression, the interpreting the natural language expression further comprising selecting an interpretation using the weight.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2024
From: ACP POST OAK CREDIT II LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
Reel/Frame 067698/0845 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: SOUNDHOUND AI IP HOLDING, LLC
To: SOUNDHOUND AI IP, LLC
Reel/Frame 064205/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2023
From: SOUNDHOUND, INC.
To: SOUNDHOUND AI IP HOLDING, LLC
Reel/Frame 064083/0484 →
SECURITY INTEREST Recorded Apr 17, 2023
From: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
To: ACP POST OAK CREDIT II LLC
Reel/Frame 063349/0355 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2021
From: MONT-REYNAUD, BERNARD; WILSON, CHRISTOPHER S.; MOHAJER, KEYVAN
To: SOUNDHOUND, INC.
Reel/Frame 056889/0001 →