IP Library Granted Patent US 11,900,928
Granted Patent B2
US 11,900,928 · App. 15/853,780 · Granted Feb 13, 2024

System and method for adapted interactive experiences

Inventors: Joel McKenzie (San Francisco, CA); Qindi Zhang (Los Altos, CA)
Assignee: SoundHound AI IP, LLC
G10L15/22G06Q30/0267G06Q30/0271G10L15/1815G10L15/19
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,900,928
App. No.
15/853,780
Granted
Feb 13, 2024
Kind
B2
Abstract

Natural language grammars interpret expressions at the conversational human-machine interfaces of devices. Under conditions favoring engagement, as specified in a unit of conversational code, the device initiates a discussion using one or more of TTS, images, video, audio, and animation depending on the device capabilities of screen and audio output. Conversational code units specify conditions based on conversation state, mood, and privacy. Grammars provide intents that cause calls to system functions. Units can provide scripts for guiding the conversation. The device, or supporting server system, can provide feedback to creators of the conversational code units for analysis and machine learning.

Claims (29)

1. A method of delivering interactive experiences through a human-machine interface, the method comprising:

prior to a user engaging with the human-machine interface, the human-machine interface having not received any voice from the user, delivering an introductory message, which is verbal, defined in a selected interactive experience unit, the selected interactive experience unit being selected from a plurality of interactive experience units,

wherein each interactive experience unit includes an offer, a natural language grammar, and an offer value, and

wherein the offer value of the selected interactive experience unit is highest relative to each of the plurality of interactive experience units;

receiving a natural language expression from the user after starting delivery of the introductory message;

interpreting the natural language expression according to a natural language grammar defined within the selected interactive experience unit; and

responsive to the natural language expression matching the natural language grammar, determining an intent defined in the natural language grammar.

2. The method of claim 1 wherein:

the introductory message is verbal; and

the natural language expression is received as audible speech.

3. The method of claim 1 wherein the human-machine interface is screenless.

4. The method of claim 1 wherein the introductory message comprises text with metadata for speech synthesis.

5. The method of claim 1 wherein the introductory message comprises conditional content that is conditioned by conversation state.

6. The method of claim 5 wherein the condition is a range.

7. The method of claim 1 further comprising detecting a mood, wherein delivering the introductory message is conditioned by the mood.

8. The method of claim 1 further comprising choosing an interactive experience unit with a highest message rate value, wherein message rate values are conditioned by conversation state.

9. The method of claim 1 further comprising taking an action indicated by the intent, wherein the action comprises a script with a plurality of conditional conversation paths.

10. The method of claim 1 further comprising determining an interface privacy level, wherein delivering the introductory message is conditioned by the privacy level.

11. A system comprising:

a natural language processor enabled to interpret natural language expressions according to a natural language grammar;

means to deliver introductory verbal messages, the system having not received any natural language expression from a user, of an interactive experience unit selected from a plurality of interactive experience units, the means to deliver being in communication with the natural language processor, wherein the selected interactive experience unit includes a highest offer value;

means to receive natural language expressions after delivering at least one of the introductory verbal messages to the user prior to user engagement, the means to receive being in communication with the natural language processor; and

means for storing definitions of interactive experience units, the means for storing being in communication with the natural language processor, and each of the plurality of interactive experience units comprising:

an introductory verbal message;

an offer;

an offer value; and

a natural language grammar comprising an intent that indicates an action.

12. The system of claim 11 further comprising:

means to execute the actions, the means to execute being in communication with the natural language processor and the execution being conditioned by a natural language expression matching a grammar.

Assignments (12)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Dec 3, 2024
From: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 069480/0312 →
SECURITY INTEREST Recorded Aug 9, 2024
From: SOUNDHOUND, INC.
To: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
Reel/Frame 068526/0413 →
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2024
From: ACP POST OAK CREDIT II LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
Reel/Frame 067698/0845 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: SOUNDHOUND AI IP HOLDING, LLC
To: SOUNDHOUND AI IP, LLC
Reel/Frame 064205/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2023
From: SOUNDHOUND, INC.
To: SOUNDHOUND AI IP HOLDING, LLC
Reel/Frame 064083/0484 →
RELEASE OF SECURITY INTEREST Recorded Apr 21, 2023
From: FIRST-CITIZENS BANK & TRUST COMPANY, AS AGENT
To: SOUNDHOUND, INC.
Reel/Frame 063411/0396 →
RELEASE OF SECURITY INTEREST Recorded Apr 19, 2023
From: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 063380/0625 →
SECURITY INTEREST Recorded Apr 17, 2023
From: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
To: ACP POST OAK CREDIT II LLC
Reel/Frame 063349/0355 →
CORRECTIVE ASSIGNMENT TO CORRECT THE COVER SHEET PREVIOUSLY RECORDED AT REEL: 056627 FRAME: 0772. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Apr 12, 2023
From: SOUNDHOUND, INC.
To: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
Reel/Frame 063336/0146 →
SECURITY INTEREST Recorded Jun 18, 2021
From: OCEAN II PLO LLC, AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 056627/0772 →
SECURITY INTEREST Recorded Apr 1, 2021
From: SOUNDHOUND, INC.
To: SILICON VALLEY BANK
Reel/Frame 055807/0539 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2018
From: MCKENZIE, JOEL; ZHANG, QINDI
To: SOUNDHOUND, INC.
Reel/Frame 046222/0377 →
Continuity (1)
Related Publication 20190198016A1 · Jun 27, 2019
Cited By (2)
US 12,585,655 US 12,706,094