IP Library Granted Patent US 12,125,484
Granted Patent B2
US 12,125,484 · App. 17/562,891 · Granted Oct 22, 2024

Controlling an engagement state of an agent during a human-machine dialog

Inventors: Scott Halstvedt (Santa Clara, CA); Keyvan Mohajer (Los Gatos, CA); Bernard Mont-Reynaud (Sunnyvale, CA)
Assignee: SoundHound AI IP, LLC
G10L15/22G06F3/167G06F21/32G10L15/08G10L17/04G10L17/06G10L17/22G06V40/16G06V40/166G10L2015/088G10L2015/223G10L17/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,125,484
App. No.
17/562,891
Granted
Oct 22, 2024
Kind
B2
Abstract

A method of controlling an engagement state of an agent during a human-machine dialog is provided. The method can include receiving a spoken request that is a conditional locking request, wherein the conditional locking request uses a natural language expression to explicitly specify a locking condition, which is a predicate, storing the predicate in a format that can be evaluated when needed by the agent, entering a conditionally locked state in response to the conditional locking request, in the conditionally locked state, receiving a multiplicity of requests without a need for a wakeup indicator, and for a request from the multiplicity of requests evaluating the predicate upon receiving the request, and processing the request if the predicate is true.

Claims (52)

1. A method of controlling an engagement state of an agent during a human-machine dialog, the method comprising:

receiving a spoken request that is a conditional locking request, wherein the conditional locking request uses a natural language expression including (1) a locking command and (2) a locking condition according to which the agent remains in a locked state;

storing the locking condition in a format that can be evaluated when needed by the agent;

entering a conditionally locked state in response to the conditional locking request;

in the conditionally locked state, receiving a multiplicity of requests without a need for a wakeup indicator; and

for a request from the multiplicity of requests:

evaluating the locking condition upon receiving the request; and

processing the request if the locking condition is true.

2. The method of claim 1 , wherein the locking condition is time-based and the natural language expression includes at least one of the words “after,” “before,” “until,” “when,” and “while”.

3. The method of claim 1 , wherein the locking condition is location-based and the natural language expression includes at least one of the words “in,” “outside,” “near,” “next to,” “where,” “wherever” and “within”.

4. The method of claim 1 , further comprising:

receiving a spoken request that is an unlock request; and

exiting the conditionally locked state in response to the unlock request.

5. The method of claim 1 , further comprising:

receiving a timeout; and

exiting the conditionally locked state in response to the timeout.

6. The method of claim 1 , wherein:

the conditional locking request is spoken by a first user; and

the method further includes ignoring a wakeword spoken by a second user, the first user and the second user being different users.

7. The method of claim 6 , wherein the ignoring of the wakeword spoken by the second user is performed as a result of the first user having a higher ranking than the second user.

8. An automotive virtual assistant subsystem supporting human-machine dialog, the subsystem comprising software instructions for:

receiving a spoken request that is a conditional locking request, wherein the conditional locking request uses a natural language expression including (1) a locking command and (2) a locking condition according to which the subsystem remains in a locked state;

storing the locking condition in a format that can be evaluated when needed by the subsystem;

entering a conditionally locked state in response to the conditional locking request;

in the conditionally locked state, receiving a multiplicity of requests without a need for a wakeup indicator; and

for a request from the multiplicity of requests:

evaluating the locking condition upon receiving the request; and

processing the request if the locking condition is true.

9. The automotive virtual assistant subsystem of claim 8 , wherein the locking condition is time-based and the natural language expression includes at least one of the words “after,” “before,” “until,” “when,” and “while”.

10. The automotive virtual assistant subsystem of claim 8 , wherein the locking condition is location-based and the natural language expression includes at least one of the words “in,” “outside,” “near,” “next to,” “where,” “wherever” and “within”.

11. The automotive virtual assistant subsystem of claim 8 , further comprising:

receiving a spoken request that is an unlock request; and

exiting the conditionally locked state in response to the unlock request.

12. The automotive virtual assistant subsystem of claim 8 , further comprising:

receiving a timeout; and

exiting the conditionally locked state in response to the timeout.

13. A non-transitory computer-readable recording medium having computer instructions recorded thereon for controlling an engagement state of an agent during a human-machine dialog, the computer instructions, when executed on one or more processors, causing the one or more processors to implement operations comprising:

receiving a spoken request that is a conditional locking request, wherein the conditional locking request uses a natural language expression including (1) a locking command and (2) a locking condition according to which the agent remains in a locked state;

storing the locking condition in a format that can be evaluated when needed by the agent;

entering a conditionally locked state in response to the conditional locking request;

in the conditionally locked state, receiving a multiplicity of requests without a need for a wakeup indicator; and

for a request from the multiplicity of requests:

evaluating the locking condition upon receiving the request; and

processing the request if the locking condition is true.

14. The non-transitory computer-readable recording medium of claim 13 , wherein the locking condition is time-based and the natural language expression includes at least one of the words “after,” “before,” “until,” “when,” and “while”.

15. The non-transitory computer-readable recording medium of claim 13 , wherein the locking condition is location-based and the natural language expression includes at least one of the words “in,” “outside,” “near,” “next to,” “where,” “wherever” and “within”.

16. The non-transitory computer-readable recording medium of claim 13 , wherein the operations further comprise:

receiving a spoken request that is an unlock request; and

exiting the conditionally locked state in response to the unlock request.

17. The non-transitory computer-readable recording medium of claim 13 , wherein the operations further comprise:

receiving a timeout; and

exiting the conditionally locked state in response to the timeout.

Assignments (7)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Dec 3, 2024
From: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.
Reel/Frame 069480/0312 →
SECURITY INTEREST Recorded Aug 9, 2024
From: SOUNDHOUND, INC.
To: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
Reel/Frame 068526/0413 →
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2024
From: ACP POST OAK CREDIT II LLC, AS COLLATERAL AGENT
To: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
Reel/Frame 067698/0845 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: SOUNDHOUND AI IP HOLDING, LLC
To: SOUNDHOUND AI IP, LLC
Reel/Frame 064205/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2023
From: SOUNDHOUND, INC.
To: SOUNDHOUND AI IP HOLDING, LLC
Reel/Frame 064083/0484 →
SECURITY INTEREST Recorded Apr 17, 2023
From: SOUNDHOUND, INC.; SOUNDHOUND AI IP, LLC
To: ACP POST OAK CREDIT II LLC
Reel/Frame 063349/0355 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2021
From: MONT-REYNAUD, BERNARD; HALSTVEDT, SCOTT; MOHAJER, KEYVAN
To: SOUNDHOUND, INC.
Reel/Frame 058485/0206 →