IP Library Granted Patent US 11,194,998
Granted Patent B2
US 11,194,998 · App. 15/657,822 · Granted Dec 7, 2021

Multi-user intelligent assistance

Inventors: Kazuhito Koishida (Redmond, WA); Alexander A Popov (Kirkland, WA); Uros Batricevic (Redmond, WA); Steven Nabil Bathiche (Bellevue, WA)
Assignee: Microsoft Technology Licensing, LLC
G06K9/00261A61B5/0205A61B5/0507A61B5/117A61B5/1113A61B5/7475G01S5/18G01S5/28G01S13/726G06F1/324G06F1/3206G06F1/3231G06F3/011G06F3/017G06F3/0304G06F3/0482G06F3/04842G06F3/167G06F21/32G06F21/35G06F40/211G06F40/35G06K9/00G06K9/00214G06K9/00255G06K9/00288G06K9/00295G06K9/00342G06K9/00362G06K9/00711G06K9/00771G06K9/00973G06K9/6254G06K9/6255G06K9/6289G06K9/6296G06K9/726G06N5/025G06N5/047G06N20/00G06T7/248G06T7/292G06T7/60G06T7/70G06T7/74G07C9/28G08B13/1427G10L15/02G10L15/063G10L15/08G10L15/18G10L15/1815G10L15/1822G10L15/19G10L15/22G10L15/24G10L15/26G10L15/28G10L15/32G10L17/04G10L17/08G10L25/51H04L51/02H04L63/102H04L67/12H04L67/22H04N5/23219H04N5/332H04N7/181H04N7/188H04N21/231H04N21/42203H04N21/44218H04N21/44222H04R1/406H04R3/005H04W4/029H04W4/33A61B5/05A61B5/1118G01S5/16G01S11/14G01S13/38G01S13/867G01S13/888G06F3/0488G06F16/70G06F2203/0381G06F2221/2111G06K2209/09G06N3/0445G06T2207/10016G06T2207/10024G06T2207/20101G06T2207/30196G06T2207/30201G06T2207/30204G06T2207/30232G07C9/32G08B29/186G10L17/00G10L2015/0635G10L2015/088G10L2015/223G10L2015/225G10L2015/228H04N5/247Y02D10/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,194,998
App. No.
15/657,822
Filed
Jul 24, 2017
Granted
Dec 7, 2021
Kind
B2
Art Unit
2658
USPC
704/251
Abstract

An intelligent assistant records speech spoken by a first user and determines a self-selection score for the first user. The intelligent assistant sends the self-selection score to another intelligent assistant, and receives a remote-selection score for the first user from the other intelligent assistant. The intelligent assistant compares the self-selection score to the remote-selection score. If the self-selection score is greater than the remote-selection score, the intelligent assistant responds to the first user and blocks subsequent responses to all other users until a disengagement metric of the first user exceeds a blocking threshold. If the self-selection score is less than the remote-selection score, the intelligent assistant does not respond to the first user.

Claims (51)

1. An intelligent assistant computer, comprising:

a logic machine; and

a storage machine holding instructions executable by the logic machine to:

recognize another intelligent assistant computer located in a same environment as the intelligent assistant computer;

record speech spoken by a first user;

determine a self-selection score for the first user based on the speech spoken by the first user;

send the self-selection score for the first user to the other intelligent assistant computer;

receive a remote-selection score for the first user from the other intelligent assistant computer;

compare the self-selection score for the first user to the remote-selection score for the first user;

if the self-selection score is greater than the remote-selection score, respond to the first user, determine a disengagement metric of the first user based on recorded speech spoken by the first user, and block subsequent responses to all other users until the disengagement metric of the first user exceeds a blocking threshold, wherein the disengagement metric increases with increasing disengagement of the first user from the intelligent assistant computer, wherein subsequent responses to all other users are blocked when the blocking threshold is above the disengagement metric, and wherein a subsequent response to another user is not blocked when the blocking threshold is below the disengagement metric;

if the self-selection score is less than the remote-selection score, do not respond to the first user; and

stop blocking subsequent responses to the other user responsive to a new self-selection score for the first user being less than a new remote-selection score for the first user.

2. The intelligent assistant computer of claim 1 , wherein the instructions are further executable to set the disengagement metric of the first user to a maximum value responsive to an explicit command from the first user to disengage from the intelligent assistant computer.

3. The intelligent assistant computer of claim 1 , wherein the instructions are further executable to lower the blocking threshold responsive to identifying that the other user is authorized to receive subsequent responses based on a device setting of the intelligent assistant computer.

4. The intelligent assistant computer of claim 3 , wherein the device setting includes a parental control setting authorizing an identified child to receive approved content.

5. The intelligent assistant computer of claim 3 , wherein the device setting includes a privacy setting authorizing the other user to receive selected impersonal content.

6. The intelligent assistant computer of claim 3 , wherein the device setting authorizes the first user to receive high-value information based on an organizational relationship between the first user and the high-value information, and authorizes the other user to receive filtered content that does not include high-value information based on a different organizational relationship between the other user and the high-value information.

7. The intelligent assistant computer of claim 1 , wherein the instructions are further executable to:

receive a request from the other user;

identify content that the other user is authorized to receive from the intelligent assistant computer; and

responsive to identifying the content, lower the blocking threshold.

8. The intelligent assistant computer of claim 1 , wherein the instructions are further executable to stop blocking subsequent responses to the other user responsive to receiving a command from the first user instructing the intelligent assistant computer to respond to the other user.

9. The intelligent assistant computer of claim 1 , wherein the instructions are further executable to lower the blocking threshold for any other user for which remote selection scores are not being received.

10. The intelligent assistant computer of claim 1 , wherein the instructions are further executable to respond to the first user responsive to recognizing a keyword in the speech spoken by the first user.

11. The intelligent assistant computer of claim 1 , wherein the instructions are further executable to adjust the blocking threshold responsive to the other user being unidentified.

12. The intelligent assistant computer of claim 1 , wherein the other intelligent assistant computer is closer to the first user than the intelligent assistant computer.

13. The intelligent assistant computer of claim 1 , wherein the instructions are further executable to lower the blocking threshold according to a time decay function.

14. The intelligent assistant computer of claim 13 , wherein the instructions are further executable to lower the blocking threshold according to the time decay function based on one or both of the disengagement metric of the first user and an engagement metric of the other user.

15. The intelligent assistant computer of claim 1 , wherein the instructions are further executable to select one of a plurality of audio output devices controlled by the intelligent assistant computer with which to respond to the first user.

16. The intelligent assistant computer of claim 15 , wherein the instructions are further executable to select all of the plurality of audio output devices controlled by the intelligent assistant computer with which to respond to the other user when the other user is an identified child or an unidentified user.

17. The intelligent assistant computer of claim 1 , wherein the instructions are further executable to select a number of audio output devices controlled by the intelligent assistant computer with which to respond to the other user, the number being selected based on a recorded loudness in the environment.

18. At an intelligent assistant computer, a method, comprising:

recognizing another intelligent assistant computer located in a same environment as the intelligent assistant;

recording speech spoken by a first user;

determining a self-selection score for the first user based on the speech spoken by the first user;

sending the self-selection score for the first user to the other intelligent assistant computer;

receiving a remote-selection score for the first user from the other intelligent assistant computer;

comparing the self-selection score for the first user to the remote-selection score for the first user;

if the self-selection score is greater than the remote-selection score, responding to the first user, determining a disengagement metric of the first user based on recorded speech spoken by the first user, and blocking subsequent responses to all other users until the disengagement metric of the first user exceeds a blocking threshold, wherein the disengagement metric increases with increasing disengagement of the first user from the intelligent assistant computer, and wherein subsequent responses to all other users are blocked when the blocking threshold is above the disengagement metric, wherein a subsequent response to another user is not blocked when the blocking threshold is below the disengagement metric;

if the self-selection score is less than the remote-selection score, not responding to the first user; and

stopping blocking subsequent responses to the other user responsive to a new self-selection score for the first user being less than a new remote-selection score for the first user.

19. At an intelligent assistant computer, a method, comprising:

recognizing another intelligent assistant computer located in a same environment as the intelligent assistant;

recording speech spoken by a first user;

determining a self-selection score for the first user based on the speech spoken by the first user;

sending the self-selection score for the first user to the other intelligent assistant computer;

receiving a remote-selection score for the first user from the other intelligent assistant computer;

comparing the self-selection score for the first user to the remote-selection score for the first user;

if the self-selection score is greater than the remote-selection score, responding to the first user, determining a disengagement metric of the first user based on recorded speech spoken by the first user, and blocking subsequent responses to all other users until the disengagement metric of the first user exceeds a blocking threshold, wherein the disengagement metric increases with increasing disengagement of the first user from the intelligent assistant computer, wherein subsequent responses to all other users are blocked when the blocking threshold is above the disengagement metric, wherein a subsequent response to another user is not blocked when the blocking threshold is below the disengagement metric, and wherein the blocking threshold decreases between instances of recorded speech spoken by the first user according to a time decay function;

if the self-selection score is less than the remote-selection score, not responding to the first user; and

stopping blocking subsequent responses to the other user responsive to a new self-selection score for the first user being less than a new remote-selection score for the first user.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 28, 2017
From: BATHICHE, STEVEN NABIL
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 044239/0275 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2017
From: KOISHIDA, KAZUHITO; POPOV, ALEXANDER A.; BATRICEVIC, UROS
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 043081/0148 →
Continuity (3)
Provisional Application 62459020 · Feb 14, 2017
Provisional Application 62482165 · Apr 5, 2017
Related Publication 20180233142A1 · Aug 16, 2018