IP Library › Granted Patent US 11,004,446
Granted Patent B2
US 11,004,446 · App. 15/640,201 · Granted May 11, 2021

Alias resolving intelligent assistant computing device

Inventors: Erich-Soren Finkelstein (Bellevue, WA); Han Yee Mimi Fung (Bellevue, WA); Oz Solomon (Maple, CA)
Assignee: Microsoft Technology Licensing, LLC
G10L15/1822A61B5/0205A61B5/0507A61B5/117A61B5/1113A61B5/7475G01S5/18G01S5/28G06F1/324G06F1/3206G06F1/3231G06F3/011G06F3/017G06F3/0304G06F3/0482G06F3/04842G06F3/167G06F21/32G06F21/35G06F40/211G06F40/35G06K9/00G06K9/00214G06K9/00255G06K9/00261G06K9/00288G06K9/00295G06K9/00342G06K9/00362G06K9/00711G06K9/00771G06K9/00973G06K9/6254G06K9/6255G06K9/6289G06K9/6296G06K9/726G06N5/025G06N5/047G06N20/00G06T7/248G06T7/292G06T7/60G06T7/70G06T7/74G07C9/28G08B13/1427G10L15/02G10L15/063G10L15/08G10L15/18G10L15/1815G10L15/19G10L15/22G10L15/24G10L15/26G10L15/28G10L15/32G10L17/04G10L17/08G10L25/51H04L51/02H04L63/102H04L67/12H04L67/22H04N5/23219H04N5/332H04N7/181H04N7/188H04N21/231H04N21/42203H04N21/44218H04N21/44222H04R1/406H04R3/005H04W4/029H04W4/33A61B5/05A61B5/1118G01S5/16G01S13/38G01S13/867G01S13/888G06F3/0488G06F16/70G06F2203/0381G06F2221/2111G06K2209/09G06N3/0445G06T2207/10016G06T2207/10024G06T2207/20101G06T2207/30196G06T2207/30201G06T2207/30204G06T2207/30232G07C9/32G08B29/186G10L17/00G10L2015/0635G10L2015/088G10L2015/223G10L2015/225G10L2015/228H04N5/247Y02D10/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,004,446
App. No.
15/640,201
Filed
Jun 30, 2017
Granted
May 11, 2021
Kind
B2
Art Unit
2123
USPC
706/48
Abstract

Intelligent assistant systems, methods and computing devices are disclosed for resolving alias identifiers. A method comprises receiving and parsing data comprising a current user input that includes an alias identifier. The data and/or other sensor data are analyzed to identify the user. Based at least on identifying the user and recognizing the alias identifier, usage pattern data comprising at least one previous user input that includes the alias identifier and corresponding context information is accessed. The usage pattern data is used to resolve the alias identifier to mean the alias identifier in an alias record of a known entity. Based at least on resolving the alias identifier, an output device is controlled to one or more of generate a message and perform an action with respect to the known entity.

Claims (63)

1. An intelligent digital assistant system, comprising:

at least one sensor in an environment;

a logic processor; and

a storage device holding instructions executable by the logic processor to:

via the at least one sensor, receive data comprising a current input provided by a user that includes an alias identifier;

parse the data to recognize the alias identifier;

computer-analyze one or more of the data and other sensor data received from the environment to identify the user as providing the current input;

based at least on identifying the user and recognizing the alias identifier in the data, access usage pattern data of the user comprising at least one previous input provided by the user that includes the alias identifier and corresponding context information;

using at least the previous input and the context information, resolve the alias identifier in the current input to mean the alias identifier in an alias record of a known entity;

based at least on resolving the alias identifier in the current input, control an output device to one or more of generate a message and perform an action with respect to the known entity;

from a new user, receive a new user input that includes the alias identifier;

based at least on usage pattern data of the new user, resolve the alias identifier in the new user input to mean the alias identifier in the alias record of the known entity; and

based at least on resolving the alias identifier in the new user input, classify the new user into a category that relates to one or more aspects of the alias identifier.

2. The intelligent digital assistant system of claim 1 , wherein the at least one sensor comprises a microphone, the data comprises audio data and the current input comprises a spoken utterance of the user.

3. The intelligent digital assistant system of claim 2 , wherein the at least one sensor further comprises a camera, and the data further comprises image data captured with the spoken utterance of the user.

4. The intelligent digital assistant system of claim 1 , wherein the at least one sensor comprises a camera, the data comprises image data and the current input comprises a gesture of the user.

5. The intelligent digital assistant system of claim 1 , wherein the context information is captured contemporaneously with the previous user input provided by the user.

6. The intelligent digital assistant system of claim 1 , wherein the context information comprises one or more of audio data and image data.

7. The intelligent digital assistant system of claim 1 , wherein the instructions are executable to:

from another user receive alias record input comprising the alias identifier; and

populate the alias record with the alias record input from the other user.

8. The intelligent digital assistant system of claim 7 , wherein the alias record input comprises an utterance spoken by the other user.

9. The intelligent digital assistant system of claim 1 , wherein the instructions are executable to:

identify a link between the alias identifier and other information of the user that relates to the one or more aspects of the alias identifier; and

use the link to classify the new user into the category that relates to the one or more aspects of the alias identifier.

10. At a computing device, a method for resolving an alias identifier, the method comprising:

via at least one sensor in an environment, receiving data comprising a current input provided by a user that includes the alias identifier;

parsing the data to recognize the alias identifier;

computer-analyzing one or more of the data and other sensor data received from the environment to identify the user as providing the current input;

based at least on identifying the user and recognizing the alias identifier in the data, accessing usage pattern data of the user comprising at least one previous input provided by the user that includes the alias identifier and corresponding context information;

using at least the previous input and the context information, resolving the alias identifier in the current input to mean the alias identifier in an alias record of a known entity;

based at least on resolving the alias identifier in the current input, controlling an output device to one or more of generate a message and perform an action with respect to the known entity;

from a new user, receiving a new user input that includes the alias identifier;

based at least on usage pattern data of the new user, resolving the alias identifier in the new user input to mean the alias identifier in the alias record of the known entity; and

based at least on resolving the alias identifier in the new user input, classifying the new user into a category that relates to one or more aspects of the alias identifier.

11. The method of claim 10 , wherein the at least one sensor comprises a microphone, the data comprises audio data and the current input comprises a spoken utterance of the user.

12. The method of claim 11 , wherein the at least one sensor further comprises a camera, and the data further comprises image data captured with the spoken utterance of the user.

13. The method of claim 10 , wherein the at least one sensor comprises a camera, the data comprises image data and the current input comprises a gesture of the user.

14. The method of claim 10 , further comprising capturing the context information contemporaneously with the previous user input provided by the user.

15. The method of claim 10 , wherein the context information comprises one or more of audio data and image data.

16. The method of claim 10 , further comprising:

receiving from another user alias record input comprising the alias identifier; and

populating the alias record with the alias record input from the other user.

17. The method of claim 16 , wherein the alias record input comprises an utterance spoken by the other user.

18. A computing device, comprising:

a plurality of sensors;

a logic processor; and

a storage device holding instructions executable by the logic processor to:

via the at least one of the sensors, receive data comprising a current input provided by a user that includes an alias identifier;

convert the data into parsable data;

parse the data to recognize the alias identifier;

computer-analyze one or more of the data and other sensor data received from an environment of the user to identify the user as providing the current input;

based at least on identifying the user and recognizing the alias identifier in the data, access usage pattern data of the user comprising at least one previous input provided by the user that includes the alias identifier and corresponding context information;

access an alias record of a known entity;

using at least the previous input and the context information, resolve the alias identifier in the current input to mean the alias identifier in the alias record of the known entity;

based at least on resolving the alias identifier in the current input, control an output device to one or more of generate a message and perform an action with respect to the known entity;

from a new user, receive a new user input that includes the alias identifier;

based at least on usage pattern data of the new user, resolve the alias identifier in the new user input to mean the alias identifier in the alias record of the known entity; and

based at least on resolving the alias identifier in the new user input, classify the new user into a category that relates to one or more aspects of the alias identifier.

19. The computing device of claim 18 , wherein the context information is captured contemporaneously with the previous user input provided by the user.

20. The method of claim 10 , further comprising:

identifying a link between the alias identifier and other information of the user that relates to the one or more aspects of the alias identifier; and

using the link to classify the new user into the category that relates to the one or more aspects of the alias identifier.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2017
From: FINKELSTEIN, ERICH-SOREN; FUNG, HAN YEE MIMI; SOLOMON, OZ
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 043631/0286 →
Continuity (3)
Provisional Application 62482165 · Apr 5, 2017
Provisional Application 62459020 · Feb 14, 2017
Related Publication 20180232645A1 · Aug 16, 2018