IP Library Patent Application 15708517
Patent Application
App. No. 15/708,517

PERSONAL ASSISTANT CONTEXT BUILDING

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/708,517
Abstract

Technologies related to personal assistant context building are generally described. In some examples, network service communications, such as network traffic resulting from the use of mobile applications or “apps” on a mobile device, may be captured, parsed, and included in personal assistant context databases for use in configuring automated personal assistant user interaction operations. In some examples, parsing services may be provided to parse forwarded network service communications and generate converted data for inclusion in personal assistant context databases.

Claims (60)

1 . A method, comprising:

obtaining, by a computing device that is equipped with an automated personal assistant, data that corresponds to a network application programming interface (API) communication;

parsing, by the computing device, at least a portion of the data, wherein parsing the at least the portion of the data comprises:

identifying, by the computing device, a network API that corresponds to the network API communication;

identifying, by the computing device, service translation information for the identified network API, wherein the service translation information comprises terms used in connection with the identified network API, and translation outputs that correspond to the terms; and

converting, by the computing device, the at least the portion of the data into converted data using the identified service translation information for the identified network API;

storing, by the computing device, the converted data in a context database, wherein the context database corresponds to the automated personal assistant;

receiving, by the computing device, a user input that corresponds to the automated personal assistant;

determining, by the computing device, context information for the user input, based on the converted data that is stored in the context database;

configuring, by the computing device and based on the context information, a user interaction operation, which is to be performed in response to the user input, wherein the user interaction operation corresponds to the automated personal assistant; and

performing, by the computing device, the configured user interaction operation.

2 . The method of claim 1 , further comprising detecting, by the computing device, the network API communication by analyzing network traffic for at least one of API calls and API responses.

3 . The method of claim 2 , wherein detecting the network API communication comprises detecting one or more of an extensible markup language (XML) or a javascript object notation (JSON) communication.

4 . The method of claim 2 , wherein detecting the network API communication comprises detecting one or more of a hypertext transfer protocol (HTTP) “Post” command, a HTTP “Get” command, an API key field, an API destination, an API format tag, or a communication with a known API in the network API communication.

5 . The method of claim 1 , further comprising:

maintaining, by the computing device, a network API library that includes service translation information for a plurality of network APIs.

6 . The method of claim 5 , wherein maintaining the network API library comprises maintaining the network API library at least, in part, by checking published network APIs for updates to the published network APIs.

7 . The method of claim 1 , further comprising:

connecting, by the computing device, to a network API library to retrieve the service translation information for the network API that corresponds to the network API communication.

8 . The method of claim 1 , wherein configuring the user interaction operation comprises configuring one or more of: an internet search or a voice interaction with a user of the computing device.

9 . The method of claim 1 , wherein configuring the user interaction operation comprises configuring one of: a display operation by the automated personal assistant on a user interface of the computing device or an audible speech output by the automated personal assistant.

10 . The method of claim 1 , further comprising classifying, by the computing device, the converted data that is stored in the context database.

11 . The method of claim 10 , wherein classifying the converted data comprises adjusting relative weights of relationships among the converted data, and wherein adjusting the relative weights comprises strengthening weights of relationships among the converted data that is stored in the context database relative to weights of relationships among other data that is stored in the context database.

12 . The method of claim 11 , wherein adjusting the relative weights of relationships among the converted data comprises adjusting the relative weights of relationships based on age of the converted data.

13 . The method of claim 1 , wherein parsing the at least the portion of the data comprises removing portions of the API communication, which are irrelevant to build context for the automated personal assistant.

14 . The method of claim 1 , wherein parsing the at least the portion of the data comprises grouping data from the API communication into contextual groups to build context for the automated personal assistant.

15 . A computing device, comprising:

a processor; and

an automated personal assistant executable by the processor, wherein the automated personal assistant is configured to:

obtain data that corresponds to a network application programming interface (API) communication;

parse at least a portion of the data,

wherein to parse the at least the portion of the data, the automated personal assistant is configured to:

identify a network API that corresponds to the network API communication;

identify service translation information for the identified network API, wherein the service translation information comprises terms used in connection with the identified network API, and translation outputs that correspond to the terms; and

convert the at least the portion of the data into converted data by use of the identified service translation information for the identified network API;

store the converted data in a context database that corresponds to the automated personal assistant;

obtain a user input that corresponds to the automated personal assistant;

determine context information for the user input, based on the converted data that is stored in the context database;

configure, based on the context information, a user interaction operation, which is to be performed in response to the user input, wherein the user interaction operation corresponds to the automated personal assistant; and

perform the configured user interaction operation.

16 . The computing device of claim 15 , wherein the automated personal assistant is further configured to:

adjust relative weights of relationships among the converted data that is stored in the context database, and wherein to adjust the relative weights, the automated personal assistant is configured to strengthen weights of relationships among the converted data that is stored in the context database relative to weights of relationships among other data that is stored in the context database.

17 . The computing device of claim 16 , wherein adjustment of the relative weights of relationships among the converted data comprises adjustment of the relative weights of relationships based on age of the converted data.

18 . The computing device of claim 15 , wherein the API communication corresponds to one of: an application, a widget, or a browser of the computing device.

19 . The computing device of claim 15 , wherein the context database is stored locally on the computing device or is implemented as a cloud-based context database.

20 . The computing device of claim 15 , wherein the automated personal assistant is configured to obtain the user input via one of: a microphone, a keyboard, or a camera.

21 . The computing device of claim 15 , wherein to perform the configured user interaction operation, the automated personal assistant is configured to: place a call, send a text message, post information to a social network, display requested information, or retrieve driving instructions.

22 . The computing device of claim 21 , wherein the automated personal assistant is configured to connect to a network API library service to retrieve the service translation information for the network API that corresponds to the API communication.

23 . A non-transitory computer readable storage medium having computer executable instructions that, in response to execution by one or more processors, cause the one or more processors to execute an automated personal assistant to perform or control performance of operations comprising:

obtain data that corresponds to a network application programming interface (API) communication;

parse at least a portion of the data, wherein the operation to parse the at least the portion of the data comprises operations to:

identify a network API that corresponds to the network API communication;

identify service translation information for the identified network API, wherein the service translation information comprises terms used in connection with the identified network API, and translation outputs that correspond to the terms; and

convert the at least the portion of the data into converted data by use of the identified service translation information for the identified network API;

store the converted data in a context database, wherein the context database corresponds to the automated personal assistant;

classify the converted data that is stored in the context database;

obtain a user input that corresponds to the automated personal assistant;

determine context information for the received user input, based on the classified data that is stored in the context database;

configure, based on the context information, a user interaction operation, which is to be performed in response to the user input, wherein the user interaction operation corresponds to the automated personal assistant; and

perform the configured user interaction operation.

Assignments (5)
RELEASE OF SECURITY INTEREST IN PATENTS, RECORDED ON JANUARY 29, 2019 AT REEL 048373 FRAME 0217 Recorded Sep 22, 2025
From: CRESTLINE DIRECT FINANCE, L.P., AS COLLATERAL AGENT
To: EMPIRE TECHNOLOGY DEVELOPMENT LLC
Reel/Frame 072936/0464 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 3, 2021
From: IP3 2019, SERIES 400 OF ALLIED SECURITY TRUST I
To: ZAMA INNOVATIONS LLC
Reel/Frame 057407/0395 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2020
From: EMPIRE TECHNOLOGY DEVELOPMENT, LLC
To: IP3 2019, SERIES 400 OF ALLIED SECURITY TRUST I
Reel/Frame 051435/0374 →
RELEASE OF SECURITY INTEREST Recorded Dec 6, 2019
From: CRESTLINE DIRECT FINANCE, L.P.
To: EMPIRE TECHNOLOGY DEVELOPMENT LLC
Reel/Frame 051205/0654 →
SECURITY INTEREST Recorded Jan 29, 2019
From: EMPIRE TECHNOLOGY DEVELOPMENT LLC
To: CRESTLINE DIRECT FINANCE, L.P.
Reel/Frame 048373/0217 →