IP Library Granted Patent US 11,152,002
Granted Patent B2
US 11,152,002 · App. 16/737,100 · Granted Oct 19, 2021

Application integration with a digital assistant

Inventors: Robert A. Walker, II (San Francisco, CA); Brandon J. Newendorp (San Francisco, CA); Rohit Dasari (San Francisco, CA); Richard D. Giuli (Arroyo Grande, CA); Thomas R. Gruber (Santa Cruz, CA); Carey E. Radebaugh (Los Gatos, CA); Ashish Garg (Bellevue, WA); Vineet Khosla (Cupertino, CA); Jonathan H. Russell (San Francisco, CA); Corey Peterson (Cupertino, CA)
Assignee: Apple Inc.
G10L15/22G10L13/02G10L15/1815G06F40/35G10L15/063G10L15/30G10L2015/223G10L2015/228
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,152,002
App. No.
16/737,100
Granted
Oct 19, 2021
Kind
B2
Abstract

Systems and processes for application integration with a digital assistant are provided. In accordance with one example, a method includes, at an electronic device having one or more processors and memory, receiving a natural-language user input; identifying, with the one or more processors, an intent object of a set of intent objects and a parameter associated with the intent, where the intent object and the parameter are derived from the natural-language user input. The method further includes identifying a software application associated with the intent object of the set of intent objects; and providing the intent object and the parameter to the software application.

Claims (61)

1. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of a first electronic device, cause the first electronic device to:

receive a natural-language user input;

provide the natural-language user input to a second electronic device;

receive, in response to a determination by the second electronic device that a software application corresponding to an intent object derived from the natural-language user input is not located on the first electronic device, an indication of the determination from the second electronic device;

responsive to the indication, obtain a list of applications corresponding to the intent object;

display, with a touch-sensitive display of the first electronic device, the list of applications corresponding to the intent object in a user interface; and

receive a user input indicative of a selection of an application of the list of applications.

2. The non-transitory computer-readable storage medium according to claim 1 , wherein the one or more programs further include instructions which when executed by one or more processors of the first electronic device, cause the first electronic device to:

derive the intent object from the natural-language user input.

3. The non-transitory computer-readable storage medium according to claim 1 , wherein the one or more programs further include instructions which when executed by one or more processors of the first electronic device, cause the first electronic device to:

provide the intent object to the application, wherein providing the intent object includes downloading and/or installing the application such that the first electronic device may access the software application locally, or wherein providing the intent object includes remotely accessing the application.

4. The non-transitory computer-readable storage medium according to claim 3 , wherein the one or more programs further include instructions which when executed by one or more processors of the first electronic device, cause the first electronic device to:

cause the application to perform a task associated with the intent object; and

after providing the intent object to the application, receive, from the application, a result response associated with the intent object.

5. The non-transitory computer-readable storage medium according to claim 1 , wherein the one or more programs further include instructions which when executed by one or more processors of the first electronic device, cause the first electronic device to:

identify a parameter associated with the intent object; and

provide the parameter to the application.

6. The non-transitory computer-readable storage medium according to claim 5 , wherein the one or more programs further include instructions which when executed by one or more processors of the first electronic device, cause the first electronic device to:

receive a response from the application, wherein the response is indicative of whether the parameter is valid.

7. A first electronic device, comprising:

one or more processors;

a memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

receiving a natural-language user input;

providing the natural-language user input to a second electronic device;

receiving, in response to a determination by the second electronic device that a software application corresponding to an intent object derived from the natural-language user input is not located on the first electronic device, an indication of the determination from the second electronic device;

responsive to the indication, obtaining a list of applications corresponding to the intent object;

displaying, with a touch-sensitive display of the first electronic device, the list of applications corresponding to the intent object in a user interface; and

receiving a user input indicative of a selection of an application of the list of applications.

8. The first electronic device according to claim 7 , wherein the one or more programs further include instructions for:

deriving the intent object from the natural-language user input.

9. The first electronic device according to claim 7 , wherein the one or more programs further include instructions for:

providing the intent object to the application, wherein providing the intent object includes downloading and/or installing the application such that the first electronic device may access the software application locally, or wherein providing the intent object includes remotely accessing the application.

10. The first electronic device according to claim 9 , wherein the one or more programs further include instructions for:

causing the application to perform a task associated with the intent object; and

after providing the intent object to the application, receiving, from the application, a result response associated with the intent object.

11. The first electronic device according to claim 7 , wherein the one or more programs further include instructions for:

identifying a parameter associated with the intent object; and

providing the parameter to the application.

12. The first electronic device according to claim 11 , wherein the one or more programs further include instructions for:

receiving a response from the application, wherein the response is indicative of whether the parameter is valid.

13. A method, comprising:

at a first electronic device having one or more processors:

receiving a natural-language user input;

providing the natural-language user input to a second electronic device;

receiving, in response to a determination by the second electronic device that a software application corresponding to an intent object derived from the natural-language user input is not located on the first electronic device, an indication of the determination from the second electronic device;

responsive to the indication, obtaining a list of applications corresponding to the intent object;

displaying, with a touch-sensitive display of the first electronic device, the list of applications corresponding to the intent object in a user interface; and

receiving a user input indicative of a selection of an application of the list of applications.

14. The method of claim 13 , further comprising:

deriving the intent object from the natural-language user input.

15. The method of claim 13 , further comprising:

providing the intent object to the application, wherein providing the intent object includes downloading and/or installing the application such that the first electronic device may access the software application locally, or wherein providing the intent object includes remotely accessing the application.

16. The method of claim 15 , further comprising:

causing the application to perform a task associated with the intent object; and

after providing the intent object to the application, receiving, from the application, a result response associated with the intent object.

17. The method of claim 13 , further comprising:

identifying a parameter associated with the intent object; and

providing the parameter to the application.

18. The method of claim 17 , further comprising:

receiving a response from the application, wherein the response is indicative of whether the parameter is valid.

Continuity (4)
Continuation 16207901 · Dec 3, 2018
Continuation 15269728 · Sep 19, 2016
Provisional Application 62348929 · Jun 11, 2016
Related Publication 20200143812A1 · May 7, 2020
Cited By (12)
US 12,236,938 US 12,293,763 US 12,333,404 US 12,386,434 US 12,437,747 US 12,477,470 US 12,562,172 US 12,567,415 US 12,613,621 US 12,620,179 US 12,626,702 US 12,675,839