IP Library Granted Patent US 10,567,477
Granted Patent B2
US 10,567,477 · App. 14/841,455 · Granted Feb 18, 2020

Virtual assistant continuity

Inventors: Michael R. Sumner (Cupertino, CA); Evan S. Dibiase (Pittsburgh, PA); Benjamin S. Phipps (San Francisco, CA)
Assignee: Apple Inc.
H04L67/10G06F3/04842G06F3/167
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,567,477
App. No.
14/841,455
Granted
Feb 18, 2020
Kind
B2
Abstract

At a first electronic device with a display and a microphone, receiving audio input via the microphone, wherein the audio input comprises a request; sending data representing the request to a service; receiving a token from the service, wherein the token permits lookup, from the service, of at least one of: the request, and result responsive to the request; and sending the token to a second electronic device external to the first electronic device.

Claims (108)

1. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a first electronic device with a display and a microphone, cause the first electronic device to:

receive audio input via the microphone of the first electronic device, wherein the audio input comprises a request;

send data representing the request to a service;

receive a token from the service, wherein the token permits lookup, from the service, of at least one of: the request, and result responsive to the request;

send the token to a second electronic device external to the first electronic device; and

in accordance with receiving the request at the first electronic device:

send, from the first electronic device to the service, context information related to a context of the first electronic device at the time the request was received, wherein the context information includes prior interaction history between a digital assistant and the user,

wherein activation of the token received from the service permits: lookup, by the second electronic device, of the context information, from the service.

2. The non-transitory computer readable storage medium of claim 1 , wherein the non-transitory computer-readable storage medium further comprises instructions, which when executed by the first electronic device, cause the first electronic device to:

receive, from the service, a result responsive to the request; and

display at least part of the result on the display of the first electronic device.

3. The non-transitory computer readable storage medium of claim 1 , wherein the non-transitory computer-readable storage medium further comprises instructions, which when executed by the first electronic device, cause the first electronic device to:

determine whether a virtual assistant session is actively running on the first electronic device; and

in accordance with a determination that a virtual assistant session is actively running on the first electronic device send the token to the second electronic device, and

in accordance with a determination that no virtual assistant session is actively running on the first electronic device, forgo sending the token to the second electronic device.

4. The non-transitory computer readable storage medium of claim 3 , wherein the virtual assistant session is active on the first electronic device when the first electronic device is sampling audio input.

5. The non-transitory computer readable storage medium of claim 3 , wherein the virtual assistant session is active on the first electronic device when a backlight of the display of the first electronic device is on.

6. The non-transitory computer readable storage medium of claim 1 , wherein the non-transitory computer-readable storage medium further comprises instructions, which when executed by the first electronic device, cause the first electronic device to:

in accordance with sending the token to the second electronic device, broadcast the token on an electronic communication channel.

7. The non-transitory computer readable storage medium of claim 1 , wherein the non-transitory computer-readable storage medium further comprises instructions, which when executed by the first electronic device, cause the first electronic device to:

in accordance with sending the token to the second electronic device, send the token as part of a transmission addressed to the second electronic device on an electronic communication channel.

8. The non-transitory computer readable storage medium of claim 1 , wherein the second electronic device is configured to:

send, to the service, the token; and

receive, from the service, at least one of: the request, and result responsive to the request.

9. The non-transitory computer readable storage medium of claim 1 , wherein the second electronic device is configured to:

receive, from the service, result responsive to the request; and

display at least a part of the received result.

10. The non-transitory computer readable storage medium of claim 1 , wherein the second electronic device is configured to:

receive a second audio input via the microphone, the second audio input comprising a second request;

send data representing the second request to the service; and

receive, from the service, a message corresponding to the second request, but no token corresponding to the second request.

11. The non-transitory computer readable storage medium of claim 10 , wherein the message is a generic message.

12. The non-transitory computer readable storage medium of claim 10 , wherein the message corresponding to the second request indicates a lack of available information identified by the service responsive to the second request.

13. The non-transitory computer readable storage medium of claim 10 , wherein the second request comprises a request for a task unsupported by the first electronic device.

14. The non-transitory computer readable storage medium of claim 1 , wherein activation of the token received from the service further permits: execution, by the second electronic device, of the request based on the context of the first electronic device when the request was received.

15. The non-transitory computer readable storage medium of claim 1 , wherein a continuity affordance is displayed by the second electronic device, the continuity affordance permitting activation of the token.

16. A method, comprising:

at a first electronic device with a display and a microphone:

receiving audio input via the microphone of the first electronic device, wherein the audio input comprises a request;

sending data representing the request to a service;

receiving a token from the service, wherein the token permits lookup, from the service, of at least one of: the request, and result responsive to the request;

sending the token to a second electronic device external to the first electronic device; and

in accordance with receiving the request at the first electronic device:

send, from the first electronic device to the service, context information related to a context of the first electronic device at the time the request was received, wherein the context information includes prior interaction history between a digital assistant and the user,

wherein activation of the token received from the service permits: lookup, by the second electronic device, of the context information, from the service.

17. The method of claim 16 , further comprising:

receiving, from the service, a result responsive to the request; and

displaying at least part of the result on the display of the first electronic device.

18. The method of claim 16 , further comprising:

determining whether a virtual assistant session is actively running on the first electronic device; and

in accordance with a determination that a virtual assistant session is actively running on the first electronic device, sending the token to the second electronic device, and

in accordance with a determination that no virtual assistant session is actively running on the first electronic device forgoing sending the token to the second electronic device.

19. The method of claim 16 , further comprising:

in accordance with sending the token to the second electronic device, broadcasting the token on an electronic communication channel.

20. The method of claim 16 , further comprising:

in accordance with sending the token to the second electronic device, sending the token as part of a transmission addressed to the second electronic device on an electronic communication channel.

21. The method of claim 16 , wherein the second electronic device is configured to:

send, to the service, the token; and

receive, from the service, at least one of: the request, and result responsive to the request.

22. The method of claim 16 , wherein the second electronic device is configured to:

receive, from the service, result responsive to the request; and

display at least a part of the received result.

23. The method of claim 16 , wherein the second electronic device is configured to:

receive a second audio input via the microphone, the second audio input comprising a second request;

send data representing the second request to the service; and

receive, from the service, a message corresponding to the second request, but no token corresponding to the second request.

24. The method of claim 23 , wherein the message corresponding to the second request indicates a lack of available information identified by the service responsive to the second request.

25. The method of claim 23 , wherein the second request comprises a request for a task unsupported by the first electronic device.

26. The method of claim 16 , wherein activation of the token received from the service further permits: execution, by the second electronic device, of the request based on the context of the first electronic device when the request was received.

27. The method of claim 16 , wherein a continuity affordance is displayed by the second electronic device, the continuity affordance permitting activation of the token.

28. An electronic device comprising:

a display;

one or more processors;

a memory;

a microphone; and

one or more programs, wherein the one or more programs are stored in memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

receiving audio input via the microphone of the electronic device, wherein the audio input comprises a request;

sending data representing the request to a service;

receiving a token from the service, wherein the token permits lookup, from the service, of at least one of: the request, and result responsive to the request; and

sending the token to a second electronic device external to the electronic device; and

in accordance with receiving the request at the electronic device:

sending, from the first electronic device to the service, context information related to a context of the first electronic device at the time the request was received, wherein the context information includes prior interaction history between a digital assistant and the user,

wherein activation of the token received from the service permits: lookup, by the second electronic device, of the context information, from the service.

29. The electronic device of claim 28 , wherein the one or more programs including instructions for:

receiving, from the service, a result responsive to the request; and

displaying at least part of the result on the display of the electronic device.

30. The electronic device of claim 28 , wherein the one or more programs including instructions for:

determining whether a virtual assistant session is actively running on the electronic device; and

in accordance with a determination that a virtual assistant session is actively running on the electronic device, sending the token to the second electronic device, and

in accordance with a determination that no virtual assistant session is actively running on the electronic device forgoing sending the token to the second electronic device.

31. The electronic device of claim 28 , wherein the one or more programs including instructions for:

in accordance with sending the token to the second electronic device, broadcasting the token on an electronic communication channel.

32. The electronic device of claim 28 , wherein the one or more programs including instructions for:

in accordance with sending the token to the second electronic device, sending the token as part of a transmission addressed to the second electronic device on an electronic communication channel.

33. The electronic device of claim 28 , wherein the second electronic device is configured to:

send, to the service, the token; and

receive, from the service, at least one of: the request, and result responsive to the request.

34. The electronic device of claim 28 , wherein the second electronic device is configured to:

receive, from the service, result responsive to the request; and

display at least a part of the received result.

35. The electronic device of claim 28 , wherein the second electronic device is configured to:

receive a second audio input via the microphone, the second audio input comprising a second request;

send data representing the second request to the service; and

receive, from the service, a message corresponding to the second request, but no token corresponding to the second request.

36. The electronic device of claim 35 , wherein the message corresponding to the second request indicates a lack of available information identified by the service responsive to the second request.

37. The electronic device of claim 35 , wherein the second request comprises a request for a task unsupported by the electronic device.

38. The electronic device of claim 28 , wherein activation of the token received from the service further permits: execution, by the second electronic device, of the request based on the context of the first electronic device when the request was received.

39. The electronic device of claim 28 , wherein a continuity affordance is displayed by the second electronic device, the continuity affordance permitting activation of the token.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2015
From: SUMNER, MICHAEL R.; DIBIASE, EVAN S.; PHIPPS, BENJAMIN S.
To: APPLE INC.
Reel/Frame 036785/0389 →
Continuity (2)
Provisional Application 62129928 · Mar 8, 2015
Related Publication 20160259656A1 · Sep 8, 2016
Cited By (3)
US 12,334,073 US 12,493,447 US 12,567,435