IP Library › Granted Patent US 10,311,871
Granted Patent B2
US 10,311,871 · App. 15/620,571 · Granted Jun 4, 2019

Competing devices responding to voice triggers

Inventors: Brandon J. Newendorp (San Francisco, CA); Evan S. Dibiase (Pittsburgh, PA)
Assignee: Apple Inc.
G10L15/22G06F3/167G10L15/32G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,311,871
App. No.
15/620,571
Filed
Jun 12, 2017
Granted
Jun 4, 2019
Kind
B2
Art Unit
2658
USPC
704/270.1
Abstract

At a first electronic device with a display and a microphone: sampling audio input using the first microphone; in accordance with the sampling of audio input using the first microphone, sending stop instructions to a second electronic device with a second microphone, the second electronic device external to the first electronic device, wherein the second electronic device is configured to respond to audio input received using the second microphone, and wherein the stop instructions instruct the second electronic device to forgo responding to audio input received using the second microphone, wherein responding to audio input received using the second microphone comprises providing perceptible output.

Claims (181)

1. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a first electronic device with a first microphone, cause the first electronic device to:

determine whether a condition associated with activation of the first electronic device is met;

responsive to determining that the condition associated with activation of the first electronic device is met:

sample an audio input using the first microphone, wherein the audio input is sampled before initiating a virtual assistant session on a second electronic device with a second microphone; and

in accordance with sampling the audio input using the first microphone, send stop instructions to the second electronic device, the second electronic device external to the first electronic device,

wherein the second electronic device is configured to respond to the audio input received using the second microphone, and

wherein the stop instructions instruct the second electronic device to forgo responding to the audio input received using the second microphone.

2. The non-transitory computer readable storage medium of claim 1 , wherein the condition associated with activation of the first electronic device comprises a receipt of a verbal input at the first electronic device.

3. The non-transitory computer readable storage medium of claim 1 , wherein the condition associated with activation of the first electronic device comprises activation of an input device of the first electronic device.

4. The non-transitory computer readable storage medium of claim 3 , wherein the input device of the first electronic device is a mechanical button, a touch-sensitive button, a rotatable input device, or a touch-sensitive surface of the first electronic device.

5. The non-transitory computer readable storage medium of claim 1 , wherein the non-transitory computer readable storage medium further comprises instructions, which when executed by the first electronic device, cause the first electronic device to:

determine whether the sampled audio input comprises a spoken trigger; and

initiate a virtual assistant session in accordance with a determination that the sampled audio input comprises the spoken trigger.

6. The non-transitory computer readable storage medium of claim 5 , wherein the spoken trigger comprises a predetermined phrase.

7. The non-transitory computer readable storage medium of claim 1 , wherein the non-transitory computer-readable storage medium further comprises instructions, which when executed by the first electronic device, cause the first electronic device to:

cease sampling of a second audio input; and

in accordance with the ceasing of the sampling of the second audio input, send resume instructions to the second electronic device, wherein the resume instructions instruct the second electronic device to resume responding to the second audio input received using the second microphone.

8. The non-transitory computer readable storage medium of claim 7 , wherein the non-transitory computer-readable storage medium further comprises instructions, which when executed by the first electronic device, cause the first electronic device to:

at the first electronic device, send the stop instructions or the resume instructions to the second electronic device using a stateless transmission mechanism.

9. The non-transitory computer readable storage medium of claim 7 , wherein the non-transitory computer-readable storage medium further comprises instructions, which when executed by the first electronic device, cause the first electronic device to:

maintain a counter based on device usage conditions,

wherein the sending of the stop instructions to the second electronic device comprises:

in accordance with a determination that the counter exceeds a threshold value, send the stop instructions, and

in accordance with a determination that the counter does not exceed the threshold value, forgo the sending of the stop instructions.

10. The non-transitory computer readable storage medium of claim 9 , wherein the sending of the resume instructions to the second electronic device comprises:

in accordance with a determination that the counter does not exceed the threshold value, sending the resume instructions, and

in accordance with a determination that the counter exceeds the threshold value, forgoing the sending of the resume instructions.

11. The non-transitory computer readable storage medium of claim 1 , wherein the second electronic device is configured to respond to the audio input received using the second microphone by:

sampling the audio input using the second microphone, and

initiating the virtual assistant session in accordance with a determination that the sampled audio input using the second microphone comprises a spoken trigger; and

wherein the stop instructions instruct the second electronic device to forgo responding to the audio input received using the second microphone by forgoing the initiating of the virtual assistant session even if the sampled audio input using the second microphone comprises the spoken trigger.

12. The non-transitory computer readable storage medium of claim 11 , wherein sampling the audio input using the second microphone comprises sampling the audio input using the second microphone when a predetermined at least one processor of the second electronic device is powered on.

13. The non-transitory computer readable storage medium of claim 11 , wherein sampling the audio input using the second microphone comprises:

determining whether the second electronic device is charging; and

in accordance with a determination that the second electronic device is charging, sampling the audio input using the first microphone.

14. The non-transitory computer readable storage medium of claim 1 , wherein the stop instructions comprise an indication of a time duration for which the second electronic device is to forgo responding to the audio input received using the second microphone.

15. The non-transitory computer readable storage medium of claim 1 , wherein the second electronic device is configured to:

after forgoing responding to the audio input received using the second microphone in accordance with receiving the stop instructions from the first electronic device:

resume responding to the audio input received using the second microphone.

16. The non-transitory computer readable storage medium of claim 1 , wherein the second electronic device is further configured to:

in accordance with receiving the stop instructions while the second electronic device is responding to the audio input from the second microphone, cease responding to the audio input from the second microphone.

17. The non-transitory computer readable storage medium of claim 1 , wherein the second electronic device is further configured to:

in accordance with receiving the stop instructions while the second electronic device is responding to the audio input received using the second microphone, provide an output indicating that the second electronic device is ceasing its response to the audio input from the second microphone.

18. The non-transitory computer readable storage medium of claim 1 , wherein sampling the audio input using the first microphone comprises:

determining whether a predetermined service is actively executing on the first electronic device; and

in accordance with a determination that the predetermined service is actively executing, sampling the audio input using the first microphone.

19. The non-transitory computer readable storage medium of claim 1 , wherein sampling the audio input using the first microphone comprises:

determining whether a predetermined service has been dismissed for longer than a predetermined duration of time; and

in accordance with a determination that the predetermined service has been dismissed for no longer than the predetermined duration of time, sampling the audio input using the first microphone.

20. The non-transitory computer readable storage medium of claim 1 , wherein the non-transitory computer-readable storage medium further comprises instructions, which when executed by the first electronic device, cause the first electronic device to:

determine whether the sampled audio input comprises a spoken trigger;

in accordance with a determination that the sampled audio input comprises the spoken trigger, trigger a predetermined service; and

in accordance with a determination that the sampled audio input does not comprise the spoken trigger, forgo triggering of the predetermined service.

21. The non-transitory computer readable storage medium of claim 1 , wherein the non-transitory computer-readable storage medium further comprises instructions, which when executed by the first electronic device, cause the first electronic device to:

in accordance with sending the stop instructions to the second electronic device, send the stop instructions as part of a transmission addressed to the second electronic device on an electronic communication channel.

22. The non-transitory computer readable storage medium of claim 1 , wherein the non-transitory computer-readable storage medium further comprises instructions, which when executed by the first electronic device, cause the first electronic device to:

in accordance with sending the stop instructions to the second electronic device, broadcast the stop instructions on an electronic communication channel.

23. A method, comprising:

at a first electronic device with a first microphone:

determining whether a condition associated with activation of the first electronic device is met;

responsive to determining that the condition associated with activation of the first electronic device is met:

sampling an audio input using the first microphone, wherein the audio input is sampled before initiating a virtual assistant session on a second electronic device with a second microphone; and

in accordance with the sampling of the audio input using the first microphone, sending stop instructions to the second electronic device, the second electronic device external to the first electronic device,

wherein the second electronic device is configured to respond to the audio input received using the second microphone, and

wherein the stop instructions instruct the second electronic device to forgo responding to the audio input received using the second microphone.

24. The method of claim 23 , wherein the condition associated with activation of the first electronic device comprises a receipt of a verbal input at the first electronic device.

25. The method of claim 23 , wherein the condition associated with activation of the first electronic device comprises activation of an input device of the first electronic device.

26. The method of claim 25 , wherein the input device of the first electronic device is a mechanical button, a touch-sensitive button, a rotatable input device, or a touch-sensitive surface of the first electronic device.

27. The method of claim 23 , further comprising:

at the first electronic device:

determining whether the sampled audio input comprises a spoken trigger; and

initiating a virtual assistant session in accordance with a determination that the sampled audio input comprises the spoken trigger.

28. The method of claim 27 , wherein the spoken trigger comprises a predetermined phrase.

29. The method of claim 23 , further comprising:

at the first electronic device:

ceasing sampling of a second audio input; and

in accordance with the ceasing of the sampling of the second audio input, sending resume instructions to the second electronic device, wherein the resume instructions instruct the second electronic device to resume responding to the second audio input received using the second microphone.

30. The method of claim 29 , further comprising:

at the first electronic device, sending the stop instructions or the resume instructions to the second electronic device using a stateless transmission mechanism.

31. The method of claim 29 , further comprising, at the first electronic device:

maintaining a counter based on device usage conditions,

wherein the sending of the stop instructions to the second electronic device comprises:

in accordance with a determination that the counter exceeds a threshold value, sending the stop instructions, and

in accordance with a determination that the counter does not exceed the threshold value, forgoing the sending of the stop instructions.

32. The method of claim 31 , wherein the sending of the resume instructions to the second electronic device comprises:

in accordance with a determination that the counter does not exceed the threshold value, sending the resume instructions, and

in accordance with a determination that the counter exceeds the threshold value, forgoing the sending of the resume instructions.

33. The method of claim 23 , wherein the second electronic device is configured to respond to the audio input received using the second microphone by:

sampling the audio input using the second microphone, and

initiating the virtual assistant session in accordance with a determination that the sampled audio input using the second microphone comprises a spoken trigger; and

wherein the stop instructions instruct the second electronic device to forgo responding to the audio input received using the second microphone by forgoing the initiating of the virtual assistant session even if the sampled audio input using the second microphone comprises the spoken trigger.

34. The method of claim 33 , wherein sampling the audio input using the second microphone comprises sampling the audio input using the second microphone when a predetermined at least one processor of the second electronic device is powered on.

35. The method of claim 33 , wherein sampling the audio input using the second microphone comprises:

determining whether the second electronic device is charging; and

in accordance with a determination that the second electronic device is charging, sampling the audio input using the first microphone.

36. The method of claim 23 , wherein the stop instructions comprise an indication of a time duration for which the second electronic device is to forgo responding to the audio input received using the second microphone.

37. The method of claim 23 , wherein the second electronic device is configured to:

after forgoing responding to the audio input received using the second microphone in accordance with receiving the stop instructions from the first electronic device:

resume responding to the audio input received using the second microphone.

38. The method of claim 23 , wherein the second electronic device is further configured to:

in accordance with receiving the stop instructions while the second electronic device is responding to the audio input from the second microphone, cease responding to the audio input from the second microphone.

39. The method of claim 23 , wherein the second electronic device is further configured to:

in accordance with receiving the stop instructions while the second electronic device is responding to the audio input received using the second microphone, provide an output indicating that the second electronic device is ceasing its response to the audio input from the second microphone.

40. The method of claim 23 , wherein sampling the audio input using the first microphone comprises:

determining whether a predetermined service is actively executing on the first electronic device; and

in accordance with a determination that the predetermined service is actively executing, sampling the audio input using the first microphone.

41. The method of claim 23 , wherein sampling the audio input using the first microphone comprises:

determining whether a predetermined service has been dismissed for longer than a predetermined duration of time; and

in accordance with a determination that the predetermined service has been dismissed for no longer than the predetermined duration of time, sampling the audio input using the first microphone.

42. The method of claim 23 , further comprising:

at the first electronic device:

determining whether the sampled audio input comprises a spoken trigger;

in accordance with a determination that the sampled audio input comprises the spoken trigger, triggering a predetermined service; and

in accordance with a determination that the sampled audio input does not comprise the spoken trigger, forgoing triggering of the predetermined service.

43. The method of claim 23 , further comprising:

at the first electronic device:

in accordance with sending the stop instructions to the second electronic device, sending the stop instructions as part of a transmission addressed to the second electronic device on an electronic communication channel.

44. The method of claim 23 , further comprising:

at the first electronic device:

in accordance with sending the stop instructions to the second electronic device, broadcasting the stop instructions on an electronic communication channel.

45. A first electronic device comprising:

one or more processors;

a memory;

a first microphone; and

one or more programs, wherein the one or more programs are stored in memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

determining whether a condition associated with activation of the first electronic device is met;

responsive to determining that the condition associated with activation of the first electronic device is met:

sampling an audio input using the first microphone, wherein the audio input is sampled before initiating a virtual assistant session on a second electronic device with a second microphone; and

in accordance with the sampling of the audio input using the first microphone, sending stop instructions to the second electronic device, the second electronic device external to the first electronic device,

wherein the second electronic device is configured to respond to the audio input received using the second microphone, and

wherein the stop instructions instruct the second electronic device to forgo responding to the audio input received using the second microphone.

46. The first electronic device of claim 45 , wherein the condition associated with activation of the first electronic device comprises a receipt of a verbal input at the first electronic device.

47. The first electronic device of claim 45 , wherein the condition associated with activation of the first electronic device comprises activation of an input device of the first electronic device.

48. The first electronic device of claim 47 , wherein the input device of the first electronic device is a mechanical button, a touch-sensitive button, a rotatable input device, or a touch-sensitive surface of the first electronic device.

49. The first electronic device of claim 45 , the one or more programs further including instructions for:

determining whether the sampled audio input comprises a spoken trigger; and

initiating a virtual assistant session in accordance with a determination that the sampled audio input comprises the spoken trigger.

50. The first electronic device of claim 49 , wherein the spoken trigger comprises a predetermined phrase.

51. The first electronic device of claim 45 , the one or more programs further including instructions for:

ceasing sampling of a second audio input at the first electronic device; and

in accordance with the ceasing of the sampling of the second audio input, sending resume instructions to the second electronic device, wherein the resume instructions instruct the second electronic device to resume responding to the second audio input received using the second microphone.

52. The first electronic device of claim 51 , the one or more programs further including instructions for:

sending the stop instructions or the resume instructions to the second electronic device using a stateless transmission mechanism.

53. The first electronic device of claim 51 , the one or more programs further including instructions for:

maintaining a counter based on device usage conditions,

wherein the sending of the stop instructions to the second electronic device comprises:

in accordance with a determination that the counter exceeds a threshold value, sending the stop instructions, and

in accordance with a determination that the counter does not exceed the threshold value, forgoing the sending of the stop instructions.

54. The first electronic device of claim 53 , wherein the sending of the resume instructions to the second electronic device comprises:

in accordance with a determination that the counter does not exceed the threshold value, sending the resume instructions, and

in accordance with a determination that the counter exceeds the threshold value, forgoing the sending of the resume instructions.

55. The first electronic device of claim 45 , wherein the second electronic device is configured to respond to the audio input received using the second microphone by:

sampling the audio input using the second microphone, and

initiating a virtual assistant session in accordance with a determination that the sampled audio input using the second microphone comprises a spoken trigger; and

wherein the stop instructions instruct the second electronic device to forgo responding to the audio input received using the second microphone by forgoing the initiating of the virtual assistant session even if the sampled audio input using the second microphone comprises the spoken trigger.

56. The first electronic device of claim 55 , wherein sampling the audio input using the second microphone comprises sampling the audio input using the second microphone when a predetermined at least one processor of the second electronic device is powered on.

57. The first electronic device of claim 55 , wherein sampling the audio input using the second microphone comprises:

determining whether the second electronic device is charging; and

in accordance with a determination that the second electronic device is charging, sampling the audio input using the first microphone.

58. The first electronic device of claim 45 , wherein the stop instructions comprise an indication of a time duration for which the second electronic device is to forgo responding to the audio input received using the second microphone.

59. The first electronic device of claim 45 , wherein the second electronic device is configured to:

after forgoing responding to the audio input received using the second microphone in accordance with receiving the stop instructions from the first electronic device:

resume responding to the audio input received using the second microphone.

60. The first electronic device of claim 45 , wherein the second electronic device is further configured to:

in accordance with receiving the stop instructions while the second electronic device is responding to the audio input from the second microphone, cease responding to the audio input from the second microphone.

61. The first electronic device of claim 45 , wherein the second electronic device is further configured to:

in accordance with receiving the stop instructions while the second electronic device is responding to the audio input received using the second microphone, provide an output indicating that the second electronic device is ceasing its response to the audio input from the second microphone.

62. The first electronic device of claim 45 , wherein sampling the audio input using the first microphone comprises:

determining whether a predetermined service is actively executing on the first electronic device; and

in accordance with a determination that the predetermined service is actively executing, sampling the audio input using the first microphone.

63. The first electronic device of claim 45 , wherein sampling the audio input using the first microphone comprises:

determining whether a predetermined service has been dismissed for longer than a predetermined duration of time; and

in accordance with a determination that the predetermined service has been dismissed for no longer than the predetermined duration of time, sampling the audio input using the first microphone.

64. The first electronic device of claim 45 , the one or more programs further including instructions for:

determining whether the sampled audio input comprises a spoken trigger;

in accordance with a determination that the sampled audio input comprises the spoken trigger, triggering a predetermined service; and

in accordance with a determination that the sampled audio input does not comprise the spoken trigger, forgoing triggering of the predetermined service.

65. The first electronic device of claim 45 , the one or more programs further including instructions for:

in accordance with sending the stop instructions to the second electronic device, sending the stop instructions as part of a transmission addressed to the second electronic device on an electronic communication channel.

66. The first electronic device of claim 45 , the one or more programs further including instructions for:

in accordance with sending the stop instructions to the second electronic device, broadcasting the stop instructions on an electronic communication channel.

Continuity (3)
Continuation 14841379 · Aug 31, 2015
Provisional Application 62129922 · Mar 8, 2015
Related Publication 20180033431A1 · Feb 1, 2018
Cited By (40)
US 12,190,873 US 12,197,712 US 12,197,817 US 12,200,297 US 12,204,932 US 12,211,500 US 12,211,502 US 12,216,894 US 12,219,314 US 12,223,282 US 12,236,952 US 12,254,887 US 12,260,234 US 12,266,380 US 12,277,954 US 12,293,203 US 12,293,763 US 12,301,635 US 12,333,404 US 12,361,943 US 12,367,879 US 12,379,894 US 12,380,281 US 12,380,876 US 12,386,434 US 12,386,491 US 12,431,128 US 12,477,470 US 12,556,890 US 12,567,415 US 12,585,966 US 12,608,171 US 12,613,621 US 12,613,730 US 12,619,452 US 12,620,179 US 12,640,151 US 12,670,639 US 12,675,839 US 12,748,568