IP Library Granted Patent US 12,424,236
Granted Patent B2
US 12,424,236 · App. 19/068,717 · Granted Sep 23, 2025

Voice trigger for a digital assistant

Inventors: Justin Binder (Oakland, CA); Samuel D. Post (San Jose, CA); Onur Tackin (Saratoga, CA); Thomas R. Gruber (Kihei, HI)
Assignee: Apple Inc.
G10L21/16G06F3/167G10L15/22G10L15/26G10L17/24G10L15/02G10L2015/223G10L15/30G10L25/51G10L25/84
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,424,236
App. No.
19/068,717
Granted
Sep 23, 2025
Kind
B2
Abstract

A method for operating a voice trigger is provided. In some implementations, the method is performed at an electronic device including one or more processors and memory storing instructions for execution by the one or more processors. The method includes receiving a sound input. The sound input may correspond to a spoken word or phrase, or a portion thereof. The method includes determining whether at least a portion of the sound input corresponds to a predetermined type of sound, such as a human voice. The method includes, upon a determination that at least a portion of the sound input corresponds to the predetermined type, determining whether the sound input includes predetermined content, such as a predetermined trigger word or phrase. The method also includes, upon a determination that the sound input includes the predetermined content, initiating a speech-based service, such as a voice-based digital assistant.

Claims (102)

1. A method for operating a voice trigger, the method performed at an electronic device including one or more processors and memory storing instructions for execution by the one or more processors, the method comprising:

operating the voice trigger in a first mode;

while operating the voice trigger in the first mode, determining that the electronic device is within physical proximity of a second electronic device, wherein the second electronic device operates a second voice trigger; and

in accordance with a determination that the electronic device is within physical proximity of the second electronic device:

switching the voice trigger to a second mode.

2. The method of claim 1 , wherein the electronic device includes a first microphone, the method further comprising:

while operating the voice trigger in the first mode and while the electronic device is coupled to an external electronic device including a second microphone, monitoring audio input using the first microphone; and

in accordance with a determination that the audio input includes predetermined content:

initiating a speech based service;

causing the second microphone to monitor second audio input; and

ceasing to monitor the audio input using the first microphone.

3. The method of claim 1 , wherein the electronic device includes a first microphone, the method further comprising:

while operating the voice trigger in the first mode:

monitoring first audio input using the first microphone to determine whether the first audio input includes predetermined content; and

while the electronic device is coupled to an external electronic device including a second microphone:

in accordance with a determination that a predetermined condition is satisfied:

causing the second microphone to monitor second audio input to determine whether the second audio input includes the predetermined content; and

ceasing to monitor the first audio input using the first microphone.

4. The method of claim 3 , wherein determining that the predetermined condition is satisfied includes determining that the external electronic device is currently worn by a user.

5. The method of claim 4 , wherein determining that the external electronic device is currently worn by the user includes:

determining a difference between motion of the electronic device and motion of the external electronic device.

6. The method of claim 3 , further comprising:

in accordance with a determination that the second audio input includes the predetermined content:

initiating a speech based service operating on the electronic device.

7. The method of claim 6 , wherein the speech based service includes a digital assistant.

8. The method of claim 3 , wherein the external electronic device includes a headset.

9. The method of claim 3 , wherein the predetermined content includes one or more words.

10. The method of claim 1 , wherein the first mode includes a listening mode.

11. The method of claim 1 , wherein the second mode includes a standby mode.

12. The method of claim 1 , wherein determining that the electronic device is within physical proximity of the second electronic device includes:

determining physical proximity to the second electronic device using RFID communication.

13. The method of claim 1 , wherein determining that the electronic device is within physical proximity of the second electronic device includes:

determining physical proximity to the second electronic device using near field communication.

14. A non-transitory computer-readable storage medium storing one or more programs for execution by one or more processors of an electronic device, the one or more programs including instructions for:

operating a voice trigger in a first mode;

while operating the voice trigger in the first mode, determining that the electronic device is within physical proximity of a second electronic device, wherein the second electronic device operates a second voice trigger; and

in accordance with a determination that the electronic device is within physical proximity of the second electronic device:

switching the voice trigger to a second mode.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the electronic device includes a first microphone, and wherein the one or more programs further include instructions for:

while operating the voice trigger in the first mode and while the electronic device is coupled to an external electronic device including a second microphone, monitoring audio input using the first microphone; and

in accordance with a determination that the audio input includes predetermined content:

initiating a speech based service;

causing the second microphone to monitor second audio input; and

ceasing to monitor the audio input using the first microphone.

16. The non-transitory computer-readable storage medium of claim 14 , wherein the electronic device includes a first microphone, and wherein the one or more programs further include instructions for:

while operating the voice trigger in the first mode:

monitoring first audio input using the first microphone to determine whether the first audio input includes predetermined content; and

while the electronic device is coupled to an external electronic device including a second microphone:

in accordance with a determination that a predetermined condition is satisfied:

causing the second microphone to monitor second audio input to determine whether the second audio input includes the predetermined content; and

ceasing to monitor the first audio input using the first microphone.

17. The non-transitory computer-readable storage medium of claim 16 , wherein determining that the predetermined condition is satisfied includes determining that the external electronic device is currently worn by a user.

18. The non-transitory computer-readable storage medium of claim 17 , wherein determining that the external electronic device is currently worn by the user includes:

determining a difference between motion of the electronic device and motion of the external electronic device.

19. The non-transitory computer-readable storage medium of claim 16 , wherein the one or more programs further include instructions for:

in accordance with a determination that the second audio input includes the predetermined content:

initiating a speech based service operating on the electronic device.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the speech based service includes a digital assistant.

21. The non-transitory computer-readable storage medium of claim 16 , wherein the external electronic device includes a headset.

22. The non-transitory computer-readable storage medium of claim 16 , wherein the predetermined content includes one or more words.

23. The non-transitory computer-readable storage medium of claim 14 , wherein the first mode includes a listening mode.

24. The non-transitory computer-readable storage medium of claim 14 , wherein the second mode includes a standby mode.

25. The non-transitory computer-readable storage medium of claim 14 , wherein determining that the electronic device is within physical proximity of the second electronic device includes:

determining physical proximity to the second electronic device using RFID communication.

26. The non-transitory computer-readable storage medium of claim 14 , wherein determining that the electronic device is within physical proximity of the second electronic device includes:

determining physical proximity to the second electronic device using near field communication.

27. An electronic device, comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

operating a voice trigger in a first mode;

while operating the voice trigger in the first mode, determining that the electronic device is within physical proximity of a second electronic device, wherein the second electronic device operates a second voice trigger; and

in accordance with a determination that the electronic device is within physical proximity of the second electronic device:

switching the voice trigger to a second mode.

28. The electronic device of claim 27 , wherein the electronic device includes a first microphone, and wherein the one or more programs further include instructions for:

while operating the voice trigger in the first mode and while the electronic device is coupled to an external electronic device including a second microphone, monitoring audio input using the first microphone; and

in accordance with a determination that the audio input includes predetermined content:

initiating a speech based service;

causing the second microphone to monitor second audio input; and

ceasing to monitor the audio input using the first microphone.

29. The electronic device of claim 27 , wherein the electronic device includes a first microphone, and wherein the one or more programs further include instructions for:

while operating the voice trigger in the first mode:

monitoring first audio input using the first microphone to determine whether the first audio input includes predetermined content; and

while the electronic device is coupled to an external electronic device including a second microphone:

in accordance with a determination that a predetermined condition is satisfied:

causing the second microphone to monitor second audio input to determine whether the second audio input includes the predetermined content; and

ceasing to monitor the first audio input using the first microphone.

30. The electronic device of claim 29 , wherein determining that the predetermined condition is satisfied includes determining that the external electronic device is currently worn by a user.

31. The electronic device of claim 30 , wherein determining that the external electronic device is currently worn by the user includes:

determining a difference between motion of the electronic device and motion of the external electronic device.

32. The electronic device of claim 29 , wherein the one or more programs further include instructions for:

in accordance with a determination that the second audio input includes the predetermined content:

initiating a speech based service operating on the electronic device.

33. The electronic device of claim 32 , wherein the speech based service includes a digital assistant.

34. The electronic device of claim 29 , wherein the external electronic device includes a headset.

35. The electronic device of claim 29 , wherein the predetermined content includes one or more words.

36. The electronic device of claim 27 , wherein the first mode includes a listening mode.

37. The electronic device of claim 27 , wherein the second mode includes a standby mode.

38. The electronic device of claim 27 , wherein determining that the electronic device is within physical proximity of the second electronic device includes:

determining physical proximity to the second electronic device using RFID communication.

39. The electronic device of claim 27 , wherein determining that the electronic device is within physical proximity of the second electronic device includes:

determining physical proximity to the second electronic device using near field communication.

Continuity (11)
Continuation 18986508 · Dec 18, 2024
Continuation 18637284 · Apr 16, 2024
Continuation 18135649 · Apr 17, 2023
Continuation 17962220 · Oct 7, 2022
Continuation 17713741 · Apr 5, 2022
Continuation 17150513 · Jan 15, 2021
Continuation 16879348 · May 20, 2020
Continuation 16222249 · Dec 17, 2018
Continuation 14175864 · Feb 7, 2014
Provisional Application 61762260 · Feb 7, 2013
Related Publication 20250201264A1 · Jun 19, 2025
References Cited (112)
US 7720512B2 · Tamura et al. · 2010 [cited by applicant]
US 8643703B1 · Karakotsios et al. · 2014 [cited by applicant]
US 8683054B1 · Karakotsios et al. · 2014 [cited by applicant]
US 8687104B2 · Penov et al. · 2014 [cited by applicant]
US 8693726B2 · Karakotsios et al. · 2014 [cited by applicant]
US 8706827B1 · Noble et al. · 2014 [cited by applicant]
US 8861310B1 · Karakotsios et al. · 2014 [cited by applicant]
US 8913004B1 · Bozarth et al. · 2014 [cited by applicant]
US 8922662B1 · Fu et al. · 2014 [cited by applicant]
US 8942434B1 · Karakotsios et al. · 2015 [cited by applicant]
US 8943582B1 · Zhou et al. · 2015 [cited by applicant]
US 9123272B1 · Baldwin et al. · 2015 [cited by applicant]
US 9135333B2 · Cameron et al. · 2015 [cited by applicant]
US 9152185B2 · Karakotsios et al. · 2015 [cited by applicant]
US 9196219B1 · Zhou et al. · 2015 [cited by applicant]
US 9201585B1 · Karakotsios et al. · 2015 [cited by applicant]
US 9207852B1 · Zhou et al. · 2015 [cited by applicant]
US 9223415B1 · Zhou et al. · 2015 [cited by applicant]
US 9232353B2 · Bozarth et al. · 2016 [cited by applicant]
US 9271111B2 · Blanksteen · 2016 [cited by applicant]
US 9274597B1 · Karakotsios et al. · 2016 [cited by applicant]
US 9282222B1 · Karakotsios et al. · 2016 [cited by applicant]
US 9355301B2 · Karakotsios et al. · 2016 [cited by applicant]
US 9400575B1 · Karakotsios et al. · 2016 [cited by applicant]
US 9449427B1 · Baldwin et al. · 2016 [cited by applicant]
US 9563272B2 · Karakotsios et al. · 2017 [cited by applicant]
US 9691000B1 · Karakotsios et al. · 2017 [cited by applicant]
US 9720456B1 · Karakotsios et al. · 2017 [cited by applicant]
US 9740297B2 · Karakotsios et al. · 2017 [cited by applicant]
US 9786281B1 · Adams · 2017 [cited by examiner]
US 9946803B2 · Karakotsios et al. · 2018 [cited by applicant]
US 10001838B2 · Karakotsios et al. · 2018 [cited by applicant]
US 10019984B2 · Kuo et al. · 2018 [cited by applicant]
US 10714117B2 · Binder · 2020 [cited by examiner]
US 10778778B1 · Blanksteen · 2020 [cited by applicant]
US 11240390B2 · Kubota · 2022 [cited by applicant]
US 11995457B2 · Ellis et al. · 2024 [cited by applicant]
US 20080189110A1 · Freeman et al. · 2008 [cited by applicant]
US 20090318198A1 · Carroll · 2009 [cited by applicant]
US 20100123560A1 · Nix · 2010 [cited by examiner]
US 20110295590A1 · Lloyd et al. · 2011 [cited by applicant]
US 20120046068A1 · Katpelly · 2012 [cited by examiner]
US 20130109412A1 · Nguyen et al. · 2013 [cited by applicant]
US 20130325844A1 · Plaisant · 2013 [cited by applicant]
US 20140033071A1 · Gruber et al. · 2014 [cited by applicant]
US 20140035824A1 · Bernstein et al. · 2014 [cited by applicant]
US 20140046922A1 · Crook et al. · 2014 [cited by applicant]
US 20140067403A1 · Burke et al. · 2014 [cited by applicant]
US 20140081633A1 · Badaskar · 2014 [cited by applicant]
US 20140156269A1 · Lee et al. · 2014 [cited by applicant]
US 20140278413A1 · Pitschel et al. · 2014 [cited by applicant]
US 20140365885A1 · Carson et al. · 2014 [cited by applicant]
US 20170048341A1 · Karakotsios et al. · 2017 [cited by applicant]
US 20190050196A1 · Li · 2019 [cited by applicant]
US 20210375279A1 · Lee et al. · 2021 [cited by applicant]
US 20220020142A1 · Anderson et al. · 2022 [cited by applicant]
US 20220092269A1 · Le · 2022 [cited by applicant]
US 20220392135A1 · Cundall et al. · 2022 [cited by applicant]
US 20230036192A1 · Alakoye · 2023 [cited by applicant]
US 20250036267A1 · Burgess et al. · 2025 [cited by applicant]
US 20250037723A1 · Gruber et al. · 2025 [cited by applicant]
US 20250046310A1 · Milden · 2025 [cited by applicant]
US 20250053375A1 · Carson et al. · 2025 [cited by applicant]
US 20250069605A1 · Kim et al. · 2025 [cited by applicant]
US 20250078835A1 · Novitchenko et al. · 2025 [cited by applicant]
US 20250118328A1 · Binder et al. · 2025 [cited by applicant]
AU 2017100557A4 · 2017 [cited by applicant]
CN 105917404A · 2016 [cited by applicant]
EP 2683147A1 · 2014 [cited by applicant]
EP 3179474B1 · 2019 [cited by applicant]
EP 2732436B1 · 2019 [cited by applicant]
EP 2898399B1 · 2019 [cited by applicant]
EP 2864932B1 · 2020 [cited by applicant]
EP 4276819A2 · 2023 [cited by applicant]
JP 4319573B2 · 2009 [cited by applicant]
JP 2010217754A · 2010 [cited by applicant]
WO 2008075082A1 · 2008 [cited by applicant]
WO 2011088053A2 · 2011 [cited by applicant]
WO 2012166277A1 · 2012 [cited by applicant]
WO 2013048880A1 · 2013 [cited by applicant]
WO 2013057153A1 · 2013 [cited by applicant]
WO 2013173504A1 · 2013 [cited by applicant]
WO 2014004544A2 · 2014 [cited by applicant]
WO 2014004584A2 · 2014 [cited by applicant]
WO 2014022306A2 · 2014 [cited by applicant]
WO 2014040022A2 · 2014 [cited by applicant]
WO 2014047047A1 · 2014 [cited by applicant]
WO 2014093339A1 · 2014 [cited by applicant]
WO 2014093911A2 · 2014 [cited by applicant]
WO 2014144395A2 · 2014 [cited by applicant]
WO 2014144949A2 · 2014 [cited by applicant]
WO 2014149473A1 · 2014 [cited by applicant]
WO 2014197635A2 · 2014 [cited by applicant]
WO 2014197730A1 · 2014 [cited by applicant]
WO 2014200728A1 · 2014 [cited by applicant]
WO 2014200731A1 · 2014 [cited by applicant]
WO 2014209264A1 · 2014 [cited by applicant]
WO 2014210392A2 · 2014 [cited by applicant]
WO 2015108758A1 · 2015 [cited by applicant]
WO 2016106494A1 · 2016 [cited by applicant]
Notice of Acceptance received for Australian Patent Application No. 2022224773, mailed on May 18, 2023, 3 pages. [cited by applicant]
Office Action received for Australian Patent Application No. 2022224773, mailed on Apr. 28, 2023, 3 pages. [cited by applicant]
Sarkar, et al., “Analysis and Modeling Pauses for Synthesis of Storytelling Speech Based on Discourse Modes”, Proceedings of the IEEE International Conference on Contemporary Computing (IC3 2015),Aug. 11-13, 2015, 6 pag… [cited by applicant]
Sarkar, et al., “Development of Story Text-to-Speech System Based on Story Genres”, Workshop on Machine Learning in Speech and Language Processing (MLSLP 2016), Sep. 13, 2016, 5 pages. [cited by applicant]
Sarkar, et al., “Modeling Pauses for Synthesis of Storytelling Style Speech Using Unsupervised Word Features”, Second International Symposium on Computer Vision and the Internet (VisionNet'15), Procedia Computer Science… [cited by applicant]
Tripathi, et al., “Sentence Based Discourse Classification for Hindi Story Text-to-Speech (TTS) System”, Processing of the thirteenth International Conference on Natural Language Processing (ICON-2016) Dec. 2016, pp. 46… [cited by applicant]
Verma, et al., “Conversion of Neutral Speech to Storytelling Style Speech”, Proceedings of the eighth IEEE International Conference on Advances in Pattern Recognition (ICAPR 2015)2015, 6 pages. [cited by applicant]
Notice of Acceptance received for Australian Patent Application No. 2024201212, mailed on Mar. 6, 2025, 3 pages. [cited by applicant]
Notice of Allowance received for Japanese Patent Application No. 2025-033999, mailed on Apr. 28, 2025, 4 pages (1 page of English Translation and 3 pages of Official Copy). [cited by applicant]
Office Action received for European Patent Application No. 20198363.2, mailed on Apr. 7, 2025, 4 pages. [cited by applicant]
Decision to Grant received for European Patent Application No. 22172862.9, mailed on May 15, 2025, 2 pages. [cited by applicant]
Result of Consultation received for European Patent Application No. 20198363.2, mailed on Jun. 12, 2025, 3 pages. [cited by applicant]