IP Library Granted Patent US 12,407,771
Granted Patent B2
US 12,407,771 · App. 18/537,386 · Granted Sep 2, 2025

Method and device for audio input routing

Inventors: Kazuhiro Ondo (Buffalo, IL); Michael P. Labowicz (Palatine, IL); Hideki Yoshino (Lake Zurich, IL); Andrew K. Wells (Lindenhurst, IL)
Assignee: GOOGLE LLC
H04M1/6041G06F16/60G10L15/20G10L15/28H04M1/271H04M2250/74
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,407,771
App. No.
18/537,386
Granted
Sep 2, 2025
Kind
B2
Abstract

A method on a mobile device for a wireless network is described. An audio input is monitored for a trigger phrase spoken by a user of the mobile device. A command phrase spoken by the user after the trigger phrase is buffered. The command phrase corresponds to a call command and a call parameter. A set of target contacts associated with the mobile device is selected based on respective voice validation scores and respective contact confidence scores. The respective voice validation scores are based on the call parameter. The respective contact confidence scores are based on a user context associated with the user. A call to a priority contact of the set of target contacts is automatically placed if the voice validation score of the priority contact meets a validation threshold and the contact confidence score of the priority contact meets a confidence threshold.

Claims (52)

1. A method implemented by one or more processors of a device, the method comprising:

monitoring an audio input for an occurrence of a trigger phrase that is spoken by a user of the device while the device is in a low power mode; and

in response to detecting the occurrence of the trigger phrase:

waking the device from the low power mode; and

buffering the audio input while the device wakes up from the low power mode; and

in response to the device waking up from the low power mode, processing the buffered audio input to detect an occurrence of a command phrase that is spoken by the user in a portion of the buffered audio input;

in response to detecting the occurrence of the command phrase that is spoken by the user in the portion of the buffered audio input, determining whether the command phrase spoken by the user of the device is directed to the device or is located in the middle of a conversation, wherein determining whether the command phrase spoken by the user of the device is directed to the device or is located in the middle of a conversation comprises:

determining whether a length of the buffered audio input satisfies a threshold length;

determining, based on the length of the buffered audio input satisfying the threshold length, that the command phrase spoken by the user is located in the middle of the conversation; and

in response to determining the command phrase spoken by the user is located in the middle of the conversation and based on the length of the buffered audio input satisfying the threshold length, invalidating the command phrase.

2. The method of claim 1 , wherein the command phrase corresponds to a call command and a call parameter.

3. The method of claim 2 , wherein invalidating the command phrase comprises:

refraining from acting upon the call command using the call parameter.

4. The method of claim 1 , wherein the command phrase corresponds to a request for information.

5. The method of claim 1 , wherein the threshold length is a predetermined threshold length.

6. A device comprising:

at least one processor; and

memory storing instructions that, when executed, cause the at least one processor of the device to:

monitor an audio input for an occurrence of a trigger phrase that is spoken by a user of the device while the device is in a low power mode; and

in response to detecting the occurrence of the trigger phrase:

wake the device from the low power mode; and

buffer the audio input while the device wakes up from the low power mode; and

in response to the device waking up from the low power mode, process the buffered audio input to detect an occurrence of a command phrase that is spoken by the user in a portion of the buffered audio input;

in response to detecting the occurrence of the command phrase that is spoken by the user in the portion of the buffered audio input, determine whether the command phrase spoken by the user of the device is directed to the device or is located in the middle of a conversation, wherein the instructions to determine whether the command phrase spoken by the user of the device is directed to the device or is located in the middle of a conversation comprise instructions to:

determine whether a length of the buffered audio input satisfies a threshold length;

determine, based on the length of the buffered audio input satisfying the threshold length, that the command phrase spoken by the user is located in the middle of the conversation; and

in response to determining the command phrase spoken by the user is located in the middle of the conversation and based on the length of the buffered audio input satisfying the threshold length, invalidate the command phrase.

7. The device of claim 6 , wherein the command phrase corresponds to a call command and a call parameter.

8. The device of claim 7 , wherein the instructions to invalidate the command phrase comprise instructions to:

refrain from acting upon the call command using the call parameter.

9. The device of claim 6 , wherein the command phrase corresponds to a request for information.

10. The device of claim 6 , wherein the threshold length is a predetermined threshold length.

11. A non-transitory computer-readable storage medium storing instructions that, when executed, cause at least one processor of a device to perform operations, the operations comprising:

monitoring an audio input for an occurrence of a trigger phrase that is spoken by a user of the device while the device is in a low power mode; and

in response to detecting the occurrence of the trigger phrase:

waking the device from the low power mode; and

buffering the audio input while the device wakes up from the low power mode; and

in response to the device waking up from the low power mode, processing the buffered audio input to detect an occurrence of a command phrase that is spoken by the user in a portion of the buffered audio input;

in response to detecting the occurrence of the command phrase that is spoken by the user in the portion of the buffered audio input, determining whether the command phrase spoken by the user of the device is directed to the device or is located in the middle of a conversation, wherein determining whether the command phrase spoken by the user of the device is directed to the device or is located in the middle of a conversation comprises:

determining whether a length of the buffered audio input satisfies a threshold length;

determining, based on the length of the buffered audio input satisfying the threshold length, that the command phrase spoken by the user is located in the middle of the conversation; and

in response to determining the command phrase spoken by the user is located in the middle of the conversation and based on the length of the buffered audio input satisfying the threshold length, invalidating the command phrase.

12. The non-transitory computer-readable storage medium of claim 11 , wherein the command phrase corresponds to a call command and a call parameter.

13. The non-transitory computer-readable storage medium of claim 12 , wherein invalidating the command phrase comprises:

refraining from acting upon the call command using the call parameter.

14. The method of claim 4 , wherein invalidating the command phrase comprises:

refraining from executing the request for information.

15. The device of claim 9 , wherein the instructions to invalidate the command phrase comprise instructions to:

refrain from executing the request for information.

16. The non-transitory computer-readable storage medium of claim 11 , wherein the command phrase corresponds to a request for information.

17. The non-transitory computer-readable storage medium of claim 16 , wherein invalidating the command phrase comprises:

refraining from executing the request for information.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 18, 2024
From: ONDO, KAZUHIRO; LABOWICZ, MICHAEL P.; YOSHINO, HIDEKI; WELLS, ANDREW K.
To: MOTOROLA MOBILITY LLC
Reel/Frame 066171/0091 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 18, 2024
From: MOTOROLA MOBILITY LLC
To: GOOGLE TECHNOLOGY HOLDINGS LLC
Reel/Frame 066352/0001 →
Continuity (6)
Continuation 17833446 · Jun 6, 2022
Continuation 16703003 · Dec 4, 2019
Continuation 14142190 · Dec 27, 2013
Provisional Application 61889938 · Oct 11, 2013
Provisional Application 61857696 · Jul 23, 2013
Related Publication 20240137435A1 · Apr 25, 2024
References Cited (108)
US 5553220A · Keene · 1996 [cited by applicant]
US 5632002A · Hashimoto et al. · 1997 [cited by applicant]
US 5950157A · Heck et al. · 1999 [cited by applicant]
US 5970446A · Goldberg et al. · 1999 [cited by applicant]
US 6032115A · Kanazawa et al. · 2000 [cited by applicant]
US 6070140A · Tran · 2000 [cited by applicant]
US 6449496B1 · Beith et al. · 2002 [cited by applicant]
US 6496743B1 · Kokkosoulis et al. · 2002 [cited by applicant]
US 6532444B1 · Weber · 2003 [cited by applicant]
US 6553345B1 · Kuhn et al. · 2003 [cited by applicant]
US 6574599B1 · Lim et al. · 2003 [cited by applicant]
US 6587867B1 · Miller et al. · 2003 [cited by applicant]
US 6704707B2 · Anderson et al. · 2004 [cited by applicant]
US 6760704B1 · Bennett · 2004 [cited by applicant]
US 6795533B2 · Erb et al. · 2004 [cited by applicant]
US 6985862B2 · Strom et al. · 2006 [cited by applicant]
US 7099825B1 · Cook · 2006 [cited by applicant]
US 7203644B2 · Anderson et al. · 2007 [cited by applicant]
US 7523012B2 · Shah et al. · 2009 [cited by applicant]
US 7526431B2 · Roth et al. · 2009 [cited by applicant]
US 8009678B2 · Brooke · 2011 [cited by applicant]
US 8060373B2 · Gibbon et al. · 2011 [cited by applicant]
US 8374316B2 · Burckart et al. · 2013 [cited by applicant]
US 8386250B2 · Lloyd et al. · 2013 [cited by applicant]
US 8411603B2 · Kong · 2013 [cited by applicant]
US 8433041B2 · Clark et al. · 2013 [cited by applicant]
US 8560316B2 · Vogt · 2013 [cited by examiner]
US 9098467B1 · Blanksteen · 2015 [cited by examiner]
US 9100735B1 · Taenzer · 2015 [cited by applicant]
US 9112989B2 · Lee et al. · 2015 [cited by applicant]
US 11363128B2 · Ondo et al. · 2022 [cited by applicant]
US 20020046022A1 · Rose et al. · 2002 [cited by applicant]
US 20020059068A1 · Rose et al. · 2002 [cited by applicant]
US 20020082834A1 · Eaves et al. · 2002 [cited by applicant]
US 20020087320A1 · Lee et al. · 2002 [cited by applicant]
US 20030187639A1 · Mills · 2003 [cited by applicant]
US 20030190037A1 · Hruska · 2003 [cited by applicant]
US 20040043758A1 · Sorvari et al. · 2004 [cited by applicant]
US 20040268162A1 · Morisawa · 2004 [cited by applicant]
US 20050049860A1 · Junqua et al. · 2005 [cited by applicant]
US 20050154596A1 · Mochary et al. · 2005 [cited by applicant]
US 20050175159A1 · Cooper et al. · 2005 [cited by applicant]
US 20050177376A1 · Cooper et al. · 2005 [cited by applicant]
US 20050180464A1 · McConnell et al. · 2005 [cited by applicant]
US 20050204009A1 · Hazarika et al. · 2005 [cited by applicant]
US 20050246325A1 · Pettinati et al. · 2005 [cited by applicant]
US 20050273323A1 · Inagaki · 2005 [cited by applicant]
US 20060009974A1 · Junqua et al. · 2006 [cited by applicant]
US 20060035632A1 · Sorvari et al. · 2006 [cited by applicant]
US 20060053011A1 · Kim · 2006 [cited by applicant]
US 20060215856A1 · Meyer et al. · 2006 [cited by applicant]
US 20070043563A1 · Comerford · 2007 [cited by applicant]
US 20070054686A1 · Allen et al. · 2007 [cited by applicant]
US 20070060114A1 · Ramer et al. · 2007 [cited by applicant]
US 20070133826A1 · Burk et al. · 2007 [cited by applicant]
US 20070239454A1 · Paek et al. · 2007 [cited by applicant]
US 20070255435A1 · Cohen et al. · 2007 [cited by applicant]
US 20080019537A1 · Nongpiur et al. · 2008 [cited by applicant]
US 20080167868A1 · Kanevsky et al. · 2008 [cited by applicant]
US 20080259961A1 · Wiemann · 2008 [cited by examiner]
US 20080300025A1 · Song et al. · 2008 [cited by applicant]
US 20090007159A1 · Rangarajan et al. · 2009 [cited by applicant]
US 20090037413A1 · Castell et al. · 2009 [cited by applicant]
US 20090081953A1 · Tian et al. · 2009 [cited by applicant]
US 20090228513A1 · Tian · 2009 [cited by applicant]
US 20090287489A1 · Savant · 2009 [cited by applicant]
US 20100049516A1 · Talwar et al. · 2010 [cited by applicant]
US 20100057228A1 · Kong et al. · 2010 [cited by applicant]
US 20100161340A1 · Walsh et al. · 2010 [cited by applicant]
US 20100169092A1 · Backes et al. · 2010 [cited by applicant]
US 20100189305A1 · Capless · 2010 [cited by examiner]
US 20110184730A1 · LeBeau et al. · 2011 [cited by applicant]
US 20110237217A1 · Monks et al. · 2011 [cited by applicant]
US 20110250932A1 · Cohen et al. · 2011 [cited by applicant]
US 20110288868A1 · Lloyd et al. · 2011 [cited by applicant]
US 20120022874A1 · Lloyd et al. · 2012 [cited by applicant]
US 20120072221A1 · White et al. · 2012 [cited by applicant]
US 20120148067A1 · Petersen et al. · 2012 [cited by applicant]
US 20120166186A1 · Acero et al. · 2012 [cited by applicant]
US 20130110521A1 · Hwang et al. · 2013 [cited by applicant]
US 20130132072A1 · Pradhan et al. · 2013 [cited by applicant]
US 20130144618A1 · Sun et al. · 2013 [cited by applicant]
US 20130325484A1 · Chakladar · 2013 [cited by examiner]
US 20130339028A1 · Rosner et al. · 2013 [cited by applicant]
US 20140122378A1 · Swaminathan et al. · 2014 [cited by applicant]
US 20140156269A1 · Lee et al. · 2014 [cited by applicant]
US 20140163978A1 · Basye et al. · 2014 [cited by applicant]
US 20140179264A1 · Mathison · 2014 [cited by examiner]
US 20140214429A1 · Pantel · 2014 [cited by applicant]
US 20140244269A1 · Tokutake · 2014 [cited by applicant]
US 20140257813A1 · Mortensen · 2014 [cited by applicant]
US 20140257821A1 · Adams et al. · 2014 [cited by applicant]
US 20140270260A1 · Goertz et al. · 2014 [cited by applicant]
US 20140281628A1 · Nigam et al. · 2014 [cited by applicant]
US 20140331092A1 · Taylor et al. · 2014 [cited by applicant]
US 20140337036A1 · Haiut et al. · 2014 [cited by applicant]
US 20140358552A1 · Xu · 2014 [cited by examiner]
US 20140372122A1 · Harsham et al. · 2014 [cited by applicant]
US 20150031416A1 · Labowicz et al. · 2015 [cited by applicant]
US 20150074524A1 · Nicholson et al. · 2015 [cited by applicant]
US 20150221307A1 · Shah et al. · 2015 [cited by applicant]
US 20150340042A1 · Sejnoha et al. · 2015 [cited by applicant]
US 20220303377A1 · Ondo et al. · 2022 [cited by applicant]
EP 1895748 · 2008 [cited by applicant]
“AES Standards for Acoustics—Digital Interface for Microphones”. Audio Engineering Society, Inc. Jul. 22, 2008. [cited by applicant]
International Search Report and Written Opinion mailed Jan. 20, 2015 in related International Application No. PCT/US2014/047448. 22 Pages Jan. 20, 2015. [cited by applicant]
AES3—Retrieved from: http://web.archive.org/web/20120816133639/https://en.wikipedia.org/wiki/AES3 Mar. 9, 2017. 6 Pages. Mar. 9, 2017. [cited by applicant]
Use Speech on my phone _ Windows Phone How-to (United States), http://www.windowsphone.com/en-us/how-to/wp8/basics/use-speech-on-my-phone; dated Aug. 13, 2018. [cited by applicant]