IP Library Granted Patent US 12,387,726
Granted Patent B2
US 12,387,726 · App. 18/348,152 · Granted Aug 12, 2025

Voice commands across devices

Inventors: Jennifer Shien-Ming Chen (San Francisco, CA); Alexander Friedrich Kuscher (San Francisco, CA); Mitsuru Oshima (San Jose, CA)
Assignee: Google LLC
G10L15/22G06F3/167G10L15/30G10L15/32G10L25/78H04L12/4625G06F9/451G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,387,726
App. No.
18/348,152
Granted
Aug 12, 2025
Kind
B2
Abstract

Aspects of the subject technology relate to a method for using a voice command for multiple computing devices. First voice input data is received from a first computing device associated with a user account, where the first voice input data comprises a first voice command captured at the first computing device. Second voice input data is received from a second computing device associated with the user account where the second voice input data comprises a second voice command captured at the second computing device. An intended voice command is determined based on the obtained first and second voice input data. Based on the intended voice command, a first target computing device is determined. First instructions associated with the intended voice command are provided to the first target computing device for execution.

Claims (38)

1. A computer-implemented method executed on data processing hardware that causes the data processing hardware to perform operations comprising:

receiving voice input data corresponding to a voice command spoken by a user, the voice command including a first device identifier associated with a first computing device and a second device identifier associated with a second computing device, each of the first computing device and the second computing device including a respective microphone capable of capturing user voice commands;

identifying, using the first device identifier associated with the first computing device and the second device identifier associated with the second computing device included in the voice command:

the first computing device as a first target computing device for providing first instructions associated with the voice command; and

the second computing device as a second target computing device for providing second instructions associated with the voice command;

transmitting:

to the first computing device, the first instructions associated with the voice command for execution by the first computing device to perform a first action; and

to the second computing device, the second instructions associated with the voice command for execution by the second computing device to perform a second action, the second action performed by the second computing device executing the second instructions different than the first action performed by the first computing device executing the first instructions; and

after transmitting the second instructions, receiving subsequent voice input data corresponding to feedback spoken by the user, the feedback associated with the second instructions.

2. The computer-implemented method of claim 1 , wherein the data processing hardware, the first computing device, and the second computing device are in communication with one another via a network.

3. The computer-implemented method of claim 1 , wherein the first computing device and the second computing device are located in a household of a user.

4. The computer-implemented method of claim 1 , wherein the operations further comprise performing speech recognition on the voice input data to determine the voice command.

5. The computer-implemented method of claim 1 , wherein the first computing device captured the voice command spoken by the user via the respective microphone of the first computing device.

6. The computer-implemented method of claim 1 , wherein the second computing device captured the voice command spoken by the user via the respective microphone of the second computing device.

7. The computer-implemented method of claim 1 , wherein the first computing device comprises a media player.

8. The computer-implemented method of claim 1 , wherein the second computing device comprises a media player.

9. The computer-implemented method of claim 1 , wherein the operations further comprise comparing the voice input data with a voice profile for the user to determine the voice input data is associated with a user account for the user.

10. The computer-implemented method of claim 9 , wherein transmitting the first instructions to the first computing device and the second instructions to the second computing device is based on determining that the voice input data is associated with the user account for the user.

11. A system comprising:

data processing hardware; and

memory hardware in communication with the data processing hardware and storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:

receiving voice input data corresponding to a voice command spoken by a user, the voice command including a first device identifier associated with a first computing device and a second device identifier associated with a second computing device, each of the first computing device and the second computing device including a respective microphone capable of capturing user voice commands;

identifying, using the first device identifier associated with the first computing device and the second device identifier associated with the second computing device included in the voice command:

the first computing device as a first target computing device for providing first instructions associated with the voice command; and

the second computing device as a second target computing device for providing second instructions associated with the voice command;

transmitting:

to the first computing device, the first instructions associated with the voice command for execution by the first computing device to perform a first action; and

to the second computing device, the second instructions associated with the voice command for execution by the second computing device to perform a second action, the second action performed by the second computing device executing the second instructions different than the first action performed by the first computing device executing the first instructions; and

after transmitting the second instructions, receiving subsequent voice input data corresponding to feedback spoken by the user, the feedback associated with the second instructions.

12. The system of claim 11 , wherein the data processing hardware, the first computing device, and the second computing device are in communication with one another via a network.

13. The system of claim 11 , wherein the first computing device and the second computing device are located in a household of a user.

14. The system of claim 11 , wherein the operations further comprise performing speech recognition on the voice input data to determine the voice command.

15. The system of claim 11 , wherein the first computing device captured the voice command spoken by the user via the respective microphone of the first computing device.

16. The system of claim 11 , wherein the second computing device captured the voice command spoken by the user via the respective microphone of the second computing device.

17. The system of claim 11 , wherein the first computing device comprises a media player.

18. The system of claim 11 , wherein the second computing device comprises a media player.

19. The system of claim 11 , wherein the operations further comprise comparing the voice input data with a voice profile for the user to determine the voice input data is associated with a user account for the user.

20. The system of claim 19 , wherein transmitting the first instructions to the first computing device and the second instructions to the second computing device is based on determining that the voice input data is associated with the user account for the user.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 6, 2023
From: CHEN, JENNIFER SHIEN-MING; KUSCHER, ALEXANDER FRIEDRICH; OSHIMA, MITSURU
To: GOOGLE INC.
Reel/Frame 064173/0797 →
CHANGE OF NAME Recorded Jul 6, 2023
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 064224/0552 →
Continuity (4)
Continuation 16896061 · Jun 8, 2020
Continuation 15595802 · May 15, 2017
Division 14935350 · Nov 6, 2015
Related Publication 20230352025A1 · Nov 2, 2023
References Cited (115)
US 6182094B1 · Humpleman · 2001 [cited by examiner]
US 6697782B1 · Iso-Sipila et al. · 2004 [cited by applicant]
US 6839670B1 · Stammler · 2005 [cited by examiner]
US 7464035B2 · Funk et al. · 2008 [cited by applicant]
US 7561677B2 · Flynt · 2009 [cited by examiner]
US 7668990B2 · Krzyzanowski · 2010 [cited by examiner]
US 8214759B2 · Elliott · 2012 [cited by examiner]
US 8271287B1 · Kermani · 2012 [cited by examiner]
US 8284950B2 · Riggs · 2012 [cited by applicant]
US 8340975B1 · Rosenberger · 2012 [cited by applicant]
US 8566091B2 · Low et al. · 2013 [cited by applicant]
US 8584221B2 · Mazur · 2013 [cited by examiner]
US 8918411B1 · Latif · 2014 [cited by examiner]
US 8942412B2 · Basso · 2015 [cited by examiner]
US 9118763B1 · Margulies · 2015 [cited by examiner]
US 9172699B1 · Vazquez · 2015 [cited by examiner]
US 9293134B1 · Saleem et al. · 2016 [cited by applicant]
US 9318107B1 · Sharifi · 2016 [cited by applicant]
US 9595171B2 · Hurtig · 2017 [cited by examiner]
US 9686094B2 · Kim · 2017 [cited by examiner]
US 9984686B1 · Mutagi · 2018 [cited by examiner]
US 10181323B2 · Beckhardt et al. · 2019 [cited by applicant]
US 10257577B2 · Arling et al. · 2019 [cited by applicant]
US 10379808B1 · Angel · 2019 [cited by examiner]
US 10460597B2 · Shin · 2019 [cited by examiner]
US 10601604B2 · Kozura et al. · 2020 [cited by applicant]
US 10674198B2 · James · 2020 [cited by examiner]
US 11422772B1 · Mutagi · 2022 [cited by examiner]
US 11741979B1 · Scalise · 2023 [cited by examiner]
US 11893603B1 · Hart · 2024 [cited by examiner]
US 20030001820A1 · Hou · 2003 [cited by examiner]
US 20030109270A1 · Shorty · 2003 [cited by examiner]
US 20040003073A1 · Krzyzanowski · 2004 [cited by examiner]
US 20040150546A1 · Choi · 2004 [cited by examiner]
US 20050159823A1 · Hayes · 2005 [cited by examiner]
US 20060009980A1 · Burke et al. · 2006 [cited by applicant]
US 20060074658A1 · Chadha · 2006 [cited by applicant]
US 20060271993A1 · Nakata · 2006 [cited by examiner]
US 20070185597A1 · Bejean · 2007 [cited by examiner]
US 20080033724A1 · Block · 2008 [cited by examiner]
US 20090217153A1 · Oshima · 2009 [cited by examiner]
US 20090271203A1 · Resch et al. · 2009 [cited by applicant]
US 20100138224A1 · Bedingfield, Sr. · 2010 [cited by examiner]
US 20100269043A1 · Elliott · 2010 [cited by examiner]
US 20100312547A1 · Van Os et al. · 2010 [cited by applicant]
US 20110157479A1 · Higuchi · 2011 [cited by examiner]
US 20110257973A1 · Chutorash · 2011 [cited by examiner]
US 20120117590A1 · Agnihotri et al. · 2012 [cited by applicant]
US 20120310386A1 · To · 2012 [cited by examiner]
US 20130042026A1 · Shinomiya · 2013 [cited by examiner]
US 20130073293A1 · Jang · 2013 [cited by examiner]
US 20130090169A1 · Liu et al. · 2013 [cited by applicant]
US 20130238326A1 · Kim · 2013 [cited by examiner]
US 20130290911A1 · Praphul · 2013 [cited by examiner]
US 20130321340A1 · Seo · 2013 [cited by examiner]
US 20140012587A1 · Park · 2014 [cited by applicant]
US 20140059287A1 · Bains · 2014 [cited by examiner]
US 20140095780A1 · Bains · 2014 [cited by examiner]
US 20140136208A1 · Maltseff · 2014 [cited by examiner]
US 20140257807A1 · Mauro et al. · 2014 [cited by applicant]
US 20140330569A1 · Kolavennu · 2014 [cited by examiner]
US 20140337032A1 · Aleksic et al. · 2014 [cited by applicant]
US 20150019199A1 · Andrews · 2015 [cited by examiner]
US 20150019219A1 · Tzirkel-Hancock et al. · 2015 [cited by applicant]
US 20150026580A1 · Kang et al. · 2015 [cited by applicant]
US 20150039319A1 · Mei et al. · 2015 [cited by applicant]
US 20150040012A1 · Faaborg et al. · 2015 [cited by applicant]
US 20150073808A1 · Basir · 2015 [cited by examiner]
US 20150082175A1 · Onohara et al. · 2015 [cited by applicant]
US 20150087278A1 · Kim · 2015 [cited by examiner]
US 20150088518A1 · Kim · 2015 [cited by examiner]
US 20150092608A1 · Gossain · 2015 [cited by examiner]
US 20150154850A1 · Fadell · 2015 [cited by examiner]
US 20150154976A1 · Mutagi · 2015 [cited by examiner]
US 20150162006A1 · Kummer · 2015 [cited by applicant]
US 20150170652A1 · Kaplan et al. · 2015 [cited by applicant]
US 20150228274A1 · Leppanen et al. · 2015 [cited by applicant]
US 20150262102A1 · Tann · 2015 [cited by examiner]
US 20150287413A1 · Jung et al. · 2015 [cited by applicant]
US 20150302857A1 · Yamada · 2015 [cited by applicant]
US 20150348551A1 · Gruber · 2015 [cited by examiner]
US 20150348554A1 · Orr · 2015 [cited by examiner]
US 20160005404A1 · Yokoya · 2016 [cited by examiner]
US 20160011853A1 · Rogers et al. · 2016 [cited by applicant]
US 20160021485A1 · Sallas · 2016 [cited by examiner]
US 20160037251A1 · Daniels · 2016 [cited by examiner]
US 20160072853A1 · Bellet · 2016 [cited by examiner]
US 20160078870A1 · Helm · 2016 [cited by examiner]
US 20160110159A1 · Ono et al. · 2016 [cited by applicant]
US 20160155443A1 · Khan · 2016 [cited by examiner]
US 20160162259A1 · Zhao et al. · 2016 [cited by applicant]
US 20160321266A1 · Philippov et al. · 2016 [cited by applicant]
US 20160335141A1 · Crawford · 2016 [cited by examiner]
US 20160358460A1 · Lee · 2016 [cited by examiner]
US 20170076720A1 · Gopalan et al. · 2017 [cited by applicant]
US 20170090864A1 · Jorgovanovic · 2017 [cited by examiner]
US 20170098197A1 · Yu · 2017 [cited by examiner]
US 20170123491A1 · Hansen · 2017 [cited by examiner]
US 20170133011A1 · Chen et al. · 2017 [cited by applicant]
US 20170365251A1 · Park · 2017 [cited by examiner]
US 20180151177A1 · Gemmeke · 2018 [cited by examiner]
US 20180350359A1 · Bakar · 2018 [cited by examiner]
US 20230145324A1 · Sharifi · 2023 [cited by examiner]
CN 104145304A · 2014 [cited by applicant]
CN 104284257A · 2015 [cited by applicant]
CN 104604274A · 2015 [cited by applicant]
WO 2014007545A1 · 2014 [cited by applicant]
WO 20158009122 · 2015 [cited by applicant]
WO 2015017043A1 · 2015 [cited by applicant]
International Search Report and Written Opinion from International Application No. PCT/US2016/057519, dated Feb. 3, 2017. [cited by applicant]
CN Office Action issued in Chinese Application No. 201680042544.1, mailed on Mar. 26, 2019, 9 pages (with English translation). [cited by applicant]
EP Office Action issued in European Application No. 16790803.7, mailed on Apr. 5, 2019, 4 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. 21185794.1, dated Oct. 21, 2021, 14 pages. [cited by applicant]
Chinese Office Action issued in Chinese Application No. 201910796762.X, mailed on Dec. 23, 2022, 24 pages (with English translation). [cited by applicant]
USPTO. Office Action relating to U.S. Appl. No. 16/896,061, dated Dec. 29, 2022. [cited by applicant]