IP Library Granted Patent US 12,340,798
Granted Patent B2
US 12,340,798 · App. 18/406,484 · Granted Jun 24, 2025

Providing suggested voice-based action queries

Inventors: Vikram Aggarwal (Palo Alto, CA); Pravir Kumar Gupta (Mountain View, CA)
Assignee: GOOGLE LLC
G10L15/1822G06F3/167G06F16/3322G06F16/3323G10L15/26G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,340,798
App. No.
18/406,484
Granted
Jun 24, 2025
Kind
B2
Abstract

Technology of the disclosure may facilitate user discovery of various voice-based action queries that can be spoken to initiate computer-based actions, such as voice-based action queries that can be provided as spoken input to a computing device to initiate computer-based actions that are particularized to content being viewed or otherwise consumed by the user on the computing device. Some implementations are generally directed to determining, in view of content recently viewed by a user on a computing device, at least one suggested voice-based action query for presentation via the computing device. Some implementations are additionally or alternatively generally directed to receiving at least one suggested voice-based action query at a computing device and providing the suggested voice-based action query as a suggestion in response to input to initiate providing of a voice-based query via the computing device.

Claims (54)

1. A method implemented by one or more processors, the method comprising:

identifying content based on the content being recently visible on a computing device;

generating, based on the content and based on a first application being installed on the computing device, a first voice-based action query that can be spoken to initiate performance, by a first application, of a first computer-based action that is particularized to the content;

generating, based on a second application being installed on the computing device, a second voice-based action query that can be spoken to initiate performance, by a second application, of a second computer-based action that is particularized to the content;

determining that an input to initiate providing of a voice-based action query has been provided via the computing device, wherein the input to initiate providing of a voice-based query is a selection of a voice query interface element, a spoken phrase, or performing a gesture in view of a camera of the computing device;

in response to determining that the input to initiate providing of a voice-based action query has been provided via the computing device:

causing the first voice-based action query to be visually presented at the computing device, and

causing the second voice-based action query to be visually presented at the computing device along with the first voice-based action query; and

in response to the user speaking the provided first voice-based action query:

causing the first application to perform the first computer-based action.

2. The method of claim 1 , wherein generating the first voice-based action query is further based on a version of the first application that is installed on the computing device.

3. The method of claim 1 , wherein causing the first voice-based action query to be visually presented at the computing device, and causing the second voice-based action query to be visually presented at the computing device along with the first voice-based action query comprises:

causing a third application of the computing device to visibly render the first voice-based action query and the second voice-based action query.

4. The method of claim 3 , wherein causing the third application of the computing device to visibly render the first voice-based action query and the second voice-based action query comprises:

causing the third application to render a first interface element that includes a selectable display of the first voice-based action query and to render a second interface element that includes a selectable display of the second voice-based action query.

5. The method of claim 4 , further comprising:

causing the third application of the computing device to, while visibly rendering the first voice-based action query and the second voice-based action query:

monitor for voice input; and

display an indication of awaiting spoken input.

6. The method of claim 4 , wherein the third application is integrated as part of an operating system of the computing device.

7. The method of claim 1 , wherein the input to initiate providing of a voice-based query is the spoken phrase.

8. The method of claim 1 , wherein the input to initiate providing of a voice-based query is the selection of the voice query interface element.

9. The method of claim 1 , further comprising:

in response to determining that the input to initiate providing of the voice-based action query has been provided via the computing device:

causing monitoring for voice input to occur at the computing device along with a visual indication of awaiting voice input.

10. The method of claim 1 , wherein the presentation of the first voice-based action query is further selectable, through touch input, to cause performance of the first computer-based action.

11. A system, comprising:

one or more processors; and

memory operably coupled with the one or more processors, wherein the memory stores instructions that, in response to execution of the instructions by one or more processors, cause the one or more processors to:

identify content based on the content being recently visible on a computing device;

generate, based on the content and based on a first application being installed on the computing device, a first voice-based action query that can be spoken to initiate performance, by a first application, of a first computer-based action that is particularized to the content;

generate, based on a second application being installed on the computing device, a second voice-based action query that can be spoken to initiate performance, by a second application, of a second computer-based action that is particularized to the content;

determine that an input to initiate providing of a voice-based action query has been provided via the computing device, wherein the input to initiate providing of a voice-based query is a selection of a voice query interface element, a spoken phrase, or performing a gesture in view of a camera of the computing device;

in response to determining that the input to initiate providing of a voice-based action query has been provided via the computing device:

cause the first voice-based action query to be visually presented at the computing device, and

cause the second voice-based action query to be visually presented at the computing device along with the first voice-based action query; and

in response to the user selecting the presented first voice-based action query:

cause the first application to perform the first computer-based action.

12. The system of claim 11 , wherein in generating the first voice-based action query one or more of the processors are further to generate the first voice-based action query based on a version of the first application that is installed on the computing device.

13. The system of claim 11 , wherein in causing the first voice-based action query to be visually presented at the computing device, and in causing the second voice-based action query to be visually presented at the computing device along with the first voice-based action query one or more of the processors are to:

cause a third application of the computing device to visibly render the first voice-based action query and the second voice-based action query.

14. The system of claim 13 , wherein in causing the third application of the computing device to visibly render the first voice-based action query and the second voice-based action query one or more of the processors are to:

cause the third application to render a first interface element that includes a selectable display of the first voice-based action query and to render a second interface element that includes a selectable display of the second voice-based action query.

15. The system of claim 14 , where in response to execution of the instructions by the one or more processors, one or more of the processors are further to:

cause the third application of the computing device to, while visibly rendering the first voice-based action query and the second voice-based action query:

monitor for voice input; and

display an indication of awaiting spoken input.

16. The system of claim 14 , wherein the third application is integrated as part of an operating system of the computing device.

17. The system of claim 11 , wherein the is visible when the input to initiate providing of the voice-based action query is provided.

18. The system of claim 11 , wherein the input to initiate providing of a voice-based query is the spoken phrase.

19. The system of claim 11 , wherein the input to initiate providing of a voice-based query is the selection of the voice query interface element.

20. The system of claim 11 , where in response to execution of the instructions by the one or more processors, one or more of the processors are further to:

in response to determining that the input to initiate providing of the voice-based action query has been provided via the computing device:

cause monitoring for voice input to occur at the computing device along with a visual indication of awaiting voice input.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2024
From: AGGARWAL, VIKRAM; GUPTA, PRAVIR KUMAR
To: GOOGLE INC.
Reel/Frame 066069/0229 →
CHANGE OF NAME Recorded Jan 9, 2024
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 066242/0729 →
Continuity (5)
Continuation 17587450 · Jan 28, 2022
Continuation 16586612 · Sep 27, 2019
Continuation 14808919 · Jul 24, 2015
Provisional Application 62167195 · May 27, 2015
Related Publication 20240144924A1 · May 2, 2024
References Cited (90)
US 7657493B2 · Meijer · 2010 [cited by applicant]
US 8473289B2 · Jitkoff et al. · 2013 [cited by applicant]
US 8543397B1 · Nguyen · 2013 [cited by applicant]
US 8650210B1 · Cheng et al. · 2014 [cited by applicant]
US 8697822B2 · Durali et al. · 2014 [cited by applicant]
US 8849675B1 · Foerster et al. · 2014 [cited by applicant]
US 8930393B1 · Nordstrom et al. · 2015 [cited by applicant]
US 8990079B1 · Newman · 2015 [cited by applicant]
US 9378740B1 · Rosen et al. · 2016 [cited by applicant]
US 10504509B2 · Aggarwal et al. · 2019 [cited by applicant]
US 11238851B2 · Aggarwal et al. · 2022 [cited by applicant]
US 20050054381A1 · Lee · 2005 [cited by applicant]
US 20080243501A1 · Hafsteinsson et al. · 2008 [cited by applicant]
US 20080247519A1 · Abella et al. · 2008 [cited by applicant]
US 20090150155A1 · Endo et al. · 2009 [cited by applicant]
US 20100114944A1 · Adler · 2010 [cited by examiner]
US 20100121636A1 · Burke et al. · 2010 [cited by applicant]
US 20110307253A1 · Lloyd et al. · 2011 [cited by applicant]
US 20120016678A1 · Gruber et al. · 2012 [cited by applicant]
US 20120035931A1 · Lebeau · 2012 [cited by applicant]
US 20120084292A1 · Liang et al. · 2012 [cited by applicant]
US 20120084312A1 · Jenson · 2012 [cited by applicant]
US 20130066634A1 · Soliman et al. · 2013 [cited by applicant]
US 20130091463A1 · Nordstrom et al. · 2013 [cited by applicant]
US 20130179173A1 · Lee et al. · 2013 [cited by applicant]
US 20130325839A1 · Goddard et al. · 2013 [cited by applicant]
US 20130346450A1 · Procopio et al. · 2013 [cited by applicant]
US 20140039895A1 · Aravamudan · 2014 [cited by examiner]
US 20140046891A1 · Banas · 2014 [cited by applicant]
US 20140053088A1 · Civelli et al. · 2014 [cited by applicant]
US 20140081633A1 · Badaskar · 2014 [cited by applicant]
US 20140122059A1 · Patel et al. · 2014 [cited by applicant]
US 20140196092A1 · Chung et al. · 2014 [cited by applicant]
US 20140222436A1 · Binder et al. · 2014 [cited by applicant]
US 20140278435A1 · Ganong, III et al. · 2014 [cited by applicant]
US 20140280289A1 · Marantz et al. · 2014 [cited by applicant]
US 20140334645A1 · Yun et al. · 2014 [cited by applicant]
US 20150006564A1 · Tomkins et al. · 2015 [cited by applicant]
US 20150254057A1 · Klein et al. · 2015 [cited by applicant]
US 20150382047A1 · Van Os et al. · 2015 [cited by applicant]
US 20220157302A1 · Aggarwal et al. · 2022 [cited by applicant]
CN 101213511 · 2008 [cited by applicant]
CN 102272828 · 2011 [cited by applicant]
CN 102439661 · 2012 [cited by applicant]
CN 102792320 · 2012 [cited by applicant]
CN 102792664 · 2012 [cited by applicant]
CN 102915342 · 2013 [cited by applicant]
CN 103425727 · 2013 [cited by applicant]
CN 103443853 · 2013 [cited by applicant]
CN 103729126 · 2014 [cited by applicant]
EP 3262636 · 2018 [cited by applicant]
JP 2000244609 · 2000 [cited by applicant]
JP 2002259114 · 2002 [cited by applicant]
JP 2002278591 · 2002 [cited by applicant]
JP 2004258233 · 2004 [cited by applicant]
JP 2004272363 · 2004 [cited by applicant]
JP 2004334228 · 2004 [cited by applicant]
JP 2007508590 · 2007 [cited by applicant]
JP 2012230191 · 2012 [cited by applicant]
JP 2014134675 · 2014 [cited by applicant]
JP 2014203207 · 2014 [cited by applicant]
KR 1020140028540 · 2011 [cited by applicant]
KR 1020120125377 · 2012 [cited by applicant]
TW 200710823 · 2007 [cited by applicant]
WO 2013122840 · 2013 [cited by applicant]
WO 2016073803 · 2016 [cited by applicant]
China National Intellectual Property Administration; Notification of First Office Action issued in Application No. 201910977782.7, 12 pages, dated Mar. 23, 2023. [cited by applicant]
Japanese Patent Office; Notice of Allowance issued in Application No. 2020-091323; 3 pages; dated Nov. 15, 2021. [cited by applicant]
Intellectual Property of India; Hearing Notice issued in Application No. 201747034057; 3 pages; dated Aug. 18, 2021. [cited by applicant]
Japanese Patent Office; Notice of Reasons for Rejection issued in Application No. 2020-091323; 6 pages; dated Apr. 26, 2021. [cited by applicant]
Korean Intellectual Property Office; Notice of Office Action issued in Application No. 10-2019-7030804; 11 pages; dated Jun. 10, 2021. [cited by applicant]
European Patent Office, Intention to Grant European Patent for Application No. 18179479.3; 48 pages; dated Jun. 25, 2020. [cited by applicant]
Intellectual Property Office; Intention to Grant issued in British Application GB1715688.6; 2 pages; dated Jul. 14, 2020. [cited by applicant]
Japanese Patent Office; Notice of Allowance issue in JP Application No. 2018-212055; 3 pages; dated Apr. 27, 2020. [cited by applicant]
Intellectual Property Office; Examination Report issued in British Application GB1715688.6; 5 pages; dated Mar. 13, 2020. [cited by applicant]
Intellectual Property India; Examination Report issued in Application 201747034057 dated Feb. 14, 2020 (6 Pages) Feb. 14, 2020. [cited by applicant]
Korean Intellectual Property Office; Office Action issued in Application No. 10-2018-7017226; 62 pages; dated Jan. 16, 2019. [cited by applicant]
Korean Intellectual Property Office; Notice of Allowance issued in Application No. 10-2018-7017226; 4 pages; dated Jul. 22, 2019. [cited by applicant]
13 The Japanese Patent Office; Decision of Refusal issued in Application No. 2018-212055 dated Oct. 15, 2019. [cited by applicant]
14 European Patent Office; Examination Report issued in Application No. 18179479.3 dated Oct. 16, 2019. [cited by applicant]
European Patent Office; International Search Report and Written Opinion of PCT Serial No. PCT/US16/034290; 12 pages; dated Jul. 29, 2016. [cited by applicant]
Korean Intellectual Property Office; Office Action issued in Application No. 1020177026523; 100 pages; dated Dec. 18, 2017. [cited by applicant]
European Patent Office, Intention to Grant European Patent for Application No. 16 730 101.9; 7 pages; dated Jan. 30, 2018. [cited by applicant]
Korean Intellectual Property Office; Allowance of Patent issued in Application No. 1020177026523; 3 pages; dated Mar. 16, 2018. [cited by applicant]
Japanese Patent Office; Notice of Reasons for Rejection issued in Application No. 2017-550867; 7 pages; dated Apr. 16, 2018. [cited by applicant]
German Patent and Trademark Office: Office Action issued in Application No. 112016000986.0; 12 pages; dated Jul. 20, 2018. [cited by applicant]
Japanese Patent Office; Notice of Allowance of Application No. 2017-550867, 6 pages, dated Oct. 15, 2018. [cited by applicant]
China National Intellectual Property Administration; Office Action issued in Application No. 201680019315.8; 13 pages; dated Jan. 30, 2019. [cited by applicant]
China National Intellectual Property Administration; Notice of Grant issued in Application No. 201680019315.8; 6 pages; dated Aug. 1, 2019. [cited by applicant]
European Patent Office: Extended European Search Report issued in Application No. 18179479.3; 8 pages; dated Aug. 7, 2018. [cited by applicant]