IP Library Granted Patent US 11,657,816
Granted Patent B2
US 11,657,816 · App. 17/099,130 · Granted May 23, 2023

Developer voice actions system

Inventors: Bo Wang (San Jose, CA); Sunil Vemuri (Pleasanton, CA); Nitin Mangesh Shetti (Sunnyvale, CA); Pravir Kumar Gupta (Lose Altos, CA); Scott B. Huffman (Portola Valley, CA); Javier Alejandro Rey (San Francisco, CA); Jeffrey A. Boortz (San Francisco, CA)
Assignee: GOOGLE LLC
G10L15/22G06F3/167G10L15/1815G10L15/19G10L2015/0638G10L2015/088G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,657,816
App. No.
17/099,130
Granted
May 23, 2023
Kind
B2
Abstract

Methods, systems, and apparatus, for defining and monitoring an event for a physical entity and the performance of an action in response to the occurrence of the event. A method includes receiving data indicating an event for a physical entity, the event specified in part by a physical environment feature for which the occurrence of the event is to be monitored by the data processing apparatus; receiving data indicating an action associated with the event and to be taken in response to the occurrence of the event; monitoring for the occurrence of the event for the physical entity; and in response to the occurrence of the event, causing the action associated with the event to be performed.

Claims (53)

1. A computer-implemented method, comprising:

receiving, by a voice action service system, an intent associated with a voice command trigger phrase, the voice command trigger phrase being included in a spoken utterance provided at a computing device of a user;

receiving, by the voice action service system, contextual information associated with the computing device of the user;

in response to receiving the intent associated with the voice command trigger phrase:

identifying, by the voice action service system, based on the intent associated with the voice command trigger phrase, an application installed on the computing device of the user that, when executed by the computing device of the user, satisfies the intent associated with the voice command trigger phrase, wherein the contextual information associated with the computing device of the user comprises a version of the application installed on the computing device of the user;

determining, based on the version of the application installed on the computing device of the user, whether the computing device of the user can execute the application to satisfy the intent associated with the voice command trigger phrase; and

in response to determining that the computing device of the user can execute the application to satisfy the intent associated with the voice command trigger phrase:

causing, by the voice action service system, the computing device of the user to execute the application to satisfy the intent associated with the voice command trigger phrase.

2. The method of claim 1 , wherein the contextual information associated with the computing device of the user further comprises an operating system utilized by the computing device of the user.

3. The method of claim 2 , wherein determining whether the computing device of the user can execute the application to satisfy the intent of the user is further based on the operating system utilized by the computing device of the user.

4. The method of claim 1 , wherein the intent associated with the voice command trigger phrase is determined locally at the computing device based on the computing device processing the spoken utterance.

5. The method of claim 4 , wherein processing the spoken utterance to determine the intent comprises:

processing the spoken utterance to generate a transcription corresponding to the spoken utterance;

determining at least a portion of the transcription matches the voice command trigger phrase;

identifying the intent based on the intent being associated with the voice command trigger phrase; and

transmitting the intent to the voice action service system.

6. The method of claim 1 , further comprising:

in response to determining that the computing device of the user cannot execute the application to satisfy the intent associated with the voice command trigger phrase:

refraining from causing, by the voice action service system, the computing device of the user to execute the application to satisfy the intent associated with the voice command trigger phrase.

7. A voice action service system, comprising:

at least one processor; and

at least one memory storing instructions that, when executed, cause the at least one processor to:

receive an intent associated with a voice command trigger phrase, the voice command trigger phrase being included in a spoken utterance provided at a computing device of a user;

receive contextual information associated with the computing device of the user, wherein the contextual information associated with the computing device of the user comprises an operating system utilized by the computing device of the user;

in response to receiving the intent associated with the voice command trigger phrase:

determine, based on the intent associated with the voice command trigger phrase, and based on the operating system utilized by the computing device of the user, whether the computing device of the user can execute an application installed on the computing device of the user to satisfy the intent associated with the voice command trigger phrase; and

in response to determining that the computing device of the user can execute the application to satisfy the intent associated with the voice command trigger phrase:

cause the computing device of the user to execute the application to satisfy the intent associated with the voice command trigger phrase.

8. The voice action service system of claim 7 , wherein the contextual information associated with the computing device of the user further comprises contextual information associated with the application installed on the computing device of the user.

9. The voice action service system of claim 8 , wherein the contextual information associated with the application comprises a version of the application installed on the computing device of the user.

10. The voice action service system of claim 9 , wherein determining whether the computing device of the user can execute the application to satisfy the intent of the user is further based on the version of the application installed on the computing device of the user.

11. The voice action service system of claim 7 , wherein the intent associated with the voice command trigger phrase is determined locally at the computing device based on the computing device processing the spoken utterance.

12. The voice action service system of claim 7 , wherein the instructions further cause the at least one processor to:

identify, based on at least the intent associated with the voice command trigger phrase, the application installed on the computing device of the to satisfy the intent associated with the voice command trigger phrase.

13. The voice action service system of claim 7 , wherein the instructions further cause the at least one processor to:

in response to determining that the computing device of the user cannot execute the application to satisfy the intent associated with the voice command trigger phrase:

refrain from causing the computing device of the user to execute the application to satisfy the intent associated with the voice command trigger phrase.

14. A non-transitory computer-readable medium storing instructions that, when executed, cause at least one processor to perform operations, the operations comprising:

receiving, by a voice action service system, an intent associated with a voice command trigger phrase, the voice command trigger phrase being included in a spoken utterance provided at a computing device of a user;

receiving, by the voice action service system, contextual information associated with the computing device of the user;

in response to receiving the intent associated with the voice command trigger phrase:

identifying, by the voice action service system, based on the intent associated with the voice command trigger phrase, an application installed on the computing device of the user that, when executed by the computing device of the user, satisfies the intent associated with the voice command trigger phrase, wherein the contextual information associated with the computing device of the user comprises a version of the application installed on the computing device associated with the voice command trigger phrase;

determining, based on the version of the application installed on the computing device of the user, whether the computing device of the user can execute the application to satisfy the intent of the user; and

in response to determining that the computing device of the user can execute the application to satisfy the intent associated with the voice command trigger phrase:

causing, by the voice action service system, the computing device of the user to execute the application to satisfy the intent associated with the voice command trigger phrase.

15. The non-transitory computer-readable medium of claim 14 , wherein the contextual information associated with the computing device of the user further comprises an operating system utilized by the computing device of the user.

16. The non-transitory computer-readable medium of claim 14 , wherein the intent associated with the voice command trigger phrase is determined locally at the computing device based on the computing device processing the spoken utterance.

17. The non-transitory computer-readable medium of claim 16 , wherein the operations to process the spoken utterance to determine the intent comprise:

processing the spoken utterance to generate a transcription corresponding to the spoken utterance;

determining at least a portion of the transcription matches the voice command trigger phrase;

identifying the intent based on the intent being associated with the voice command trigger phrase; and

transmitting the intent to the voice action service system.

18. The non-transitory computer-readable medium of claim 16 , wherein determining whether the computing device of the user can execute the application to satisfy the intent of the user is further based on the operating system utilized by the computing device of the user.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2020
From: WANG, BO; VEMURI, SUNIL; SHETTI, NITIN MANGESH; GUPTA, PRAVIR KUMAR; HUFFMAN, SCOTT B.; REY, JAVIER ALEJANDRO; BOORTZ, JEFFREY A.
To: GOOGLE INC.
Reel/Frame 054758/0407 →
CHANGE OF NAME Recorded Dec 28, 2020
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 054859/0440 →
Continuity (4)
Continuation 15987509 · May 23, 2018
Continuation 15258084 · Sep 7, 2016
Continuation 14693330 · Apr 22, 2015
Related Publication 20210082430A1 · Mar 18, 2021