IP Library Granted Patent US 10,679,608
Granted Patent B2
US 10,679,608 · App. 15/841,284 · Granted Jun 9, 2020

Conversation-aware proactive notifications for a voice interface device

Inventors: Kenneth Mixter (Los Altos Hills, CA); Daniel Colish (Portland, OR); Tuan Nguyen (Mountain View, CA)
Assignee: GOOGLE LLC
G10L13/043G06F3/167G10L15/22G10L15/265H04L12/282H04L51/24H04L67/26G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,679,608
App. No.
15/841,284
Granted
Jun 9, 2020
Kind
B2
Abstract

A method for proactive notifications in a voice interface device includes: receiving a first user voice request for an action with an future performance time; assigning the first user voice request to a voice assistant service for performance; subsequent to the receiving, receiving a second user voice request and in response to the second user voice request initiating a conversation with the user; and during the conversation: receiving a notification from the voice assistant service of performance of the action; triggering a first audible announcement to the user to indicate a transition from the conversation and interrupting the conversation; triggering a second audible announcement to the user to indicate performance of the action; and triggering a third audible announcement to the user to indicate a transition back to the conversation and rejoining the conversation.

Claims (49)

1. A method, comprising:

at an electronic voice interface device including a speaker, one or more processors, and memory storing instructions for execution by the one or more processors:

receiving a first user voice request for an action with a future performance time;

assigning the first user voice request to a server implemented voice assistant service for performance;

subsequent to the receiving of the first user voice request and prior to the future performance time:

receiving a second user voice request; and

in response to the second user voice request initiating a conversation with the user, wherein the conversation includes a series of one or more requests and related response messages between the user and the server implemented voice assistant service; and

during the conversation:

receiving a notification from the server implemented voice assistant service of performance of the action;

in response to receiving the notification, interrupting the conversation by triggering a first audible announcement to the user indicating a transition from the conversation;

following the first audible announcement, triggering a verbal announcement to the user to indicate performance of the action; and

following the verbal announcement, rejoining the conversation by triggering a second audible announcement to the user indicating a transition back to the conversation.

2. The method of claim 1 , further comprising:

displaying a visual cue on the electronic voice interface device to accompany one or more of the audible announcements.

3. The method of claim 1 , further comprising: receiving the first user voice request at the electronic voice interface device.

4. The method of claim 1 , wherein the future performance time is indeterminate.

5. The method of claim 1 , wherein the voice assistant service is implemented at a server in communication with the electronic voice interface device.

6. The method of claim 1 , wherein the conversation is monitored by a digital conversation manager implemented at a server in communication with the electronic voice interface device.

7. The method of claim 6 , wherein the digital conversation manager receives the notification.

8. The method of claim 1 , further comprising:

determining based on context of the conversation an appropriate time at which to trigger the first audible announcement.

9. The method of claim 1 , wherein the conversation is performed between the user and a software agent, wherein the software agent determines and generates one or more of the audible announcements.

10. An electronic voice interface device comprising:

a speaker,

one or more processors,

and memory storing executable instructions that are configured to cause the one or more processors to perform operations including:

receiving a first user voice request for an action with a future performance time;

assigning the first user voice request to a server implemented voice assistant service for performance;

subsequent to receiving the first user voice request, receiving a second user voice request and in response to the second user voice request initiating a conversation with the user; and

during the conversation:

receiving a notification from the voice assistant service of performance of the action;

in response to receiving the notification, interrupting the conversation by triggering a first audible announcement to the user indicating a transition from the conversation;

following the first audible announcement, triggering a verbal announcement to the user to indicate performance of the action; and

following the verbal announcement, rejoining the conversation by triggering a second audible announcement to the user indicating a transition back to the conversation.

11. The electronic voice interface device of claim 10 , further comprising one or more display elements, wherein the instructions are further configured to cause the one or more processors to perform: displaying on the one or more display elements a visual cue to accompany one or more of the audible announcements.

12. The electronic voice interface device of claim 10 , wherein the instructions are further configured to cause the one or more processors to perform: receiving the first user voice request at the electronic voice interface device.

13. The electronic voice interface device of claim 10 , wherein the voice assistant service is implemented at a server communicatively coupled to the voice interface device.

14. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by a computer system with one or more processors, cause an electronic voice interface device to perform:

receiving a first user voice request for an action with a future performance time;

assigning the first user voice request to a server implemented voice assistant service for performance;

subsequent to the receiving of the first user voice request, receiving a second user voice request and in response to the second user voice request initiating a conversation with the user; and

during the conversation:

receiving a notification from the voice assistant service of performance of the action;

in response to receiving the notification, interrupting the conversation by triggering a first audible announcement to the user indicating a transition from the conversation;

following the first audible announcement, triggering a verbal announcement to the user to indicate performance of the action; and

following the verbal announcement, rejoining the conversation by triggering a second audible announcement to the user indicating a transition back to the conversation.

15. The non-transitory computer readable storage medium of claim 14 , wherein the instructions comprise an agent and an agent module, wherein the agent is configured to cause the processor to perform operations related to satisfaction of the second user voice request and the agent module is configured to cause the processor to manage interactions between the agent and the user during the conversation.

16. The non-transitory computer readable storage medium of claim 15 , wherein the agent module further comprises a library of transition-in phrases and a library of transition-out phrases, wherein the agent module is configured to cause the processor to generate content of the first audible announcement from the transition-out phrases and to generate content of the second audible announcement from the transition-in phrases.

17. The non-transitory computer readable storage medium of claim 16 , wherein the instructions further comprise a conversation manager module, wherein the conversation manager module is configured to cause the agent module to interrupt the conversation, trigger the first audible announcement, wait for the conversation manager module to trigger the verbal announcement, trigger the second audible announcement upon completion of the verbal announcement; and rejoin the conversation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2018
From: MIXTER, KENNETH; COLISH, DANIEL; NGUYEN, TUAN
To: GOOGLE LLC
Reel/Frame 045056/0880 →
Continuity (2)
Provisional Application 62441116 · Dec 30, 2016
Related Publication 20180190264A1 · Jul 5, 2018
Cited By (24)
US 12,197,712 US 12,197,817 US 12,200,297 US 12,204,932 US 12,211,502 US 12,216,894 US 12,219,314 US 12,236,952 US 12,243,523 US 12,260,234 US 12,266,380 US 12,277,954 US 12,293,763 US 12,301,635 US 12,333,404 US 12,340,809 US 12,361,943 US 12,367,879 US 12,386,434 US 12,386,491 US 12,431,128 US 12,477,470 US 12,608,171 US 12,619,452