IP Library Granted Patent US 10,986,214
Granted Patent B2
US 10,986,214 · App. 16/450,296 · Granted Apr 20, 2021

Local persisting of data for selectively offline capable voice action in a voice-enabled electronic device

Inventors: Sangsoo Sung (Palo Alto, CA); Yuli Gao (Sunnyvale, CA); Prathab Murugesan (Mountain View, CA)
Assignee: GOOGLE LLC
H04L67/42G06F16/3343G10L15/22G10L15/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,986,214
App. No.
16/450,296
Granted
Apr 20, 2021
Kind
B2
Abstract

Data associated with a selectively offline capable voice action is locally persisted in a voice-enabled electronic device whenever such an action cannot be competed locally due to the device being offline to enable the action to later be completed after online connectivity has been restored. Synchronization with an online service and/or another electronic device, and/or retrieval of context sensitive data from an online service may be performed after online connectivity has been restored to enable the voice action to thereafter be completed.

Claims (42)

1. A method, comprising:

receiving a voice input with a voice-enabled electronic device; and

in the voice-enabled electronic device, and responsive to receiving at least a portion of the voice input:

identifying, during performing local processing of the at least a portion of the voice input, that the voice input is associated with a selectively offline capable voice action that is of a type that in at least one instance is capable of being completed offline and in at least one other instance can only be completed using a connection with an online service because a parameter, required for completion of the selectively offline capable voice action, is unresolvable strictly based upon data provided in the voice input and/or data available locally on the voice-enabled electronic device;

determining, during the local processing, that the selectively offline capable voice action cannot be completed offline, wherein determining that the selectively offline capable voice action cannot be completed offline includes determining, during the local processing, that the selectively offline capable voice action includes at least one parameter that remains unresolved from the local processing; and

in response to determining that the selectively offline capable voice action cannot be completed offline:

interfacing with an online service to obtain a value for the at least one parameter that remains unresolved from the voice input; and

completing the selectively offline capable voice action using the value obtained from interfacing with the online service.

2. The method of claim 1 , wherein the type of the selectively offline capable voice action is a media control type.

3. The method of claim 1 , wherein completing the selectively offline capable voice action comprises:

after obtaining the value, completing the selectively offline capable voice action using the value and using locally persisted data generated by the local processing for the selectively offline capable voice action.

4. The method of claim 1 , wherein the voice-enabled electronic device comprises a mobile device configured to communicate with the online service when in communication with a wireless network.

5. The method of claim 1 , wherein performing the local processing dynamically builds the at least a portion of the offline capable voice action prior to completely receiving the voice input with the voice-enabled electronic device, and wherein determining during the local processing that the selectively offline capable voice action cannot be completed offline is performed prior to completely receiving the voice input with the voice-enabled electronic device.

6. The method of claim 1 , wherein the voice-enabled electronic device is offline during the local processing.

7. The method of claim 1 , wherein the value is for context sensitive data.

8. The method of claim 6 , wherein the at least one parameter includes a location sensitive parameter, and wherein the value includes location sensitive data that is based on a current location of the voice-enabled electronic device.

9. The method of claim 1 , further comprising, in response to determining that the selectively offline capable voice action cannot be completed offline, notifying a user of the voice-enabled electronic device that the selectively offline capable voice action will be completed at a future time.

10. The method of claim 1 , wherein determining during the local processing that the selectively offline capable voice action cannot be completed offline is performed prior to completely receiving the voice input with the voice-enabled electronic device.

11. A voice-enabled electronic device including memory and one or more processors operable to execute instructions stored in the memory, comprising instructions to:

receive a voice input with a voice-enabled electronic device; and

in the voice-enabled electronic device, and responsive to receiving at least a portion of the voice input:

identify, during performance of local processing of the at least a portion of the voice input, that the voice input is associated with a selectively offline capable voice action that is of a type that in at least one instance is capable of being completed offline and in at least one other instance can only be completed using a connection with an online service because a parameter, required for completion of the selectively offline capable voice action, is unresolvable strictly based upon data provided in the voice input and/or data available locally on the voice-enabled electronic device;

determine, during the local processing, that the selectively offline capable voice action cannot be completed offline, wherein the instructions to determine that the selectively offline capable voice action cannot be completed offline include instructions to determine, during the local processing, that the selectively offline capable voice action includes at least one parameter that remains unresolved from the local processing; and

in response to determining that the selectively offline capable voice action cannot be completed offline:

interface with an online service to obtain a value for the at least one parameter that remains unresolved from the voice input; and

complete the selectively offline capable voice action using the value obtained from interfacing with the online service.

12. The voice-enabled electronic device of claim 11 , wherein the instructions to complete the selectively offline capable voice action comprise instructions to:

after obtaining the value, complete the selectively offline capable voice action using the value and using locally persisted data generated by the local processing for the selectively offline capable voice action.

13. The voice-enabled electronic device of claim 11 , wherein the instructions to perform the local processing comprise instructions to dynamically build the at least a portion of the offline capable voice action prior to completely receiving the voice input with the voice-enabled electronic device, and wherein the instructions to determine, during the local processing, that the selectively offline capable voice action cannot be completed offline include instructions to determine, prior to completely receiving the voice input with the voice-enabled electronic device, that the selectively offline capable voice action cannot be completed offline.

14. The voice-enabled electronic device of claim 11 , wherein the voice-enabled electronic device is offline during the local processing.

15. The voice-enabled electronic device of claim 11 , wherein the at least one parameter includes a location sensitive parameter, and wherein the value includes location sensitive data that is based on a current location of the voice-enabled electronic device.

16. The voice-enabled electronic device of claim 11 , wherein the instructions further comprise instructions to:

in response to determining that the selectively offline capable voice action cannot be completed offline, notify a user of the voice-enabled electronic device that the selectively offline capable voice action will be completed at a future time.

17. The voice-enabled electronic device of claim 11 , wherein the instructions to determine, during the local processing, that the selectively offline capable voice action cannot be completed offline include instructions to determine, prior to completely receiving the voice input with the voice-enabled electronic device, that the selectively offline capable voice action cannot be completed offline.

18. A non-transitory computer readable storage medium storing computer instructions executable by one or more processors to perform a method comprising:

receiving a voice input with a voice-enabled electronic device; and

in the voice-enabled electronic device, and responsive to receiving at least a portion of the voice input:

identifying, during performing local processing of the at least a portion of the voice input, that the voice input is associated with a selectively offline capable voice action that is of a type that in at least one instance is capable of being completed offline and in at least one other instance can only be completed using a connection with an online service because a parameter, required for completion of the selectively offline capable voice action, is unresolvable strictly based upon data provided in the voice input and/or data available locally on the voice-enabled electronic device;

determining, during the local processing, that the selectively offline capable voice action cannot be completed offline, wherein determining that the selectively offline capable voice action cannot be completed offline includes determining during the local processing that the selectively offline capable voice action includes at least one parameter that remains unresolved from the local processing; and

in response to determining that the selectively offline capable voice action cannot be completed offline:

interfacing with an online service to obtain a value for the at least one parameter that remains unresolved from the voice input; and

completing the selectively offline capable voice action using the value obtained from interfacing with the online service.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2019
From: SUNG, SANGSOO; GAO, YULI; MURUGESAN, PRATHAB
To: GOOGLE INC.
Reel/Frame 049568/0741 →
CHANGE OF NAME Recorded Jun 24, 2019
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 049571/0070 →
Continuity (3)
Continuation 16115219 · Aug 28, 2018
Continuation 14723279 · May 27, 2015
Related Publication 20190387076A1 · Dec 19, 2019