IP Library › Granted Patent US 9,836,527
Granted Patent B2
US 9,836,527 · App. 15/051,778 · Granted Dec 5, 2017

Customized query-action mappings for an offline grammar model

Inventors: Yuli Gao (Sunnyvale, CA); Sangsoo Sung (Palo Alto, CA); Pedro Jose Moreno Mengibar (Jersey City, NJ)
Assignee: Google LLC
G06F17/30654G06F17/271G06F17/30684G10L15/265G10L2015/223G10L2015/225
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,836,527
App. No.
15/051,778
Filed
Feb 24, 2016
Granted
Dec 5, 2017
Kind
B2
Art Unit
2657
USPC
704/9
Abstract

An offline semantic processor of a resource-constrained voice-enabled device such as a mobile device utilizes an offline grammar model with reduced resource requirements to parse voice-based queries. In various implementations, a query issued at a resource-constrained device may be semantically processed to identify candidate responsive actions that are performable by the resource-constrained device. Candidate responsive action performance statistics may be analyzed to select, from the one or more candidate responsive actions, a qualifying responsive action. In various implementations, the candidate responsive action performance statistics may relate to performance of the one or more candidate responsive actions by the resource-constrained device following issuance of the query. An offline grammar model stored in the resource-constrained device may be updated to include a mapping between the issued query and the qualifying responsive action, wherein the offline grammar model maps queries to actions that are performable by the resource-constrained device while offline.

Claims (24)

1. A method, comprising:

semantically processing, by an online semantic processor, a long tail voice-based query issued at a first resource-constrained device of a coordinated ecosystem of resource-constrained devices controlled by a user to identify one or more candidate responsive actions that are performable by one or more of the resource-constrained devices, wherein the long tail voice-based query is unique or occurs relatively infrequently in a search volume of queries;

providing, as output at one or more of the resource-constrained devices, one or more prompts suggesting performance of the respective one or more candidate actions;

analyzing one or more responses by the user to the one or more prompts to select, from the one or more candidate responsive actions, a qualifying responsive action; and

updating an offline grammar model stored in each of the coordinated ecosystem of resource-constrained devices to include a mapping between the issued long tail voice-based query and the qualifying responsive action, wherein the offline grammar model maps voice-based queries to actions that are performable by each resource-constrained device of the coordinated ecosystem of resource-constrained devices while offline.

2. The method of claim 1 , wherein the one or more prompts comprise a selectable graphical element.

3. The method of claim 1 , wherein the one or more prompts comprise an audible or tactile prompt.

4. The method of claim 1 , further comprising communicating the offline grammar model to each resource-constrained device of the coordinated ecosystem of resource-constrained devices for storage and for use by respective semantic processors of each resource-constrained device of the coordinated ecosystem of resource-constrained devices while offline.

5. The method of claim 4 , wherein the communicating dynamically updates the offline grammar model stored in the resource-constrained device.

6. The method of claim 1 , wherein the semantic processing is performed using an online grammar model, wherein the offline grammar model has reduced resource requirements relative to the online grammar model.

7. The method of claim 1 , further comprising restricting access to the one or more of the mapping, the issued query, and the offline grammar to the resource-constrained device.

8. A system including memory and one or more processors operable to execute instructions stored in the memory, comprising instructions to:

semantically process a long tail voice-based query issued at a first resource-constrained device of a coordinated ecosystem of resource-constrained devices controlled by a user to identify one or more candidate responsive actions that are performable by one or more of the resource-constrained devices, wherein the long tail voice-based query is unique or occurs relatively infrequently in a search volume of queries;

provide, as output at one or more of the resource-constrained devices, one or more prompts suggesting performance of the respective one or more candidate actions;

analyze one or more responses by the user to the one or more prompts to select, from the one or more candidate responsive actions, a qualifying responsive action; and

update an offline grammar model stored in each of the coordinated ecosystem of resource-constrained devices to include a mapping between the issued long tail voice-based query and the qualifying responsive action, wherein the offline grammar model maps voice-based queries to actions that are performable by each resource-constrained device of the coordinated ecosystem of resource-constrained devices while offline.

9. The system of claim 8 , wherein the one or more prompts comprise a selectable graphical element.

10. The system of claim 8 , wherein the one or more prompts comprise an audible or tactile prompt.

11. The system of claim 8 , further comprising instructions to communicate the offline grammar model to each resource-constrained device of the coordinated ecosystem of resource-constrained devices for storage and for use by respective semantic processors of each resource-constrained device of the coordinated ecosystem of resource-constrained devices while offline.

12. At least one non-transitory computer-readable medium comprising instructions that, in response to execution of the instructions by a computer system, cause the computer system to perform the following operations:

semantically processing, by an online semantic processor, a long tail voice-based query issued at a first resource-constrained device of a coordinated ecosystem of resource-constrained devices controlled by a user to identify one or more candidate responsive actions that are performable by one or more of the resource-constrained devices, wherein the long tail voice-based query is unique or occurs relatively infrequently in a search volume of queries;

providing, as output at one or more of the resource-constrained devices, one or more prompts suggesting performance of the respective one or more candidate actions;

analyzing one or more responses by the user to the one or more prompts to select, from the one or more candidate responsive actions, a qualifying responsive action; and

updating an offline grammar model stored in each of the coordinated ecosystem of resource-constrained devices to include a mapping between the issued long tail voice-based query and the qualifying responsive action, wherein the offline grammar model maps voice-based queries to actions that are performable by each resource-constrained device of the coordinated ecosystem of resource-constrained devices while offline.

Assignments (2)
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2016
From: GAO, YULI; SUNG, SANGSOO; MENGIBAR, PEDRO JOSE MORENO
To: GOOGLE INC.
Reel/Frame 037815/0094 →
Continuity (1)
Related Publication 20170242914A1 · Aug 24, 2017