IP Library Granted Patent US 12,086,147
Granted Patent B2
US 12,086,147 · App. 18/196,941 · Granted Sep 10, 2024

User attribute resolution of unresolved terms of action queries

Inventors: Vikram Aggarwal (Palo Alto, CA); Alice Lee (Menlo Park, CA)
Assignee: GOOGLE LLC
G06F16/24575G06F16/29G06F16/335G06F16/9535G06F16/9537
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,086,147
App. No.
18/196,941
Granted
Sep 10, 2024
Kind
B2
Abstract

User attribute data associated with a user may be used to resolve unresolved entities in connection with the performance of computer-based actions, e.g., actions resulting from action queries generated based at least in part on content being accessed on a computing device.

Claims (50)

1. A method implemented by one or more processors, the method comprising:

receiving a natural language input provided at a computing device by a user of the computing device;

in response to receiving the natural language input, identifying at least one entity term for an action query, wherein the at least one entity term is mapped to a plurality of computer-based actions in one or more databases;

identifying content displayed by the computing device most recently relative to receiving the natural language input, wherein the content displayed by the computing device most recently relative to receiving the natural language input is content displayed in response to an interaction between the computing device and the user initiated previous to receiving the natural language input at the computing device;

processing the identified content displayed by the computing device most recently relative to receiving the natural language input to resolve the plurality of computer-based actions for the action query;

subsequent to resolving the plurality of computer-based actions for the action query:

generating interactive content based on processing the action query including the plurality of resolved computer-based actions, wherein the interactive content includes a plurality of graphical elements,

wherein a selection of a first graphical element, of the plurality of graphical elements, via further user input received at the computing device, causes performance, by first a computer application installed on the computing device, of a first resolved computer-based action, of the plurality of resolved computer-based actions, and

wherein selection of a second graphical element, of the plurality of graphical elements, via further user input received at the computing device, causes performance, by a second computer application installed on the computing device, of a second resolved computer-based action, of the plurality of resolved computer-based actions;

providing, in response to receiving the natural language input, the interactive content for display at the computing device; and

initiating performance of the first resolved computer-based action in response to a user selection of the first graphical element when the interactive content is displayed at the computing device, wherein initiating performance of the first resolved computer-based action comprises causing the first computer application installed on the computing device to automatically perform the first resolved computer-based action.

2. The method of claim 1 , wherein causing the first computer application to automatically perform the first resolved computer-based action comprises interfacing with an API of the first computer application based on a parse of the action query.

3. The method of claim 1 , wherein resolving the plurality of computer-based actions for the action query further comprises using user attribute data stored in the computing device.

4. The method of claim 1 , wherein resolving the plurality of computer-based actions for the action query further uses location data stored in the computing device, the location data including a current location of the computing device, point of interest data stored in a point of interest database in the computing device or beacon data received from a beacon in proximity to the computing device.

5. The method of claim 1 , wherein the first resolved computer-based action for the action query is a point of interest search, and wherein the at least one entity term includes a point of interest category term.

6. The method of claim 5 , further comprising resolving the point of interest category term based on user attribute data stored in the computing device.

7. The method of claim 6 , wherein the point of interest category term is resolvable among one or more of a restaurant category, a shopping category, an activity category, a services category, and an entertainment category.

8. A system comprising one or more processors and memory storing instructions that, in response to execution by the one or more processors, cause the one or more processors to:

receive a natural language input provided at a computing device by a user of the computing device;

in response to receipt of the natural language input, identify at least one entity term for an action query, wherein the at least one entity term is mapped to a plurality of computer-based actions in one or more databases;

identify content displayed by the computing device most recently relative to receiving the natural language input, wherein the content displayed by the computing device most recently relative to receiving the natural language input is content displayed in response to an interaction between the computing device and the user initiated previous to receiving the natural language input at the computing device;

process the identified content displayed by the computing device most recently relative to receiving the natural language input to resolve the plurality of computer-based actions for the action query;

subsequent to resolution of the plurality of computer-based actions for the action query:

generate interactive content based on processing the action query including the plurality of resolved computer-based actions, wherein the interactive content includes a plurality of graphical elements,

wherein a selection of a first graphical element, of the plurality of graphical elements, via further user input received at the computing device, causes performance, by a first computer application installed on the computing device, of a first resolved computer-based action, of the plurality of resolved computer-based actions, and

wherein selection of a second graphical element, of the plurality of graphical elements, via further user input received at the computing device, causes performance, by a second computer application installed on the computing device, of a second resolved computer-based action, of the plurality of resolved computer-based actions;

provide, in response to receiving the natural language input, the interactive content for display at the computing device; and

initiate performance of the first resolved computer-based action in response to a user selection of the first graphical element when the interactive content is displayed at the computing device, wherein initiating performance of the first resolved computer-based action comprises causing the first computer application installed on the computing device to automatically perform the first resolved computer-based action.

9. The system of claim 8 , wherein the instructions to cause the first computer application to automatically perform the first resolved computer-based action comprise instructions to interface with an API of the first computer application based on a parse of the action query.

10. The system of claim 8 , wherein the instructions to resolve the plurality of computer-based actions for the action query comprise instructions to use user attribute data stored in the computing device.

11. The system of claim 8 , wherein the instructions to resolve the plurality of computer-based actions for the action query further comprise instructions to use location data stored in the computing device, the location data including a current location of the computing device, point of interest data stored in a point of interest database in the computing device or beacon data received from a beacon in proximity to the computing device.

12. The system of claim 8 , wherein the first resolved computer-based action for the action query is a point of interest search, and wherein the at least one entity term includes a point of interest category term.

13. The system of claim 12 , further comprising instructions to resolve the point of interest category term based on user attribute data stored in the computing device.

14. The system of claim 13 , wherein the point of interest category term is resolvable among one or more of a restaurant category, a shopping category, an activity category, a services category, and an entertainment category.

15. At least one non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to:

receive a natural language input provided at a computing device by a user of the computing device;

in response to receipt of the natural language input, identify at least one entity term for an action query, wherein the at least one entity term is mapped to a plurality of computer-based actions in one or more databases;

identify content displayed by the computing device most recently relative to receiving the natural language input, wherein the content displayed by the computing device most recently relative to receiving the natural language input is content displayed in response to an interaction between the computing device and the user initiated previous to receiving the natural language input at the computing device;

process the identified content displayed by the computing device most recently relative to receiving the natural language input to resolve the plurality of computer-based action for the actions query;

subsequent to resolution of the plurality of computer-based actions for the action query:

generate interactive content based on processing the action query including the plurality of resolved computer-based actions, wherein the interactive content includes a plurality of graphical elements,

wherein a selection of a first graphical element, of the plurality of graphical elements, via further user input received at the computing device, causes performance, by a first computer application installed on the computing device, of a first resolved computer-based action, of the plurality of resolved computer-based actions, and

wherein selection of a second graphical element, of the plurality of graphical elements, via further user input received at the computing device, causes performance, by a second computer application installed on the computing device, of a second resolved computer-based action, of the plurality of resolved computer-based actions;

provide, in response to receiving the natural language input, the interactive content for display at the computing device; and

initiate performance of the first resolved computer-based action in response to a user selection of the first graphical element when the interactive content is displayed at the computing device, wherein initiating performance of the first resolved computer-based action comprises causing the first computer application installed on the computing device to automatically perform the first resolved computer-based action.

16. The at least one non-transitory computer-readable medium of claim 15 , wherein the instructions to cause the computer application to automatically perform the first resolved computer-based action comprise instructions to interface with an API of the first computer application based on a parse of the action query.

17. The at least one non-transitory computer-readable medium of claim 15 , wherein the instructions to resolve the plurality of computer-based actions for the action query comprise instructions to use user attribute data stored in the computing device.

18. The at least one non-transitory computer-readable medium of claim 15 , wherein the instructions to resolve the plurality of computer-based actions for the action query further comprise instructions to use location data stored in the computing device, the location data including a current location of the computing device, point of interest data stored in a point of interest database in the computing device or beacon data received from a beacon in proximity to the computing device.

19. The at least one non-transitory computer-readable medium of claim 15 , wherein the first resolved computer-based action for the action query is a point of interest search, and wherein the at least one entity term includes a point of interest category term.

20. The at least one non-transitory computer-readable medium of claim 19 , further comprising instructions to resolve the point of interest category term based on user attribute data stored in the computing device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2023
From: AGGARWAL, VIKRAM; LEE, ALICE
To: GOOGLE INC.
Reel/Frame 063644/0624 →
CHANGE OF NAME Recorded May 15, 2023
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 063648/0919 →
Continuity (4)
Continuation 17193785 · Mar 5, 2021
Continuation 16216521 · Dec 11, 2018
Continuation 15204236 · Jul 7, 2016
Related Publication 20230281206A1 · Sep 7, 2023