IP Library Granted Patent US 12,461,924
Granted Patent B2
US 12,461,924 · App. 18/825,600 · Granted Nov 4, 2025

User attribute resolution of unresolved terms of action queries

Inventors: Vikram Aggarwal (Palo Alto, CA); Alice Lee (Menlo Park, CA)
Assignee: GOOGLE LLC
G06F16/24575G06F16/29G06F16/335G06F16/9535G06F16/9537
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,461,924
App. No.
18/825,600
Granted
Nov 4, 2025
Kind
B2
Abstract

User attribute data associated with a user may be used to resolve unresolved entities in connection with the performance of computer-based actions, e.g., actions resulting from action queries generated based at least in part on content being accessed on a computing device.

Claims (42)

1 . A method, comprising:

receiving, at a computing device, input to initiate providing of an action query via the computing device, wherein the input is one of: selection of a virtual button, selection of a hardware button, a voice input, or a gesture input;

identifying, by the computing device, content displayed by the computing device most recently relative to receiving the input;

identifying at least one action term for the action query in response to receiving the input, the action term being mapped to at least one entity term and configured to initiate performance of a computer-based action;

resolving the at least one entity term using the identified content and user attribute data stored in the computing device;

generating interactive content using the identified at least one action term and the resolved at least one entity term of the action query, wherein the interactive content includes a graphical element that, when selected via further input received at the computing device, causes the computing device to perform the computer-based action;

providing, in response to receiving the input, the interactive content for display at the computing device; and

performing the computer-based action in response to a selection of the graphical element when the interactive content is displayed at the computing device.

2 . The method of claim 1 , wherein performing the computer-based action includes querying a remote computing system and providing a response thereto on the computing device using response data received from the remote computing system.

3 . The method of claim 1 , wherein performing the computer-based action includes querying a local database stored on the computing device and providing a response thereto on the computing device using response data received from the local database.

4 . The method of claim 3 , wherein the local database includes point of interest data.

5 . The method of claim 1 , wherein identifying the at least one action term for the action query in response to receiving the input is based at least in part on the identified content.

6 . The method of claim 1 , wherein resolving the at least one entity term is based on determining that the action term is a vague action term.

7 . The method of claim 1 , wherein resolving the at least one entity term is based on determining that an entity in the identified content is subject to multiple interpretations.

8 . The method of claim 1 , wherein resolving the at least one entity term is based on determining multiple species for a genus determined in the identified content.

9 . The method of claim 1 , wherein resolving the at least one entity term further uses location data stored in the computing device, the location data including a current location of the computing device, point of interest data stored in a point of interest database in the computing device or beacon data received from a beacon in proximity to the computing device.

10 . The method of claim 1 , wherein the identified action term is a point of interest search, wherein the at least one entity term includes a point of interest category term, and wherein resolving the at least one entity term using the user attribute data stored in the computing device includes resolving the point of interest category term.

11 . The method of claim 10 , wherein the point of interest category term is resolvable among one or more of a restaurant category, a shopping category, an activity category, a services category, and an entertainment category.

12 . The method of claim 10 , wherein resolving the at least one entity term using the user attribute data stored in the computing device includes resolving a subcategory for the resolved point of interest category term.

13 . A system, comprising:

a computing device including memory storing instructions and one or more processors operable to execute the instructions in the memory, wherein the instructions comprise instructions to:

receive input to initiate providing of an action query via the computing device, wherein the input is one of: selection of a virtual button, selection of a hardware button, a voice input, or a gesture input;

identify content displayed by the computing device most recently relative to receiving the input;

identify at least one action term for the action query in response to receiving the input, the action term being mapped to at least one entity term and configured to initiate performance of a computer-based action;

resolve the at least one entity term using the identified content and user attribute data stored in the computing device;

generate interactive content using the identified at least one action term and the resolved at least one entity term of the action query, wherein the interactive content includes a graphical element that, when selected via further input received at the computing device, causes the computing device to perform the computer-based action;

provide, in response to receiving the input, the interactive content for display at the computing device; and

perform the computer-based action in response to a selection of the graphical element when the interactive content is displayed at the computing device.

14 . The system of claim 13 , wherein the instructions to identify the at least one action term for the action query in response to receiving the input identify the at least one action term based at least in part on the identified content.

15 . The system of claim 13 , wherein the instructions to resolve the at least one entity term include instructions to determine that the action term is a vague action term, instructions to determine that an entity in the identified content is subject to multiple interpretations, and/or instructions to determine an inability to determine a species for a genus determined in the identified content.

16 . The system of claim 13 , wherein the instructions to resolve the at least one entity term further use location data stored in the computing device, the location data including a current location of the computing device, point of interest data stored in a point of interest database in the computing device or beacon data received from a beacon in proximity to the computing device.

17 . The system of claim 13 , wherein the identified action term is a point of interest search, wherein the at least one entity term includes a point of interest category term, and wherein the instructions to resolve the at least one entity term using the user attribute data stored in the computing device include instructions to resolve the point of interest category term.

18 . At least one non-transitory computer-readable medium comprising instructions that, in response to execution of the instructions by a computing device, cause the computing device to:

receive input to initiate providing of an action query via the computing device;

identify content displayed by the computing device most recently relative to receiving the input;

identify at least one action term for the action query in response to receiving the input, the action term being mapped to at least one entity term and configured to initiate performance of a computer-based action;

resolve the at least one entity term using the identified content and user attribute data stored in the computing device;

generate interactive content using the identified at least one action term and the resolved at least one entity term of the action query, wherein the interactive content includes a graphical element that, when selected via further input received at the computing device, causes the computing device to perform the computer-based action;

provide, in response to receiving the input, the interactive content for display at the computing device; and

perform the computer-based action in response to a selection of the graphical element when the interactive content is displayed at the computing device.

19 . The non-transitory computer-readable medium of claim 18 , wherein the instructions to identify the at least one action term for the action query in response to receiving the input identify the at least one action term based at least in part on the identified content.

20 . The non-transitory computer-readable medium of claim 18 , wherein the instructions to resolve the at least one entity term include instructions to determine that the action term is a vague action term, instructions to determine that an entity in the identified content is subject to multiple interpretations, and/or instructions to determine an inability to determine a species for a genus determined in the identified content.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 17, 2024
From: AGGARWAL, VIKRAM; LEE, ALICE
To: GOOGLE INC.
Reel/Frame 068614/0802 →
CHANGE OF NAME Recorded Sep 17, 2024
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 068978/0871 →
Continuity (5)
Continuation 18196941 · May 12, 2023
Continuation 17193785 · Mar 5, 2021
Continuation 16216521 · Dec 11, 2018
Continuation 15204236 · Jul 7, 2016
Related Publication 20240427778A1 · Dec 26, 2024
References Cited (39)
US 7072884B2 · Kemp · 2006 [cited by applicant]
US 7603367B1 · Kanter et al. · 2009 [cited by applicant]
US 7765227B1 · Khoshnevisan et al. · 2010 [cited by applicant]
US 9286910B1 · Li et al. · 2016 [cited by applicant]
US 10180965B2 · Aggarwal et al. · 2019 [cited by applicant]
US 10956425B2 · Aggarwal et al. · 2021 [cited by applicant]
US 20040083203A1 · Kemp · 2004 [cited by applicant]
US 20070116112A1 · Gu et al. · 2007 [cited by applicant]
US 20070168382A1 · Tillberg et al. · 2007 [cited by applicant]
US 20080275784A1 · Kramer et al. · 2008 [cited by applicant]
US 20100299136A1 · Tong et al. · 2010 [cited by applicant]
US 20120117058A1 · Rubinstein et al. · 2012 [cited by applicant]
US 20130073388A1 · Heath · 2013 [cited by applicant]
US 20140019462A1 · Heck et al. · 2014 [cited by applicant]
US 20140358958A1 · Mandic et al. · 2014 [cited by applicant]
US 20160055246A1 · Marcin et al. · 2016 [cited by applicant]
US 20210191948A1 · Aggarwal · 2021 [cited by applicant]
US 20230281206A1 · Aggarwal et al. · 2023 [cited by applicant]
CN 102609444 · 2012 [cited by applicant]
WO 2010034056 · 2010 [cited by applicant]
WO 2012019028 · 2012 [cited by applicant]
WO 2012064530 · 2012 [cited by applicant]
WO 2015103238 · 2015 [cited by applicant]
WO 2016029099 · 2016 [cited by applicant]
Deutsches Patent Office; Examination Report issued in Application No. DE102017115016.1; 10 pages; dated Jan. 8, 2025. [cited by applicant]
European Patent Office; Brief Communication issued in Application No. 17740859.8; 8 pages; dated Nov. 24, 2023. [cited by applicant]
Intelectual Property India; Examination Report Issue in Application Serial No. 202148011694; 7 pages; dated Dec. 14, 2023. [cited by applicant]
European Patent Office; Summons to attend oral proceedings issued in Application No. 17740859.8; 9 pages; dated Jul. 31, 2023. [cited by applicant]
China National Intellectual Property Administration; Decision on Rejection issue in Application No. 201710550534.5; 7 pages; dated Nov. 2, 2021. [cited by applicant]
European Patent Office; Communication Pursuant to Article 94(3) issued in Application No. 17740859.9; 8 pages; dated Jul. 9, 2021. [cited by applicant]
China National Intellectual Property Administration; Notification of Second Office Action issue in Application No. 201710550534.5; 7 pages; dated Feb. 3, 2021. [cited by applicant]
China National Intellectual Property Administration; Notification of Third Office Action issue in Application No. 201710550534.5; 27 pages; dated Jul. 6, 2021. [cited by applicant]
Intelectual Property India; Examination Report Issue in Application Serial No. 201847003815; 7 pages; dated Sep. 24, 2020. [cited by applicant]
China National Intellectual Property Administration; Notification of First Office Action issue in Application No. 201710550534.5; 25pages; dated Apr. 3, 2020. [cited by applicant]
European Patent Office; International Preliminary Report on Patentability of PCT Ser. No. PCT/US2017/040871, 9 pages, dated Jan. 17, 2019. [cited by applicant]
International Search Report and Written Opinion of PCT Ser. No. PCT/US2017/040871; 14 pages Sep. 15, 2017. [cited by applicant]
European Patent Office; Written Opinion of the International Preliminary Examining Authority of International Application No. PCT/US2017/0408741; dated Jun. 13, 2018. [cited by applicant]
China National Intellectual Property Administration; Reexamination Notice issue in Application No. 201710550534.5; 20 pages; dated May 15, 2025. [cited by applicant]
China National Intellectual Property Administration; Decision of Reexamination issued in Application No. 201710550534.5; 28 pages; dated Sep. 23, 2025. [cited by applicant]