IP Library Granted Patent US 12,499,307
Granted Patent B2
US 12,499,307 · App. 18/732,549 · Granted Dec 16, 2025

Autonomous spreadsheet creation

Inventors: Andrew J. Lavery (Austin, TX); Earl J. Wagner (Chicago, IL); Matthew Albright (Montclair, NJ)
Assignee: Google LLC
G06F40/18G06F16/953G06F40/40G06N5/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,499,307
App. No.
18/732,549
Granted
Dec 16, 2025
Kind
B2
Abstract

A method includes receiving, by a processing device, a natural language query corresponding to a request to create a document having a tabular structure, identifying, by the processing device, one or more attribute categories pertaining to the document, converting, by the processing device, the natural language query into a data access query for accessing at least one external data source, retrieving, by the processing device from the at least one external data source, a plurality of data items corresponding to the one or more attribute categories, and generating, by the processing device, the document by populating each cell of a plurality of cells of the document with a respective data item of the plurality of data items.

Claims (58)

1 . A method comprising:

receiving, by a processing device, a natural language query corresponding to a request to populate a document having a tabular structure;

identifying, by the processing device, a set of attribute categories pertaining to the document, the set of attribute categories comprising a first attribute category corresponding to one or more cells populated with one or more first attributes;

converting, by the processing device, the natural language query into a semantic index representation for accessing at least one external data source comprising a knowledge graph;

retrieving, by the processing device from the at least one external data source, a plurality of data items corresponding to the set of attribute categories; and

populating, by the processing device, each cell of a plurality of cells of the document with a respective data item of the plurality of data items.

2 . The method of claim 1 , wherein the at least one external data source further comprises a website.

3 . The method of claim 1 , wherein populating the document comprises generating an original version of the document to have a size determined in accordance with a size limit.

4 . The method of claim 1 , further comprising:

retrieving, by the processing device, one or more additional data items from the at least one external data source; and

updating, by the processing device, the document based on the one or more additional data items.

5 . The method of claim 4 , wherein retrieving the one or more additional data items further comprises:

receiving an additional natural language query; and

retrieving the one or more additional data items in response to receiving the additional natural language query.

6 . The method of claim 4 , wherein retrieving the one or more additional data items further comprises:

identifying, from the at least one external data source, newly relevant data with respect to the document; and

retrieving the newly relevant data from the at least one external data source.

7 . A system comprising:

a memory device; and

a processing device coupled to the memory device, the processing device to perform operations comprising:

receiving a natural language query corresponding to a request to populate a document having a tabular structure;

identifying a set of attribute categories pertaining to the document, the set of attribute categories comprising a first attribute category corresponding to one or more cells populated with one or more first attributes;

converting the natural language query into a semantic index representation for accessing at least one external data source comprising a knowledge graph;

retrieving, from the at least one external data source, a plurality of data items corresponding to the set of attribute categories; and

populating each cell of a plurality of cells of the document with a respective data item of the plurality of data items.

8 . The system of claim 7 , wherein the at least one external data source further comprises a website.

9 . The system of claim 7 , wherein populating the document comprises generating an original version of the document to have a size determined in accordance with a size limit.

10 . The system of claim 7 , wherein the operations further comprise:

retrieving one or more additional data items from the at least one external data source; and

updating the document based on the one or more additional data items.

11 . The system of claim 10 , wherein retrieving the one or more additional data items further comprises:

receiving an additional natural language query; and

retrieving the one or more additional data items in response to receiving the additional natural language query.

12 . The system of claim 10 , wherein retrieving the one or more additional data items further comprises:

identifying, from the at least one external data source, newly relevant data with respect to the document; and

retrieving the newly relevant data from the at least one external data source.

13 . A system comprising:

a memory device; and

a processing device coupled to the memory device, the processing device to perform operations comprising:

receiving a plurality of natural language queries from a user;

determining that each natural language query of the plurality of natural language queries is associated with a similar topic;

sending a recommendation to the user to populate a document having a tabular structure based on the plurality of natural language queries; and

in response to receiving an indication from the user to populate the document, populating each cell of a plurality of cells of the document with a respective data item of a set of data items retrieved from at least one external data source comprising a knowledge graph and a semantic index, wherein the set of data items corresponds to a set of attribute categories pertaining to the document, and wherein the set of attribute categories comprises a first attribute category corresponding to one or more cells populated with one or more first attributes.

14 . The system of claim 13 , wherein populating the document comprises generating an original version of the document to have a size determined in accordance with a size limit.

15 . The system of claim 13 , wherein populating the document comprises converting the natural language query into a semantic index representation for accessing the at least one external data source using the semantic index.

16 . The system of claim 13 , wherein populating the document further comprises:

identifying the set of attribute categories pertaining to the document; and

retrieving, from the at least one external data source, the set of data items.

17 . The system of claim 13 , wherein the at least one external data source further comprises a website.

18 . The system of claim 13 , wherein the operations further comprise:

retrieving one or more additional data items from the at least one external data source; and

updating the document based on the one or more additional data items.

19 . The system of claim 18 , wherein retrieving the one or more additional data items further comprises:

receiving an additional natural language query; and

retrieving the one or more additional data items in response to receiving the additional natural language query.

20 . The system of claim 18 , wherein retrieving the one or more additional data items further comprises:

identifying, from the at least one external data source, newly relevant data with respect to the document; and

retrieving the newly relevant data from the at least one external data source.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 9, 2024
From: LAVERY, ANDREW J.; WAGNER, EARL J.; ALBRIGHT, MATTHEW
To: GOOGLE LLC
Reel/Frame 067939/0469 →
Continuity (2)
Continuation 17485028 · Sep 24, 2021
Related Publication 20240330576A1 · Oct 3, 2024
References Cited (78)
US 5926822A · Garman · 1999 [cited by applicant]
US 7613719B2 · Chang et al. · 2009 [cited by applicant]
US 8972437B2 · Hoellwarth · 2015 [cited by applicant]
US 9652446B2 · Creason et al. · 2017 [cited by applicant]
US 9870354B2 · Hicks et al. · 2018 [cited by applicant]
US 10120851B2 · Naor · 2018 [cited by applicant]
US 10180979B2 · Perlegos · 2019 [cited by applicant]
US 10698978B1 · Hatton · 2020 [cited by applicant]
US 10740367B2 · Taylor et al. · 2020 [cited by applicant]
US 10936688B2 · Lu et al. · 2021 [cited by applicant]
US 11182538B2 · Ben-Ishay et al. · 2021 [cited by applicant]
US 11222171B2 · Zhang et al. · 2022 [cited by applicant]
US 11550778B2 · Zarras · 2023 [cited by applicant]
US 20120173476A1 · Rizvi · 2012 [cited by applicant]
US 20130159832A1 · Ingargiola et al. · 2013 [cited by applicant]
US 20150019216A1 · Singh et al. · 2015 [cited by applicant]
US 20150261794A1 · Lehrian et al. · 2015 [cited by applicant]
US 20150310073A1 · Chakrabarti et al. · 2015 [cited by applicant]
US 20160110367A1 · Krishnan · 2016 [cited by applicant]
US 20160179940A1 · Ashtiani et al. · 2016 [cited by applicant]
US 20170060868A1 · Rais Ghasem et al. · 2017 [cited by applicant]
US 20170308571A1 · McCurley et al. · 2017 [cited by applicant]
US 20170337233A1 · Fawcett et al. · 2017 [cited by applicant]
US 20180004722A1 · Naor · 2018 [cited by applicant]
US 20180108092A1 · Goodyear et al. · 2018 [cited by applicant]
US 20180203924A1 · Agrawal et al. · 2018 [cited by applicant]
US 20180239748A1 · Zhang et al. · 2018 [cited by applicant]
US 20180349377A1 · Verma et al. · 2018 [cited by applicant]
US 20190012305A1 · Dvorak · 2019 [cited by applicant]
US 20190340240A1 · Duta · 2019 [cited by applicant]
US 20200097541A1 · Christianson · 2020 [cited by examiner]
US 20200117758A1 · Lu et al. · 2020 [cited by applicant]
US 20210042308A1 · Mustafi · 2021 [cited by applicant]
US 20210081405A1 · Zarras · 2021 [cited by applicant]
US 20210103694A1 · Bouton · 2021 [cited by applicant]
US 20210141820A1 · Vora et al. · 2021 [cited by applicant]
US 20210173829A1 · Zeng et al. · 2021 [cited by applicant]
US 20210200761A1 · Li et al. · 2021 [cited by applicant]
US 20210271697A1 · Agrawal et al. · 2021 [cited by applicant]
US 20220035802A1 · Penzo · 2022 [cited by examiner]
US 20220044134A1 · Joy et al. · 2022 [cited by applicant]
US 20220058191A1 · Chen et al. · 2022 [cited by applicant]
US 20220067281A1 · Hu et al. · 2022 [cited by applicant]
US 20220309106A1 · Ramos · 2022 [cited by examiner]
US 20220335943A1 · Zhao · 2022 [cited by applicant]
CN 103473234A · 2013 [cited by applicant]
CN 105531706A · 2016 [cited by applicant]
CN 105824872A · 2016 [cited by applicant]
CN 108628887A · 2018 [cited by applicant]
CN 109829085A · 2019 [cited by applicant]
CN 110705226A · 2020 [cited by applicant]
CN 112417836A · 2021 [cited by applicant]
CN 112800773A · 2021 [cited by applicant]
CN 118159960A · 2024 [cited by applicant]
JP H11212996A · 1999 [cited by applicant]
JP 2003228564A · 2003 [cited by applicant]
JP 2007328716A · 2007 [cited by applicant]
JP 2012123559A · 2012 [cited by applicant]
JP 2019109782A · 2019 [cited by applicant]
JP 2021501386A · 2021 [cited by applicant]
WO 2015009586A2 · 2015 [cited by applicant]
WO 2021134358A1 · 2021 [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2022/044611, mailed on Jan. 17, 2023, 11 pages. [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2022/044613, mailed on Dec. 15, 2022, 17 pages. [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2022/044614, mailed on Dec. 8, 2022, 13 pages. [cited by applicant]
Microsoft: “Data Refresh in Power BI,” Jun. 3, 2021, 31 Pages, Retrieved from URL: https://docs.microsoft.com/en-us/power-bi/connect-data/refresh-data. [cited by applicant]
Microsoft: “Refresh an External Data Connection in Excel,” Jun. 2, 2021, 4 Pages, Retrieved from URL: https://supportmicrosoft.com/en-us/office/refresh-an-external-data-connection-in-excel-1524175f-777a-48fc-8fc7-)8514b… [cited by applicant]
Synapse: “Novel Deep Learning Powered Text Analytics,” VYASA, Synapse, Jun. 2, 2021, 13 Pages, Retrieved from URL: https://vyasa.com/solutions/synapse/. [cited by applicant]
Xia S., et al., “KTabulator: Interactive Ad Hoc Table Creation Using Knowledge Graphs,” Proceedings of the 36th Annual ACM Symposium on Applied Computing, 2021, 14 Pages. [cited by applicant]
Office Action for Chinese Patent Application No. 202280071445.1, mailed Nov. 30, 2024, 20 Pages. [cited by applicant]
Office Action for Chinese Patent Application No. 202280071451.7, mailed Dec. 5, 2024, 15 Pages. [cited by applicant]
Office Action for Japanese Patent Application No. 2024518729, mailed Feb. 25, 2025, 3 Pages. [cited by applicant]
Office Action for Korean Patent Application No. 10-2024-7012705, mailed Jul. 22, 2024, 15 Pages. [cited by applicant]
Office Action for Korean Patent Application No. 20247012705, mailed Jan. 23, 2025, 4 Pages. [cited by applicant]
Office Action of European Patent Application No. 22792996.5, mailed Mar. 7, 2025, 03 Pages. [cited by applicant]
Notice of Allowance for Korean Patent Application No. 10-2024-7012704, mailed May 30, 2025, 4 Pages. [cited by applicant]
Office Action for Indian Patent Application No. 202447031718, mailed Jul. 3, 2025, 07 Pages. [cited by applicant]
Office Action for Japanese Patent Application No. JP2024518729, mailed Jun. 17, 2025, 06 Pages. [cited by applicant]