IP Library Granted Patent US 12,412,031
Granted Patent B2
US 12,412,031 · App. 17/877,819 · Granted Sep 9, 2025

Natural language query disambiguation

Inventors: Goutham Kallepalli (Mountain View, CA); Richard J. Becker (Edmonton, CA); Olabode Idowu (Edmonton, CA); Corinne Finegan (Mountain View, CA)
Assignee: Intuit Inc.
G06F40/211G06F16/3344G06N3/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,412,031
App. No.
17/877,819
Filed
Jul 29, 2022
Granted
Sep 9, 2025
Kind
B2
Art Unit
2654
USPC
704/9
Abstract

A method, computer program product, and system are provided. A first natural language text is received via a user interface. A generative pretrained transformer machine learning model processes the first natural language text and a context to identify a first intent. The processing is based in part on a syntax determined from a set of natural language completion paradigms. The generative transformer machine learning model maps the first set of parameters to a first query. The mapping is associated with a first confidence. The generative transformer machine learning model processes the first set of parameters and the first query to generate a set of execution steps. The processing is performed when the first confidence satisfies a threshold. The set of execution steps is parsed into a query object that is forwarded to a reporting service.

Claims (75)

1. A method comprising:

iteratively until a confidence satisfies a threshold:

receiving a first natural language text via a user interface,

processing, by a generative pretrained transformer machine learning model, the first natural language text and a context to identify a first intent, wherein:

the generative pretrained transformer machine learning model determines a latent space representation of both encoder and decoder sides of the generative pretrained transformer machine learning model,

each layer of the encoder and decoder sides of the generative pretrained transformer machine learning model comprises a plurality of sublayers,

the plurality of sublayers each comprise a multi-head self-attention layer and a position wise feed forward network layer that uses a fully connected network to process the multi-head self-attention layer, and

processing by the generative pretrained transformer machine learning model comprises: executing the encoder and decoder sides of the generative pretrained transformer machine learning model on the first natural language text and the context, to insert a set of learnable prompt embeddings that are generated using a series of example prompts and corresponding completions, and to identify the first intent,

mapping, by a generative transformer machine learning model, the first intent to a first query associated with the confidence,

processing the first query to generate a clarification question in natural language text when the confidence fails to satisfy the threshold, and

populating the user interface with the clarification question when the confidence fails to satisfy the threshold wherein prompt and completion pairs are encoded in JAVASCRIPT® object notation language (JSON) to fine-tune the generative pretrained transformer machine learning model;

processing, by the generative transformer machine learning model, the first intent and the first query to generate a series of structured query language (SQL) type statements, wherein the processing is performed when the confidence satisfies the threshold;

parsing the series of SQL type statements into a query object comprising a JSON payload comprising a series of execution steps;

forwarding the query object to a reporting service;

mapping the execution steps to a reporting application programming interface (API) of the reporting service to generate a mapping; and

generating a report using the mapping.

2. The method of claim 1 , wherein parsing the series of SQL type statements comprises:

generating a JSON object according to an API schema, wherein the JSON object is based the series of SQL type statements; and

forwarding the JSON object to the reporting service.

3. The method of claim 1 , further comprising:

forwarding the report to the user interface.

4. The method of claim 3 , further comprising:

processing, by the generative pretrained transformer machine learning model, the report to generate a fourth natural language text; and

forwarding the fourth natural language text to the user interface.

5. A computer program product comprising non-transitory computer-readable program code that, when executed by a computer processor of a computing system, causes the computing system to perform operations comprising:

iteratively until a confidence satisfies a threshold:

receiving a first natural language text via a user interface,

processing, by a generative pretrained transformer machine learning model, the first natural language text and a context to identify a first intent, wherein:

the generative pretrained transformer machine learning model determines a latent space representation of both encoder and decoder sides of the generative pretrained transformer machine learning model,

each layer of the encoder and decoder sides of the generative pretrained transformer machine learning model comprises a plurality of sublayers,

the plurality of sublayers each comprise a multi-head self-attention layer and a position wise feed forward network layer that uses a fully connected network to process the multi-head self-attention layer, and

processing by the generative pretrained transformer machine learning model comprises: executing the encoder and decoder sides of the generative pretrained transformer machine learning model on the first natural language text and the context, to insert a set of learnable prompt embeddings that are generated using a series of example prompts and corresponding completions, and to identify the first intent,

mapping, by a generative transformer machine learning model, the first intent to a first query, wherein the mapping is associated with a first confidence,

processing the first query to generate a clarification question in natural language text when the confidence fails to satisfy the threshold, and

populating the user interface with the clarification question when the confidence fails to satisfy the threshold wherein prompt and completion pairs are encoded in JAVASCRIPT® object notation language (JSON) to fine-tune the generative pretrained transformer machine learning model;

processing, by the generative transformer machine learning model, the first intent and the first query to generate a series of structured query language (SQL) type statements, wherein the processing is performed when the confidence satisfies the threshold;

parsing the series of SQL type statements into a query object comprising a JSON payload comprising a series of execution steps;

forwarding the query object to a reporting service;

mapping the execution steps to a reporting application programming interface (API) of the reporting service to generate a mapping; and

generating a report using the mapping.

6. The computer program product of claim 5 , wherein parsing the series of SQL type statements comprises:

generating a JSON object according to an API schema, wherein the JSON object is based on the series of execution steps; and

forwarding the JSON object to the reporting service.

7. The computer program product of claim 5 , the operations further comprising:

forwarding the report to the user interface.

8. The computer program product of claim 7 , the operations further comprising:

processing, by the generative pretrained transformer machine learning model, the report to generate a fourth natural language text; and

forwarding the fourth natural language text to the user interface.

9. A system comprising:

a computer processor;

memory; and

instructions stored in the memory and executable by the computer processor to cause the computer processor to perform operations, the operations comprising:

iteratively until a confidence satisfies a threshold:

receiving a first natural language text via a user interface,

processing, by a generative pretrained transformer machine learning model, the first natural language text and a context to identify a first intent, wherein:

the generative pretrained transformer machine learning model determines a latent space representation of both encoder and decoder sides of the generative pretrained transformer machine learning model,

each layer of the encoder and decoder sides of the generative pretrained transformer machine learning model comprises a plurality of sublayers,

the plurality of sublayers each comprise a multi-head self-attention layer and a position wise feed forward network layer that uses a fully connected network to process the multi-head self-attention layer, and

processing by the generative pretrained transformer machine learning model comprises: executing the encoder and decoder sides of the generative pretrained transformer machine learning model on the first natural language text and the context, to insert a set of learnable prompt embeddings that are generated using a series of example prompts and corresponding completions, and to identify the first intent,

mapping, by a generative transformer machine learning model, the first intent to a first query associated with the confidence,

processing the first query to generate a clarification question in natural language text when the confidence fails to satisfy the threshold, and

populating the user interface with the clarification question when the confidence fails to satisfy the threshold wherein prompt and completion pairs are encoded in JAVASCRIPT® object notation language (JSON) to fine-tune the generative pretrained transformer machine learning model,

processing, by the generative transformer machine learning model, the first intent and the first query to generate a series of structured query language (SQL) type statements, wherein the processing is performed when the confidence satisfies the threshold,

parsing the series of SQL type statements into a query object comprising a JSON payload comprising a series of execution steps;

forwarding the query object to a reporting service,

mapping the execution steps to a reporting application programming interface (API) of the reporting service to generate a mapping, and

generating a report using the mapping.

10. The system of claim 9 , wherein parsing the series of SQL type statements comprises:

generating a JSON object according to an API schema, wherein the JSON object is based the series of execution steps; and

forwarding the JSON object to the reporting service.

11. The system of claim 9 , further comprising:

forwarding the report to the user interface.

12. The system of claim 11 , further comprising:

processing, by the generative pretrained transformer machine learning model, the report to generate a new natural language text; and

forwarding the new natural language text to the user interface.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2022
From: KALLEPALLI, GOUTHAM; BECKER, RICHARD J.; IDOWU, OLABODE; FINEGAN, CORRINE
To: INTUIT INC.
Reel/Frame 062018/0567 →
Continuity (1)
Related Publication 20240037327A1 · Feb 1, 2024
References Cited (22)
US 10654380B2 · Chang · 2020 [cited by examiner]
US 10726002B1 · Srivastava · 2020 [cited by examiner]
US 10733993B2 · Kudurshian · 2020 [cited by examiner]
US 11520815B1 · Gutta · 2022 [cited by examiner]
US 20180095962A1 · Anderson · 2018 [cited by examiner]
US 20190103111A1 · Tiwari · 2019 [cited by examiner]
US 20190370629A1 · Liu · 2019 [cited by examiner]
US 20210104236A1 · Doggett · 2021 [cited by examiner]
US 20220092272A1 · Swift · 2022 [cited by examiner]
US 20220101276A1 · Banatao · 2022 [cited by examiner]
US 20220156823A1 · Tremblay · 2022 [cited by examiner]
US 20220180056A1 · Hong · 2022 [cited by examiner]
US 20220229832A1 · Li · 2022 [cited by examiner]
US 20220366153A1 · Li · 2022 [cited by examiner]
US 20230197067A1 · Robert Jose et al. · 2023 [cited by examiner]
US 20230237281A1 · Yarlagadda · 2023 [cited by examiner]
US 20240020484A1 · Will, IV · 2024 [cited by examiner]
“JSON.” Wikipedia, Feb. 15, 2020, https://en.wikipedia.org/wiki/JSON. Accessed Aug. 9, 2024 via web.archive.org. URL: https://web.archive.org/web/20200215034517/https://en.wikipedia.org/wiki/JSON (Year: 2020). [cited by examiner]
Yao et al. “Model-based Interactive Semantic Parsing: A Unified Framework and A Text-to-SQL Case Study.” Aclanthology, 2019, https://aclanthology.org/D19-1547.pdf. Accessed Jan. 23, 2025. (Year: 2019). [cited by examiner]
Zeng et al. “Photon: A Robust Cross-Domain Text-to-SQL System.” arXiv, Aug. 3, 2020, https://arxiv.org/pdf/2007.15280. Accessed Jan. 23, 2025. (Year: 2020). [cited by examiner]
Rajkumar et al. “Evaluating the Text-to-SQL Capabilities of Large Language Models.” arXiv, Mar. 15, 2022, https://arxiv.org/pdf/2204.00498. Accessed Jan. 23, 2025. (Year: 2022). [cited by examiner]
Yu et al. “SyntaxSQLNet: Syntax Tree Networks for Complex and Cross-Domain Text-to-SQL Task.” arXiv, Oct. 25, 2018, https://arxiv.org/pdf/1810.05237. Accessed Jan. 23, 2025. (Year: 2018). [cited by examiner]