IP Library Granted Patent US 12,498,908
Granted Patent B2
US 12,498,908 · App. 18/375,371 · Granted Dec 16, 2025

Methods and systems for automatically generating and executing computer code using a natural language description of a data manipulation to be performed on a data set

Inventors: Nate Gillman (New York, NY); Nadia Lahlaf (Billerica, MA); Aperahama Parangi (Boston, MA); Jonathon Reilly (Cambridge, MA); Nathan Wies (Brookline, MA)
Assignee: Akkio Inc.
G06F8/35G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,498,908
App. No.
18/375,371
Filed
Sep 29, 2023
Granted
Dec 16, 2025
Kind
B2
Art Unit
2123
USPC
706/12
Abstract

A method for automatically generating and executing computer code includes receiving, by a machine learning engine, a user-specified data set and a user-specified task. The machine learning engine analyzes at least one characteristic of the user-specified data set and at least one characteristic of the user-specified task and generates at least one machine learning model for processing the user-specified data set. The machine learning model generates a first output by processing the user-specified data set. The machine learning engine receives a natural language description of a user-requested data transformation task for execution with a subset of the first output and directs a large language model to identify an archetype of the user-requested data transformation task. The large language model applies the user-requested data transformation task to the subset of the first output using the archetype to generate a second output.

Claims (20)

1 . A method for automatically generating, and executing in real time, computer code using a natural language description of a data manipulation to be performed on a data set, the method comprising:

receiving, by a machine learning engine executing on a computing device, a user-specified data set and a user-specified task;

analyzing, by the machine learning engine, at least one characteristic of the user-specified data set and at least one characteristic of the user-specified task;

generating, by the machine learning engine, at least one machine learning model for processing the user-specified data set, wherein generating further comprises generating the at least one machine learning model based upon the at least one characteristic of the user-specified data set and at least one characteristic of the user-specified task and wherein generating further comprises executing a neural architecture search to progressively build an ensemble of a plurality of machine learning models;

directing, by the machine learning engine, the at least one machine learning model to generate a first output by processing the user-specified data set;

receiving, by the machine learning engine, a natural language description of a second user-requested data transformation task for execution with a subset of the first output;

directing, by the machine learning engine, a large language model to identify an archetype of the user-requested data transformation task;

applying, by the large language model, the user-requested data transformation task to the subset of the first output using the archetype to generate a second output, wherein applying further comprises generating, by a data set preparation engine, executable code for performing the user-requested data transformation task;

executing, by the computing device, the generated executable code with the subset of the first output; and

displaying, by a user interface engine in communication with the machine learning engine, to a user, a user interface including a display of the second output.

2 . The method of claim 1 , wherein receiving the natural language description of the user-requested data transformation task further comprises receiving a prompt to generate executable computer code.

3 . The method of claim 1 further comprising generating, by the large language model, executable computer code in a computer programming language specified in the natural language description of the user-requested data transformation task.

4 . The method of claim 3 wherein applying further comprises executing the generated executable computer code.

5 . A method for automatically generating, and executing in real time, computer code using a natural language description of a data manipulation to be performed on a data set, the method comprising:

receiving, by a machine learning engine executing on a computing device, a user-specified data set and a natural language description of a user-requested data transformation task for execution with a subset of the user-specified data set;

directing, by the machine learning engine, a large language model to generate at least one candidate executable computer code for performing the user-requested data transformation task;

generating, by the large language model in communication with a data set preparation engine, the at least one candidate executable computer code;

performing, by the machine learning engine, at least one validation check on the at least one candidate executable computer code;

executing, by the machine learning engine, the at least one candidate executable computer code to generate a transformation result; and

modifying, by a user interface engine in communication with the machine learning engine, a user interface to display to a user a sample of the transformation result.

Assignments (2)
CONFIRMATION OF ASSIGNMENT Recorded Oct 20, 2025
From: GILLMAN, NATE; LAHLAF, NADIA; PARANGI, APERAHAMA; REILLY, JONATHON; WIES, NATHAN
To: AKKIO INC.
Reel/Frame 073140/0677 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2023
From: GILLMAN, NATE; LAHLAF, NADIA; PARANGI, APERAHAMA; REILLY, JONATHON; WIES, NATHAN
To: AKKIO, INC.
Reel/Frame 065163/0911 →
Continuity (3)
Continuation In Part 17158681 · Jan 26, 2021
Provisional Application 63411898 · Sep 30, 2022
Related Publication 20240028312A1 · Jan 25, 2024
References Cited (64)
US 6453465B1 · Klein · 2002 [cited by applicant]
US 8903711B2 · Lundberg · 2014 [cited by applicant]
US 9619209B1 · Allen · 2017 [cited by examiner]
US 9652714B2 · Achin et al. · 2017 [cited by applicant]
US 9939792B2 · Chen · 2018 [cited by applicant]
US 10360482B1 · Khare · 2019 [cited by applicant]
US 10366346B2 · Achin et al. · 2019 [cited by applicant]
US 10431328B1 · Wang · 2019 [cited by applicant]
US 10592386B2 · Walters et al. · 2020 [cited by applicant]
US 10600005B2 · Gunes et al. · 2020 [cited by applicant]
US 11176329B2 · Vaithiyanathan · 2021 [cited by applicant]
US 20050165712A1 · Araki · 2005 [cited by applicant]
US 20140022100A1 · Fallon · 2014 [cited by applicant]
US 20160071014A1 · Brand · 2016 [cited by applicant]
US 20170300814A1 · Shaked · 2017 [cited by applicant]
US 20180174047A1 · Bourdev et al. · 2018 [cited by applicant]
US 20190050319A1 · Gondalia · 2019 [cited by applicant]
US 20190197011A1 · Zavesky · 2019 [cited by applicant]
US 20190213115A1 · Takawale · 2019 [cited by applicant]
US 20190251439A1 · Zoph · 2019 [cited by applicant]
US 20190261243A1 · Amini et al. · 2019 [cited by applicant]
US 20190347621A1 · White · 2019 [cited by applicant]
US 20200012584A1 · Walters et al. · 2020 [cited by applicant]
US 20200012935A1 · Goodsitt et al. · 2020 [cited by applicant]
US 20200034665A1 · Ghanta et al. · 2020 [cited by applicant]
US 20200090075A1 · Achin et al. · 2020 [cited by applicant]
US 20200125568A1 · Idicula et al. · 2020 [cited by applicant]
US 20200134489A1 · Achin et al. · 2020 [cited by applicant]
US 20200242505A1 · Raz et al. · 2020 [cited by applicant]
US 20200245009A1 · Saini et al. · 2020 [cited by applicant]
US 20200342265A1 · Cai et al. · 2020 [cited by applicant]
US 20200349464A1 · Lin et al. · 2020 [cited by applicant]
US 20200356762A1 · Wang et al. · 2020 [cited by applicant]
US 20200356857A1 · Lee et al. · 2020 [cited by applicant]
US 20200401899A1 · Dohan et al. · 2020 [cited by applicant]
US 20210081819A1 · Polleri · 2021 [cited by examiner]
US 20210232920A1 · Parangi · 2021 [cited by applicant]
US 20210256217A1 · Vaithiyanathan · 2021 [cited by examiner]
CN 110489102 · 2019 [cited by applicant]
CN 112748906 · 2021 [cited by applicant]
CN 116400901 · 2023 [cited by applicant]
EP 3355248A2 · 2018 [cited by applicant]
JP 2023018851 · 2023 [cited by applicant]
KR 102511568B1 · 2023 [cited by applicant]
WO 2018112514A1 · 2018 [cited by applicant]
WO 2018223037A1 · 2018 [cited by applicant]
WO 2018226492A1 · 2018 [cited by applicant]
WO 2020204904A1 · 2020 [cited by applicant]
WO 2020214428A1 · 2020 [cited by applicant]
WO 2021154722A1 · 2021 [cited by applicant]
WO 2023014370 · 2023 [cited by applicant]
Chen, Mark, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards et al. “Evaluating large language models trained on code.” arXiv preprint arXiv:2107.03374 (2021). (Year: … [cited by examiner]
International Search Report and Written Opinion mailed May 4, 2021, in international patent application No. PCT/US2021/015080, 9 pages. [cited by applicant]
Shin, Jiho, and Jaechang Nam. “A survey of automatic code generation from natural language.” Journal of Information Processing Systems 17.3 (2021): 537-555. [cited by applicant]
International Search Report issued in App. No. PCT/US2023/034209, dated Jan. 19, 2024, 10 pages. [cited by applicant]
Office Action (Non-Final Rejection) dated Dec. 29, 2023 for U.S. Appl. No. 17/158,681 (pp. 1-12). [cited by applicant]
Sarsa, Sami, et al. “Automatic generation of programming exercises and code explanations using large language models.” Proceedings of the 2022 ACM Conference on International Computing Education Research—vol. 1. 2022. [cited by applicant]
Vaithilingam, Priyan, Tianyi Zhang, and Elena L. Glassman. “Expectation vs. experience: Evaluating the usability of code generation tools powered by large language models.” Chi conference on human factors in computing s… [cited by applicant]
Xu, Frank F., et al. “A systematic evaluation of large language models of code.” Proceedings of the 6th ACM SIGPLAN International Symposium on Machine Programming. 2022. [cited by applicant]
Extended European Search Report issued in App. No. EP20210748262, dated Jan. 25, 2024, 14 pages. [cited by applicant]
Li et al., 2006, “Improving Generalization Ability of Neural Networks Ensemble with Multi-Task Learning” (Year: 2006). [cited by applicant]
Office Action (Final Rejection) dated Jul. 12, 2024 for U.S. Appl. No. 17/158,681 (pp. 1-17). [cited by applicant]
Office Action (Final Rejection) dated Jul. 19, 2024 for U.S. Appl. No. 18/375,371 (pp. 1-22). [cited by applicant]
Office Action dated Dec. 11, 2023 for U.S. Appl. No. 18/375,371 (pp. 1-21). [cited by applicant]