IP Library Granted Patent US 12,578,934
Granted Patent B2
US 12,578,934 · App. 18/468,025 · Granted Mar 17, 2026

Visual programming platform featuring machine learning for automated code development

Inventors: Ruofei Du (San Francisco, CA); Zhongyi Zhou (San Francisco, CA)
Assignee: GOOGLE LLC
G06F8/34G06F8/33
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,578,934
App. No.
18/468,025
Granted
Mar 17, 2026
Kind
B2
Abstract

A visual programming platform can leverage a machine learning-based coding system to generate an initial set of programming-language code for further graphical editing by a human user. As an example, the visual programming platform can obtain a natural language description of a task to be performed by a computational pipeline. The visual programming platform can process the natural language description of the task with a machine learning coding system that includes one or more machine-learned models to generate, as an output of the machine learning coding system, a set of pseudocode that describes performance of the task. The platform can process the set of pseudocode that describes performance of the task with a compiler to generate a set of programming-language code that defines the computational pipeline for performing the task. The visual programming platform can generate a graphical visualization of the computational pipeline defined by the set of programming-language code.

Claims (35)

1 . A visual programming platform that enables the graphical development of software code, the visual programming platform comprising one or more processors, the visual programming platform configured to perform operations, the operations comprising:

obtaining a natural language description of a task to be performed by a computational pipeline;

processing the natural language description of the task with a machine learning coding system comprising one or more machine-learned models to generate, as an output of the machine learning coding system, a set of pseudocode that describes performance of the task;

processing the set of pseudocode that describes performance of the task with a compiler to generate a set of programming-language code that defines the computational pipeline for performing the task;

generating a graphical visualization of the computational pipeline defined by the set of programming-language code; and

providing the graphical visualization of the computational pipeline for display in an interactive user interface that enables a human user to edit the graphical visualization to modify the set of programming-language code.

2 . The visual programming platform of claim 1 , wherein the machine learning coding system comprises one or more large language models.

3 . The visual programming platform of claim 1 , wherein the machine learning coding system comprises a machine-learned pseudocode drafting model configured to process the natural language description of the task to generate the set of pseudocode that describes performance of the task.

4 . The visual programming platform of claim 3 , wherein the machine learning coding system comprises a machine-learned node selection model configured to process the natural language description of the task to select one or more selected nodes from a library of nodes, wherein the one or more selected nodes are identified to the machine-learned pseudocode drafting model.

5 . The visual programming platform of claim 4 , wherein the one or more selected nodes are identified in a prompt supplied to the machine-learned pseudocode drafting model.

6 . The visual programming platform of claim 5 , wherein the prompt comprises a few-shot prompt that provides one or more examples of pseudocode output.

7 . The visual programming platform of claim 1 , wherein the natural language description of the task to be performed by the computational pipeline is input by the human user.

8 . The visual programming platform of claim 1 , wherein the computational pipeline comprises a machine learning pipeline that executes one or more machine learning models to process a pipeline input to generate a pipeline output.

9 . The visual programming platform of claim 1 , wherein the graphical visualization of the computational pipeline comprises an editable node-graph.

10 . A computer-implemented method for finetuning a sequence processing model to perform a pseudocode drafting task, the method comprising:

obtaining, by a computing system comprising one or more computing devices, a training tuple, the training tuple comprising a natural language description of a computational pipeline and a set of programming-language code that defines the computational pipeline;

decompiling, by the computing system, the set of programming-language code to generate a set of ground truth pseudocode;

processing, by the computing system, the natural language description of the computational pipeline with the sequence processing model to generate a set of predicted pseudocode;

evaluating, by the computing system, a loss function that compares the set of predicted pseudocode with the set of ground truth pseudocode; and

modifying, by the computing system, one or more values of one or more parameters of the sequence processing model based on the loss function.

11 . The computer-implemented method of claim 10 , wherein the natural language description was generated by a human.

12 . The computer-implemented method of claim 10 , wherein the natural language description was generated by a machine learning model.

13 . The computer-implemented method of claim 10 , wherein decompiling, by the computing system, the set of programming-language code to generate a set of ground truth pseudocode comprises applying, by the computing system, a set of inverse compiling rules to the set of programming-language code.

14 . The computer-implemented method of claim 10 , wherein the loss function evaluates whether the set of predicted pseudocode contains the same number, type, or sequence of nodes as the set of ground truth pseudocode.

15 . One or more non-transitory computer-readable media that store computer-executable instructions that, when executed, cause a computing system to perform operations, the operations comprising:

obtaining a natural language description of a task to be performed by a computational pipeline;

processing the natural language description of the task with a machine learning coding system comprising one or more machine-learned models to generate, as an output of the machine learning coding system, a set of pseudocode that describes performance of the task;

processing the set of pseudocode that describes performance of the task with a compiler to generate a set of programming-language code that defines the computational pipeline for performing the task;

generating a graphical visualization of the computational pipeline defined by the set of programming-language code; and

providing the graphical visualization of the computational pipeline for display in an interactive user interface that enables a human user to edit the graphical visualization to modify the set of programming-language code.

16 . The one or more non-transitory computer-readable media of claim 15 , wherein the machine learning coding system comprises one or more large language models.

17 . The one or more non-transitory computer-readable media of claim 15 , wherein the machine learning coding system comprises a machine-learned pseudocode drafting model configured to process the natural language description of the task to generate the set of pseudocode that describes performance of the task.

18 . The one or more non-transitory computer-readable media of claim 17 , wherein the machine learning coding system comprises a machine-learned node selection model configured to process the natural language description of the task to select one or more selected nodes from a library of nodes, wherein the one or more selected nodes are identified to the machine-learned pseudocode drafting model.

19 . The one or more non-transitory computer-readable media of claim 18 , wherein the one or more selected nodes are identified in a prompt supplied to the machine-learned pseudocode drafting model.

20 . The one or more non-transitory computer-readable media of claim 19 , wherein the prompt comprises a few-shot prompt that provides one or more examples of pseudocode output.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2023
From: DU, RUOFEI; ZHOU, ZHONGYI
To: GOOGLE LLC
Reel/Frame 064920/0159 →
Continuity (1)
Related Publication 20250094137A1 · Mar 20, 2025
References Cited (4)
US 7000191B2 · Schmitt · 2006 [cited by examiner]
US 9720983B1 · Yu · 2017 [cited by examiner]
US 11609748B2 · Bahrami · 2023 [cited by examiner]
US 12007877B1 · Garg · 2024 [cited by examiner]