IP Library › Granted Patent US 12,282,719
Granted Patent B1
US 12,282,719 · App. 18/775,938 · Granted Apr 22, 2025

Building and simulating execution of managed artificial intelligence pipelines

Inventors: Roman Fedoruk (Cumming, GA); John Manton (Alpharetta, GA); Spencer Reagan (Marietta, GA); Gregory Roberts (Alpharetta, GA); Erich Stuntebeck (Johns Creek, GA)
Assignee: Airia LLC
G06F30/27
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,282,719
App. No.
18/775,938
Filed
Jul 17, 2024
Granted
Apr 22, 2025
Kind
B1
Art Unit
2616
USPC
703/22
Abstract

Systems and methods are described for building artificial intelligence (“AI”) pipelines. A user interface (UI) includes selectable pipeline objects, such as a dataset and an AI model, that a user can position and connect on the screen. This causes execution linking between the selected pipeline objects, with the execution linking being visually displayed in the UI. A management policy can be applied to the pipeline, including user or device requirements for accessing the dataset in the pipeline. Then the UI can present a simulated execution of the AI pipeline, in which a test query is input and the pipeline objects execute in an order displayed in the UI. The pipeline can then be deployed for access at an endpoint.

Claims (61)

1. A method of creating an artificial intelligence (AI) pipeline, comprising:

receiving a selection of pipeline objects on a user interface (UI), the selected pipeline objects including a dataset object and an AI model, wherein the dataset object includes at least one vector database;

receiving inputs to the UI to arrange the selected pipeline objects in an AI pipeline, including causing an execution linking between the selected dataset object and the AI model to be established, wherein the UI visually represents the established execution linking between the pipeline objects, wherein the pipeline objects are moveable within the UI by a user, and wherein the AI pipeline is displayed as an execution flow within the UI,

wherein establishing the execution linking between the selected dataset object and AI model comprises validating that outputs from the selected dataset object can be used as inputs to the AI model;

causing a management policy to be applied to the dataset object, compliance with the management policy being a prerequisite for accessing the dataset object through an execution of the AI pipeline, wherein the UI visually represents the application of the management policy to the dataset object,

wherein enforcing the management policy includes verifying at least one of device location and a device security state based on a profile, and wherein the AI pipeline includes a conditional execution alternative based on noncompliance with the management policy;

causing a simulated execution of the AI pipeline to be displayed within the UI, including:

receiving a query in the UI;

receiving compliance information;

causing the selected pipeline objects to be executed in an order that follows the execution linking displayed within the UI and applies the management policy based on the compliance information; and

causing an output of the simulated execution to be displayed in the UI; and

causing the AI pipeline to be deployed, wherein the deployed AI pipeline is accessible by at least one AI application through a generated endpoint.

2. The method of claim 1 , wherein causing the execution linking between the selected dataset object and AI model to be established comprises causing a pipeline manifest file to be generated which stores the arrangement of pipeline objects in the AI pipeline.

3. The method of claim 2 , further comprising:

validating the pipeline manifest against a dependency rule, wherein the dependency rule dictates an event that must occur before at least one of the selected pipeline objects can execute; and

displaying, within the UI, a validation of the pipeline manifest.

4. The method of claim 1 , wherein the method further comprises, prior to displaying the selected pipeline objects, determining that a computing device through which the UI is displayed is compliant with at least one pipeline administrative user policy, wherein compliance with the pipeline administrative user policy is determined at least in part on information received from a management agent that executes on the computing device.

5. The method of claim 1 , wherein prior to displaying the selected pipeline objects in the UI, the method further comprises authenticating the user based on a user identifier and a tenant identifier.

6. The method of claim 1 , wherein the selected pipeline objects are selected from a displayed menu that includes at least one of AI model prompts, datasets, AI models, and executable code objects, and wherein one of the executable code objects is a conditional object that allows user selection of an if-then statement for at least two branches within the AI pipeline.

7. The method of claim 1 , wherein the management policy requires that an end user attempting to access the AI application is authorized to access the dataset object based at least in part on the end user being associated with an identifier of an authorized group and a client device of the end user being compliant with at least one pipeline end user policy, the client device of the end user being a computing device through which the attempt to access the AI application is attempted.

8. A non-transitory, computer-readable medium including instructions are executed by a processor and cause the processor to perform stages for creating an artificial intelligence (AI) pipeline, the stages comprising:

receiving a selection of pipeline objects on a user interface (UI), the selected pipeline objects including a dataset object and an AI model, wherein the dataset object includes at least one vector database;

receiving inputs to the UI to arrange the selected pipeline objects in an AI pipeline, including causing an execution linking between the selected dataset object and AI model to be established, wherein the UI visually represents the established execution linking between the pipeline objects, wherein the pipeline objects are moveable by a user within the UI, and wherein the AI pipeline is displayed as an execution flow within the UI,

wherein establishing the execution linking between the selected dataset object and AI model comprises validating that outputs from the selected dataset object can be used as inputs to the AI model;

causing a management policy to be applied to the dataset object, compliance with the management policy being a prerequisite for accessing the dataset object through an execution of the AI pipeline, wherein the UI visually represents the application of the management policy to the dataset object,

wherein enforcing the management policy includes verifying at least one of device location and a device security state based on a profile, and wherein the AI pipeline includes a conditional execution alternative based on noncompliance with the management policy;

causing a simulated execution of the AI pipeline to be displayed within the UI, including:

receiving a query in the UI;

receiving compliance information;

causing the selected pipeline objects to be executed in an order that follows the execution linking displayed within the UI and applies the management policy based on the compliance information; and

causing an output of the simulated execution to be displayed in the UI; and

causing the AI pipeline to be deployed, wherein the deployed AI pipeline is accessible by at least one AI application through a generated endpoint.

9. The non-transitory, computer-readable medium of claim 8 , wherein causing the execution linking between the selected dataset object and AI model to be established comprises causing a pipeline manifest file to be generated which stores the arrangement of pipeline objects in the AI pipeline.

10. The non-transitory, computer-readable medium of claim 9 , the stages further comprising:

validating the pipeline manifest against a dependency rule, wherein the dependency rule dictates an event that must occur before at least one of the selected pipeline objects can execute; and

displaying, within the UI, a validation of the pipeline manifest.

11. The non-transitory, computer-readable medium of claim 8 , wherein the stages further comprise, prior to displaying the selected pipeline objects, determining that a computing device through which the UI is displayed is compliant with at least one pipeline administrative user policy, wherein compliance with the pipeline administrative user policy is determined at least in part on information received from a management agent that executes on the computing device.

12. The non-transitory, computer-readable medium of claim 8 , wherein prior to displaying the selected pipeline objects in the UI, the stages further comprise authenticating the user based on a user identifier and a tenant identifier.

13. The non-transitory, computer-readable medium of claim 8 , wherein the selected pipeline objects are selected from a displayed menu that includes at least one of AI model prompts, datasets, AI models, and executable code objects, and wherein one of the executable code objects is a conditional object that allows user selection of an if-then statement for at least two branches within the AI pipeline.

14. The non-transitory, computer-readable medium of claim 8 , wherein the management policy requires that an end user attempting to access the AI application is authorized to access the dataset object based at least in part on the end user being associated with an identifier of an authorized group and a client device of the end user being compliant with at least one pipeline end user policy, the client device of the end user being a computing device through which the attempt to access the AI application is attempted.

15. A system for creating an artificial intelligence (AI) pipeline, comprising:

a memory storage including a non-transitory, computer-readable medium comprising instructions; and

a hardware-based processor that executes the instructions to carry out stages comprising:

receiving a selection of pipeline objects on a user interface (UI), the selected pipeline objects including a dataset object and an AI model, wherein the dataset object includes at least one vector database;

receiving inputs to the UI to arrange the selected pipeline objects in an AI pipeline, including causing an execution linking between the selected dataset object and AI model to be established, wherein the UI visually represents the established execution linking between the pipeline objects, wherein the pipeline objects are moveable by a user within the UI, and wherein the AI pipeline is displayed as an execution flow within the UI,

wherein establishing the execution linking between the selected dataset object and AI model comprises validating that outputs from the selected dataset object can be used as inputs to the AI model;

causing a management policy to be applied to the dataset object, compliance with the management policy being a prerequisite for accessing the dataset object through an execution of the AI pipeline, wherein the UI visually represents the application of the management policy to the dataset object,

wherein enforcing the management policy includes verifying at least one of device location and a device security state based on a profile, and wherein the AI pipeline includes a conditional execution alternative based on noncompliance with the management policy;

causing a simulated execution of the AI pipeline to be displayed within the UI, including:

receiving a query in the UI;

receiving compliance information;

causing the selected pipeline objects to be executed in an order that follows the execution linking displayed within the UI and applies the management policy based on the compliance information; and

causing an output of the simulated execution to be displayed in the UI; and

causing the AI pipeline to be deployed, wherein the deployed AI pipeline is accessible by at least one AI application through a generated endpoint.

16. The system of claim 15 , wherein causing the execution linking between the selected dataset object and AI model to be established comprises causing a pipeline manifest file to be generated which stores the arrangement of pipeline objects in the AI pipeline.

17. The system of claim 16 , the stages further comprising:

validating the pipeline manifest against a dependency rule, wherein the dependency rule dictates an event that must occur before at least one of the selected pipeline objects can execute; and

displaying, within the UI, a validation of the pipeline manifest.

18. The system of claim 15 , wherein the stages further comprise, prior to displaying the selected pipeline objects, determining that a computing device through which the UI is displayed is compliant with at least one pipeline administrative user policy, wherein compliance with the pipeline administrative user policy is determined at least in part on information received from a management agent that executes on the computing device.

19. The system of claim 15 , wherein prior to displaying the selected pipeline objects in the UI, the stages further comprise authenticating the user based on a user identifier and a tenant identifier.

20. The system of claim 15 , wherein the selected pipeline objects are selected from a displayed menu that includes at least one of AI model prompts, datasets, AI models, and executable code objects, and wherein one of the executable code objects is a conditional object that allows user selection of an if-then statement for at least two branches within the AI pipeline.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2024
From: FEDORUK, ROMAN; MANTON, JOHN; REAGAN, SPENCER; ROBERTS, GREGORY; STUNTEBECK, ERICH
To: AIRIA LLC
Reel/Frame 069564/0657 →
Continuity (2)
Provisional Application 63658434 · Jun 10, 2024
Provisional Application 63650487 · May 22, 2024
References Cited (152)
US 9495133B1 · Righi et al. · 2016 [cited by applicant]
US 9811074B1 · Aichele · 2017 [cited by examiner]
US 9823950B1 · Carrier · 2017 [cited by examiner]
US 10643144B2 · Bowers · 2020 [cited by examiner]
US 10824703B1 · Desai · 2020 [cited by examiner]
US 10902705B1 · Rose · 2021 [cited by examiner]
US 10983904B1 · Sundararaman · 2021 [cited by examiner]
US 11074107B1 · Nandakumar · 2021 [cited by examiner]
US 11113470B2 · Nelson · 2021 [cited by examiner]
US 11119985B1 · Alagianambi · 2021 [cited by examiner]
US 11636401B2 · Dhingra · 2023 [cited by examiner]
US 11734027B2 · Katahanas · 2023 [cited by examiner]
US 11748634B1 · Kulkarni · 2023 [cited by examiner]
US 11922153B2 · Jones · 2024 [cited by examiner]
US 11989537B2 · de Jong · 2024 [cited by examiner]
US 12086153B1 · Kannan · 2024 [cited by examiner]
US 12118338B1 · Benamu · 2024 [cited by examiner]
US 12131233B1 · Kulkarni · 2024 [cited by examiner]
US 20080281768A1 · Sadeh · 2008 [cited by examiner]
US 20100138368A1 · Stundner · 2010 [cited by examiner]
US 20110161920A1 · Alexander · 2011 [cited by examiner]
US 20110213712A1 · Hadar et al. · 2011 [cited by applicant]
US 20140170606A1 · Chong · 2014 [cited by examiner]
US 20140287397A1 · Chong · 2014 [cited by examiner]
US 20150199010A1 · Coleman · 2015 [cited by examiner]
US 20150277900A1 · O'Keeffe · 2015 [cited by examiner]
US 20150277901A1 · Karle · 2015 [cited by examiner]
US 20150309695A1 · Sannandeji · 2015 [cited by examiner]
US 20160063512A1 · Greenspan · 2016 [cited by examiner]
US 20160092178A1 · Geng · 2016 [cited by examiner]
US 20160103659A1 · Tijanic · 2016 [cited by examiner]
US 20160358099A1 · Sturlaugson · 2016 [cited by examiner]
US 20180052861A1 · Seetharaman · 2018 [cited by examiner]
US 20180089582A1 · Bouillet · 2018 [cited by examiner]
US 20180152564A1 · Lang et al. · 2018 [cited by applicant]
US 20180268244A1 · Moazzami · 2018 [cited by examiner]
US 20180314971A1 · Chen et al. · 2018 [cited by applicant]
US 20180349527A1 · Li · 2018 [cited by examiner]
US 20190079643A1 · Kershaw · 2019 [cited by examiner]
US 20190206390A1 · Rotem · 2019 [cited by examiner]
US 20190311095A1 · Paeschke · 2019 [cited by examiner]
US 20190384461A1 · Seif · 2019 [cited by examiner]
US 20190384577A1 · Seif · 2019 [cited by examiner]
US 20190384615A1 · Kernert · 2019 [cited by examiner]
US 20190384635A1 · Seif · 2019 [cited by examiner]
US 20190384659A1 · Johannsen · 2019 [cited by examiner]
US 20200151588A1 · Doan Huu · 2020 [cited by examiner]
US 20200242279A1 · Malkosh · 2020 [cited by examiner]
US 20200257567A1 · Fontanari Filho et al. · 2020 [cited by applicant]
US 20200264437A1 · Kobayashi · 2020 [cited by examiner]
US 20200265509A1 · Kumar Addepalli et al. · 2020 [cited by applicant]
US 20200294201A1 · Planche · 2020 [cited by examiner]
US 20200349469A1 · Katzenberger · 2020 [cited by examiner]
US 20200379755A1 · Boada · 2020 [cited by examiner]
US 20210081819A1 · Polleri · 2021 [cited by examiner]
US 20210081837A1 · Polleri · 2021 [cited by examiner]
US 20210081841A1 · Sikka · 2021 [cited by examiner]
US 20210081848A1 · Polleri · 2021 [cited by examiner]
US 20210117868A1 · Sriharsha · 2021 [cited by examiner]
US 20210150411A1 · Coenders · 2021 [cited by examiner]
US 20210192111A1 · Hoyer · 2021 [cited by examiner]
US 20210241170A1 · Sarferaz · 2021 [cited by examiner]
US 20210312276A1 · Rawat · 2021 [cited by examiner]
US 20210326736A1 · Kishimoto · 2021 [cited by examiner]
US 20210342738A1 · Sarferaz · 2021 [cited by examiner]
US 20220004914A1 · Kirchner · 2022 [cited by examiner]
US 20220036232A1 · Patel · 2022 [cited by examiner]
US 20220038490A1 · Thakur · 2022 [cited by examiner]
US 20220051049A1 · Wang · 2022 [cited by examiner]
US 20220051112A1 · Wang · 2022 [cited by examiner]
US 20220066905A1 · Lee · 2022 [cited by examiner]
US 20220067181A1 · Carley · 2022 [cited by examiner]
US 20220067199A1 · Taber · 2022 [cited by examiner]
US 20220121988A1 · Margineantu · 2022 [cited by examiner]
US 20220129786A1 · da Silva · 2022 [cited by examiner]
US 20220138004A1 · Nandakumar · 2022 [cited by examiner]
US 20220188691A1 · Katz · 2022 [cited by examiner]
US 20220207163A1 · Gentleman · 2022 [cited by examiner]
US 20220229636A1 · Nayak · 2022 [cited by examiner]
US 20220275610A1 · Bohorquez Arevalo · 2022 [cited by examiner]
US 20220300850A1 · Mendez · 2022 [cited by examiner]
US 20220308903A1 · Chakraborty · 2022 [cited by examiner]
US 20220309337A1 · Copty · 2022 [cited by examiner]
US 20220329594A1 · Fan · 2022 [cited by examiner]
US 20220343020A1 · Farre Guiu · 2022 [cited by examiner]
US 20220374457A1 · Parkhe · 2022 [cited by examiner]
US 20220384057A1 · Gopalakrishnan · 2022 [cited by examiner]
US 20220414530A1 · Cmielowski · 2022 [cited by examiner]
US 20230022775A1 · Soenksen Martinez · 2023 [cited by examiner]
US 20230059857A1 · Dolby · 2023 [cited by examiner]
US 20230108560A1 · Wang · 2023 [cited by examiner]
US 20230114013A1 · Marinescu · 2023 [cited by examiner]
US 20230129665A1 · Kumar · 2023 [cited by examiner]
US 20230177388A1 · Cornec · 2023 [cited by examiner]
US 20230229976A1 · Cheng · 2023 [cited by examiner]
US 20230230351A1 · Abdollahian · 2023 [cited by examiner]
US 20230244968A1 · Gurin · 2023 [cited by examiner]
US 20230259817A1 · Grayson · 2023 [cited by examiner]
US 20230289148A1 · Wang · 2023 [cited by examiner]
US 20230289444A1 · Ermey · 2023 [cited by examiner]
US 20230297863A1 · Chen · 2023 [cited by examiner]
US 20230306859A1 · Foias · 2023 [cited by examiner]
US 20230316123A1 · Liu · 2023 [cited by examiner]
US 20230342623A1 · Grayson · 2023 [cited by examiner]
US 20230351049A1 · Annau · 2023 [cited by examiner]
US 20230359746A1 · Wang · 2023 [cited by examiner]
US 20230368078A1 · Arpit · 2023 [cited by examiner]
US 20230368773A1 · Mishra · 2023 [cited by examiner]
US 20230376296A1 · Nomula · 2023 [cited by examiner]
US 20230384746A1 · Reynolds · 2023 [cited by examiner]
US 20230409654A1 · Ziv · 2023 [cited by examiner]
US 20230418243A1 · Reynolds · 2023 [cited by examiner]
US 20230419168A1 · Reynolds · 2023 [cited by examiner]
US 20240019853A1 · Reynolds · 2024 [cited by examiner]
US 20240031387A1 · Reynolds · 2024 [cited by examiner]
US 20240046041A1 · Damo · 2024 [cited by examiner]
US 20240061883A1 · Vadapandeshwara · 2024 [cited by examiner]
US 20240062044A1 · Subramanian · 2024 [cited by examiner]
US 20240089256A1 · Landy · 2024 [cited by examiner]
US 20240095397A1 · Knuesel · 2024 [cited by examiner]
US 20240095463A1 · Leary · 2024 [cited by examiner]
US 20240104394A1 · Skerry-Ryan · 2024 [cited by examiner]
US 20240119364A1 · Jain · 2024 [cited by examiner]
US 20240135198A1 · Ranganathan · 2024 [cited by examiner]
US 20240143343A1 · Hamlin · 2024 [cited by examiner]
US 20240161015A1 · Patel · 2024 [cited by examiner]
US 20240168855A1 · Lopes · 2024 [cited by examiner]
US 20240201957A1 · Chaurasia · 2024 [cited by examiner]
US 20240202458A1 · Zha · 2024 [cited by examiner]
US 20240202466A1 · Zha · 2024 [cited by examiner]
US 20240256241A1 · Dakkak · 2024 [cited by examiner]
US 20240256520A1 · Rapowitz · 2024 [cited by examiner]
US 20240273398A1 · Acharya · 2024 [cited by examiner]
US 20240281419A1 · Alfaras · 2024 [cited by examiner]
US 20240281429A1 · Subramanian · 2024 [cited by examiner]
US 20240289261A1 · Walker · 2024 [cited by examiner]
US 20240296522A1 · Saito · 2024 [cited by examiner]
US 20240303470A1 · Wang · 2024 [cited by examiner]
US 20240311453A1 · Berry · 2024 [cited by examiner]
US 20240319976A1 · Benamu · 2024 [cited by examiner]
US 20240362352A1 · Carao · 2024 [cited by examiner]
US 20240378196A1 · Lester · 2024 [cited by examiner]
US 20240378653A1 · Christiansen · 2024 [cited by examiner]
CN 115374515A · 2022 [cited by applicant]
WO 2019053488A1 · 2019 [cited by applicant]
Desfeux et al., Identification of a Series of Compatible Components using Artificial Intelligence, 2019, World Intellectual PropertyOrganization Patent Cooperation Treaty (PCT), pp. 1-34 (Year: 2019), In consideration o… [cited by applicant]
Ding et al, “Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing”, arXiv preprint arXiv:2404.14618 (Apr. 2024). (Year: 2024). [cited by applicant]
Geronimo, “Evaluating LLMs with Semantic Similarity,” Mar. 2024 [retrieved on Nov. 30, 2024], pp. 1-39, downloaded from :https://medium.com/@geronimo7/semscore-evaluating-llms-with-semantic-similarity-2abf5c2fadb9. (Yea… [cited by applicant]
Hazelwood et al., “Applied Machine Learning at Facebook: A Datacenter Infrastructure Perspective,” 2018 IEEE International Symposium on High Performance Computer Architecture (H PCA), Vienna, Austria, 2018, pp. 620-629,… [cited by applicant]
Lin et al., A Pipeline Design Method for Domestic Design(translation), 2022, Chinese Patent Office, pp. 1-8 (Year: 2022), In consideration of CN 115374515. [cited by applicant]
Lins et al, “Artificial Intelligence as a Service”, Bus Inf Syst Eng 63, 441-456 (2021 ). https://doi .org/10.1007 /s12599-021-00708-w (Year: 2021). [cited by applicant]
Niknazar et al. “Building a domain-specific guardrail model in production.” arXiv preprint arXiv:2408.01452 (Jul. 2024). (Year: 2024). [cited by applicant]
Cited By (11)
US 12,432,240 US 12,493,473 US 12,493,540 US 12,493,829 US 12,547,677 US 12,683,941 US 12,711,263 US 12,737,492 US 12,744,783 US 12,750,208 US 12,750,368