AI hallucination and jailbreaking prevention framework
The disclosed embodiments include systems and methods configured to provide a Generative AI framework that uses the power of multiple LLMs by separating the generative aspect into multiple distinct large language models. In some disclosed embodiments, a first large language model evaluates an input prompt and transforms it if needed (e.g., in a first processing stage of the framework); a second large language model performs a generative function based on an input prompt it receives from the first large language model (e.g., in a second processing stage); and a third large language model analyzes and as necessary transforms the output of the second large language model to ensure accuracy, no hallucinations, and no harmful content in the final generated response to the input prompt (e.g., in a third processing stage).
1. A computer system configured to provide a generative artificial intelligence (AI) framework having multiple interconnected large language models, the computer system comprising:
one or more physical processors;
one or more network interfaces configured to receive a user prompt from a user; and
a memory configured to store one or more computer-readable instructions that, when executed by the one or more physical processors, configure the computer system to implement the generative AI framework, the generative AI framework comprising:
a first processing stage comprising a first large language model, wherein the first large language model is configured to process the user prompt received at the one or more network interfaces and generate an updated user prompt, wherein the first large language model is configured to use a first machine learning model to generate the updated user prompt;
a second processing stage comprising a second large language model, wherein the second large language model is configured to process the updated user prompt generated by the first large language model and generate a response to the updated user prompt, wherein the second large language model is configured to use a second machine learning model to generate the response to the updated user prompt; and
a third processing stage comprising a third large language model, wherein the third large language model is configured to process the response to the updated user prompt generated by the second large language model and generate a response to return to the user, wherein the third large language model is configured to use a third machine learning model to generate the response to return to the user, and wherein the third large language model is configured to transform the response to the updated user prompt generated by the second large language model to remove hallucinations from the response.
2. The computer system of claim 1 , wherein the second large language model is configured to process the updated user prompt generated by the first large language model in order to build a generative answer in response to the updated user prompt.
3. The computer system of claim 1 , wherein the third large language model is further configured to transform the response to the updated user prompt generated by the second large language model to remove harmful content from the response.
4. The computer system of claim 1 , wherein each of the first large language model, second large language model, and third large language model comprises a different machine learning model.
5. The computer system of claim 1 , wherein at least one of the first processing stage, second processing stage, or third processing stage comprises an additional large language model.
6. The computer system of claim 1 , wherein at least one of the first large language model, the second large language model, or the third large language model comprises one or more guardrails.
7. The computer system of claim 6 , wherein the at least one of the first large language model, the second large language model, or the third large language model is configured to generate a predefined response based on an application of the one or more guardrails to at least one of input data or output data.
8. The computer system of claim 1 , wherein the first large language model, the second large language model, and the third large language model are configured to generate output data comprising words and phrases.
9. The computer system of claim 1 , wherein the first large language model, the second large language model, and the third large language model each comprises a database for determining probabilities of words and phrases to include in a sequentially generated response.
10. The computer system of claim 1 , wherein at least one of the first large language model, the second large language model, or the third large language model has been trained using an unsupervised machine learning process and further fine-tuned using a supervised machine learning process.
11. The computer system of claim 1 , wherein the remote user communicates the user prompt to the computer system over a network using a cloud service.
12. A computer system configured to provide a generative artificial intelligence (AI) framework having multiple interconnected large language models, the computer system comprising:
one or more physical processors;
one or more network interfaces configured to receive a user prompt from a user; and
a memory configured to store one or more computer-readable instructions that, when executed by the one or more physical processors, configure the computer system to implement the generative AI framework, the generative AI framework comprising:
a first processing stage comprising a first large language model, wherein the first large language model is configured to process the user prompt received at the one or more network interfaces and generate an updated user prompt, wherein the first large language model is configured to use a first machine learning model to generate the updated user prompt, wherein the first large language model is configured to transform the user prompt received at the one or more network interfaces to remove malicious content, jailbreaking content, or content that is outside of a scope of permitted user prompts;
a second processing stage comprising a second large language model, wherein the second large language model is configured to process the updated user prompt generated by the first large language model and generate a response to the updated user prompt, wherein the second large language model is configured to use a second machine learning model to generate the response to the updated user prompt; and
a third processing stage comprising a third large language model, wherein the third large language model is configured to process the response to the updated user prompt generated by the second large language model and generate a response to return to the user, wherein the third large language model is configured to use a third machine learning model to generate the response to return to the user.
13. The computer system of claim 12 , wherein the third large language model is further configured to transform the response to the updated user prompt generated by the second large language model to remove harmful content from the response.
14. The computer system of claim 1 , wherein the first large language model is configured to transform the user prompt received at the one or more network interfaces to remove malicious content, jailbreaking content, or content that is outside of a scope of permitted user prompts.
15. The computer system of claim 12 , wherein the second large language model is configured to process the updated user prompt generated by the first large language model in order to build a generative answer in response to the updated user prompt.
16. A method for providing a generative artificial intelligence (AI) framework having multiple interconnected large language models in a computer system, wherein the computer system comprises one or more processors and a memory configured to store computer-readable instructions that, when executed by the one or more processors, configure the computer system to implement the generative AI framework, the method comprising:
processing, at a first processing stage of the generative AI framework, a user prompt received from a user, the first processing stage comprising a first large language model, wherein the first large language model is configured to process the user prompt and generate an updated user prompt using a first machine learning model;
processing, at a second processing stage of the generative AI framework, the updated user prompt generated by the first large language model, the second processing stage comprising a second large language model, wherein the second large language model is configured to process the updated user prompt generated by the first large language model and generate a response to the updated user prompt using a second machine learning model; and
processing, at a third processing stage of the generative AI framework, the response to the updated user prompt generated by the second large language model, the third processing stage comprising a third large language model, wherein the third large language model is configured to process the response to the updated user prompt generated by the second large language model and generate a response to return to the user using a third machine learning model, and wherein the third large language model is configured to transform the response to the updated user prompt generated by the second large language model to remove hallucinations from the response.
17. The method of claim 16 , wherein the second large language model is configured to process the updated user prompt generated by the first large language model in order to build a generative answer in response to the updated user prompt.
18. The method of claim 16 , wherein each of the first large language model, second large language model, and third large language model comprises a different machine learning model.
19. The method of claim 16 , wherein at least one of the first large language model, the second large language model, or the third large language model is configured to generate a predefined response based on an application of one or more guardrails to at least one of input data or output data.
20. The method of claim 16 , wherein the third large language model is further configured to transform the response to the updated user prompt generated by the second large language model to remove harmful content from the response.
21. The method of claim 16 , wherein the first large language model is configured to transform the received user prompt to remove malicious content, jailbreaking content, or content that is outside of a scope of permitted user prompts.
22. A method for providing a generative artificial intelligence (AI) framework having multiple interconnected large language models in a computer system, wherein the computer system comprises one or more processors and a memory configured to store computer-readable instructions that, when executed by the one or more processors, configure the computer system to implement the generative AI framework, the method comprising:
processing, at a first processing stage of the generative AI framework, a user prompt received from a user, the first processing stage comprising a first large language model, wherein the first large language model is configured to process the user prompt and generate an updated user prompt using a first machine learning model, wherein the first large language model is configured to transform the received user prompt to remove malicious content, jailbreaking content, or content that is outside of a scope of permitted user prompts;
processing, at a second processing stage of the generative AI framework, the updated user prompt generated by the first large language model, the second processing stage comprising a second large language model, wherein the second large language model is configured to process the updated user prompt generated by the first large language model and generate a response to the updated user prompt using a second machine learning model; and
processing, at a third processing stage of the generative AI framework, the response to the updated user prompt generated by the second large language model, the third processing stage comprising a third large language model, wherein the third large language model is configured to process the response to the updated user prompt generated by the second large language model and generate a response to return to the user using a third machine learning model.
23. The method of claim 22 , wherein the third large language model is further configured to transform the response to the updated user prompt generated by the second large language model to remove harmful content from the response.
24. The method of claim 22 , wherein the second large language model is configured to process the updated user prompt generated by the first large language model in order to build a generative answer in response to the updated user prompt.
25. A computer-readable medium configured to store computer-readable instructions for execution by one or more processors in a computer system, wherein execution of the computer-readable instructions configure the computer system to perform a method that provides a generative artificial intelligence (AI) framework having multiple interconnected large language models in a computer system, the method comprising:
processing, at a first processing stage of the generative AI framework, a user prompt received from a user, the first processing stage comprising a first large language model, wherein the first large language model is configured to process the user prompt and generate an updated user prompt using a first machine learning model;
processing, at a second processing stage of the generative AI framework, the updated user prompt generated by the first large language model, the second processing stage comprising a second large language model, wherein the second large language model is configured to process the updated user prompt generated by the first large language model and generate a response to the updated user prompt using a second machine learning model; and
processing, at a third processing stage of the generative AI framework, the response to the updated user prompt generated by the second large language model, the third processing stage comprising a third large language model, wherein the third large language model is configured to process the response to the updated user prompt generated by the second large language model and generate a response to return to the user using a third machine learning model, and wherein the third large language model is configured to transform the response to the updated user prompt generated by the second large language model to remove hallucinations from the response.
26. The computer-readable medium of claim 25 , wherein the third large language model is further configured to transform the response to the updated user prompt generated by the second large language model to remove harmful content from the response.
27. The computer-readable medium of claim 25 , wherein the first large language model is configured to transform the received user prompt to remove malicious content, jailbreaking content, or content that is outside of a scope of permitted user prompts.
28. The computer-readable medium of claim 25 , wherein the second large language model is configured to process the updated user prompt generated by the first large language model in order to build a generative answer in response to the updated user prompt.
29. A computer-readable medium configured to store computer-readable instructions for execution by one or more processors in a computer system, wherein execution of the computer-readable instructions configure the computer system to perform a method that provides a generative artificial intelligence (AI) framework having multiple interconnected large language models in a computer system, the method comprising:
processing, at a first processing stage of the generative AI framework, a user prompt received from a user, the first processing stage comprising a first large language model, wherein the first large language model is configured to process the user prompt and generate an updated user prompt using a first machine learning model, wherein the first large language model is configured to transform the received user prompt to remove malicious content, jailbreaking content, or content that is outside of a scope of permitted user prompts;
processing, at a second processing stage of the generative AI framework, the updated user prompt generated by the first large language model, the second processing stage comprising a second large language model, wherein the second large language model is configured to process the updated user prompt generated by the first large language model and generate a response to the updated user prompt using a second machine learning model; and
processing, at a third processing stage of the generative AI framework, the response to the updated user prompt generated by the second large language model, the third processing stage comprising a third large language model, wherein the third large language model is configured to process the response to the updated user prompt generated by the second large language model and generate a response to return to the user using a third machine learning model.
30. The computer-readable medium of claim 29 , wherein the second large language model is configured to process the updated user prompt generated by the first large language model in order to build a generative answer in response to the updated user prompt.
31. The computer-readable medium of claim 29 , wherein the third large language model is further configured to transform the response to the updated user prompt generated by the second large language model to remove harmful content from the response.