Generative artificial intelligence enterprise search
Systems and methods are configured to generate a set of potential responses to a prompt using one or more data models with data from at least a plurality of data domains of an enterprise information environment that includes access controls. A deterministic response is selected from the set of potential responses based on scoring of the validation data and restricting based on access controls in view of profile information associated with the prompt. These enterprise generative AI systems and methods support granular enterprise access controls, privacy, and security requirements, and provide traceable references and links to source information underlying the generative AI insights. These systems and methods enable dramatically increased utility for enterprise users to access information, analyses, and predictive analytics associated with and derived from a combination of enterprise and external information systems.
1. A method comprising:
generating a set of potential responses to a prompt using one or more data models with data from at least a plurality of data domains of an enterprise information environment that includes access controls, wherein generating the set of potential responses uses at least one large language model trained on the at least the plurality of data domains of the enterprise information environment to determine data object semantics, and wherein the at least one large language model includes vectorized data from the data from the at least the plurality of data domains with embeddings;
determining validation data for the set of potential responses, wherein the validation data is from the at least the plurality of data domains of the enterprise information environment, wherein determining the validation data comprises retrieving the embeddings from the vectorized data;
selecting a deterministic response from the set of potential responses based on scoring of the validation data and restricting the deterministic response based on the access controls in view of profile information associated with the prompt, wherein selecting the deterministic response from the set of potential responses comprises using the embeddings from the vectorized data to determine relevance evaluations; and
outputting the selected deterministic response with the validation data corresponding to the selected deterministic response.
2. The method of claim 1 , further comprising:
generating a traceability analysis of the validation data, the traceability analysis indicating any of documents, document segments, and insights of at least a portion of one or more enterprise data sets.
3. The method of claim 1 , wherein the scoring of the validation data comprises:
determining, based on the one or more data models, a plurality of relevance scores associated with at least a portion of each piece of validation data for the set of potential responses.
4. The method of claim 1 ,
wherein at least two of the data domains include industry-specific data for different industries, wherein at least one response of the set of potential responses uses a first data domain of the at least the plurality of data domains, and wherein at least another response of the set of potential responses uses a second data domain of the at least the plurality of data domains,
wherein the one or more data models comprises multiple models trained for different data domains with industry-specific data of the at least the plurality of data domains,
wherein each data model represents respective relationships and attributes of the corresponding different data domain industry-specific data of the different data domains, and
wherein the respective relationships and attributes include any of data types, data formats, and industry-specific information.
5. The method of claim 1 , wherein the one or more data models include multimodal models wherein at least one is a large language model.
6. The method of claim 1 , wherein the access controls enforce restrictions including at least one of administrative policies, security policies, profile rights, and organizational controls.
7. The method of claim 1 , wherein the access controls cause a different deterministic response to be selected based on profiles with different access rights.
8. The method of claim 1 , wherein the access controls cause a different validation data to be output based on profiles with different access rights.
9. The method of claim 1 , wherein the selected deterministic response comprises at least one of predictions, insights, or recommendations from an artificial intelligence application.
10. The method of claim 1 , wherein the output includes at least one of data visualization, automated control and instruction, a report, and a dynamically configured dashboard.
11. The method of claim 1 , wherein generating the set of potential responses using the one or more data models comprises using a retrieval model to determine relevant objects from the at least the plurality of data domains of the enterprise information environment.
12. The method of claim 1 , wherein the data object semantics are for enterprise concepts, features, and components.
13. The method of claim 1 ,
wherein the one or more data models uses a model driven architecture with a type system for disparate data formats of the at least the plurality of data domains, and
wherein determining the validation data uses the type system of the model driven architecture for access controls of the validation data in view of the profile information associated with the prompt.
14. The method of claim 1 , wherein outputting the selected deterministic response includes a generative AI insight and a traceability report indicating at least one source document used to determine the selected deterministic response, and wherein the at least one source document is from a particular data domain of the at least the plurality of data domains of the enterprise information environment.
15. A system comprising:
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the system to perform:
generating a set of potential responses to a prompt using one or more data models with data from at least a plurality of data domains of an enterprise information environment that includes access controls, wherein generating the set of potential responses uses at least one large language model trained on the at least the plurality of data domains of the enterprise information environment to determine data object semantics, and wherein the at least one large language model includes vectorized data from the data from the at least the plurality of data domains with embeddings;
determining validation data for the set of potential responses, wherein the validation data is from the at least the plurality of data domains of the enterprise information environment, wherein determining the validation data comprises retrieving the embeddings from the vectorized data;
selecting a deterministic response from the set of potential responses based on scoring of the validation data and restricting the deterministic response based on the access controls in view of profile information associated with the prompt; wherein selecting the deterministic response from the set of potential responses comprises using the embeddings from the vectorized data to determine relevance evaluations; and
outputting the selected deterministic response with the validation data corresponding to the selected deterministic response.
16. The system of claim 15 , further comprising:
generating a traceability analysis of the validation data, the traceability analysis indicating any of documents, document segments, and insights of at least a portion of one or more enterprise data sets.
17. The system of claim 15 , wherein the scoring of the validation data comprises:
determining, based on the one or more data models, a plurality of relevance scores associated with at least a portion of each piece of validation data for the set of potential responses.
18. The system of claim 15 , wherein the one or more data models include multimodal models wherein at least one is a large language model.
19. The system of claim 15 , wherein the access controls enforce restrictions including at least one of administrative policies, security policies, profile rights, and organizational controls.
20. The system of claim 15 , wherein the access controls cause a different deterministic response to be selected based on profiles with different access rights.
21. The system of claim 15 , wherein the access controls cause a different validation data to be output based on profiles with different access rights.
22. The system of claim 15 , wherein the selected deterministic response comprises at least one of predictions, insights, or recommendations from an artificial intelligence application.
23. The system of claim 15 , wherein the output includes at least one of data visualization, automated control and instruction, a report, and a dynamically configured dashboard.
24. A non-transitory computer readable medium comprising instructions that, when executed, cause one or more processors to perform:
generating a set of potential responses to a prompt using one or more data models with data from at least a plurality of data domains of an enterprise information environment that includes access controls, wherein generating the set of potential responses uses at least one large language model trained on the at least the plurality of data domains of the enterprise information environment to determine data object semantics, and wherein the at least one large language model includes vectorized data from the data from the at least the plurality of data domains with embeddings;
determining validation data for the set of potential responses, wherein the validation data is from the at least the plurality of data domains of the enterprise information environment, wherein determining the validation data comprises retrieving the embeddings from the vectorized data;
selecting a deterministic response from the set of potential responses based on scoring of the validation data and restricting the deterministic response based on the access controls in view of profile information associated with the prompt, wherein selecting the deterministic response from the set of potential responses comprises using the embeddings from the vectorized data to determine relevance evaluations; and
outputting the selected deterministic response with the validation data corresponding to the selected deterministic response.