Systems and methods for AI-based searching
Disclosed are systems and methods that provide a decision-intelligence (DI)-based, computerized framework for compiling and leveraging reliable sequence taggings for input queries related to executed searches. The disclosed framework can compile a trained computer model to fulfill partially labeled queries tagged by AI models as fully labeled queries. The disclosed framework can further leverage other AI models (e.g., deep neural networks, knowledge graphs, and the like), so that cross-checks can be performed between different models to guarantee high quality of labeled tokens. Thus, the framework can automatically generate and implement reliable training data to train a sequence tagging model for search query understanding. Thus, the search engine operating on such tagging model can provide improved results.
1 . A method comprising steps of:
receiving, by a device, an input query, the input query comprising two words;
determining, by the device, a domain for a first word;
determining, by the device, two artificial intelligence (AI) models, each model being a different type of model for analyzing information related to the determined domain;
executing, by the device, each AI model based on the input query, the execution of each AI model comprising generating a label for the first word;
performing, by the device, a cross-check determination on each label for the first word, the cross-check determination comprising determining that a match between the labels for the first word exists;
executing, by the device, a third model based on the labeled first word and a second word;
determining, by the device, based on the third model execution, a fully labeled input query, the fully labeled input query comprising the labeled first word and a labeled second word;
executing, by the device, a search of a repository based on the fully labeled input query; and
outputting, for display within a user interface (UI), a search result.
2 . The method of claim 1 , wherein at least one of the AI models is a large language model (LLM), wherein the execution of the LLM comprises providing at least one prompt related to information related to the first word.
3 . The method of claim 1 , wherein at least one of the AI models comprises functionality related to a neural network and taxonomy, wherein information related to the taxonomy is provided to the neural network to determine the generated label for the first word.
4 . The method of claim 1 , wherein a domain corresponds to a category of information.
5 . The method of claim 1 , wherein the third model is a Conditional Random Field (CRF) model, wherein the execution of the CRF model comprises determining a set of tokens related to portions of the second word, wherein each token of the set of tokens relates to a feature representation of the second word.
6 . The method of claim 1 , further comprising:
compiling an input based on the labeled first word and the second word, wherein the input is a basis for the execution of the third model.
7 . The method of claim 1 , further comprising:
determining a match between the labels for the first word does not exist based on a similarity between the generated labels being below a similarity threshold; and
determining another set of AI models, the other set of AI models comprising at least one different AI model from the two AI models, wherein the generation of the AI labels is performed again based on the other set of AI models.
8 . The method of claim 1 , wherein a known domain does not exist for the second word.
9 . The method of claim 1 , wherein the input query comprises a plurality of words, wherein the steps are performed for each of the plurality of the words.
10 . The method of claim 1 , wherein the domain determination comprises identifying a plurality of AI models, wherein the plurality of AI models are utilized as a basis for the cross-check determination.
11 . A device comprising:
a processor configured to:
receive an input query, the input query comprising two words;
determine a domain for a first word;
determine two artificial intelligence (AI) models, each model being a different type of model for analyzing information related to the determined domain;
execute each AI model based on the input query, the execution of each AI model comprising generating a label for the first word;
perform a cross-check determination on each label for the first word, the cross-check determination comprising determining that a match between the labels for the first word exists;
execute a third model based on the labeled first word and a second word;
determine, based on the third model execution, a fully labeled input query, the fully labeled input query comprising the labeled first word and a labeled second word;
execute a search of a repository based on the fully labeled input query; and
output, for display within a user interface (UI), a search result.
12 . The device of claim 11 , wherein at least one of the AI models is a large language model (LLM), wherein the execution of the LLM comprises providing at least one prompt related to information related to the first word.
13 . The device of claim 11 , wherein at least one of the AI models comprises functionality related to a neural network and taxonomy, wherein information related to the taxonomy is provided to the neural network to determine the generated label for the first word.
14 . The device of claim 11 , wherein the third model is a Conditional Random Field (CRF) model, wherein the execution of the CRF model comprises determining a set of tokens related to portions of the second word, wherein each token of the set of tokens relates to a feature representation of the second word.
15 . The device of claim 11 , wherein the processor is further configured to:
compile an input based on the labeled first word and the second word, wherein the input is a basis for the execution of the third model.
16 . The device of claim 11 , wherein the processor is further configured to:
determine a match between the labels for the first word does not exist based on a similarity between the generated labels being below a similarity threshold; and
determine another set of AI models, the other set of AI models comprising at least one different AI model from the two AI models, wherein the generation of the AI labels is performed again based on the other set of AI models.
17 . A non-transitory computer-readable storage medium tangibly encoded with computer-executable instructions that when executed by a device, perform a method comprising:
receiving, by the device, an input query, the input query comprising two words;
determining, by the device, a domain for a first word;
determining, by the device, two artificial intelligence (AI) models, each model being a different type of model for analyzing information related to the determined domain;
executing, by the device, each AI model based on the input query, the execution of each AI model comprising generating a label for the first word;
performing, by the device, a cross-check determination on each label for the first word, the cross-check determination comprising determining that a match between the labels for the first word exists;
executing, by the device, a third model based on the labeled first word and a second word;
determining, by the device, based on the third model execution, a fully labeled input query, the fully labeled input query comprising the labeled first word and a labeled second word;
executing, by the device, a search of a repository based on the fully labeled input query; and
outputting, for display within a user interface (UI), a search result.