Predictive feedback engine for improving search relevance in a tenant configurable hybrid search system
In some implementations, the techniques described herein relate to a method including: loading, by a processor, a predictive model, the predictive model including a first set of hidden layers; loading, by the processor, a semantic model, the semantic model including a second set of hidden layers; generating, by the processor, a tenant model using the first set of hidden layers and a third set of hidden layers, the third set of hidden layers receiving, as input, an output of the first set of hidden layers; loading, by the processor, a tenanted training data set; training, by the processor, the tenant model by biasing the first set of hidden layers with the second set of hidden layers and training weights of at least the third set of hidden layers using the tenanted training data set; and building, by the processor, an embedding index using the tenant model.
1. A method comprising:
loading, by a processor, a predictive model, the predictive model including a first set of hidden layers;
loading, by the processor, a semantic model, the semantic model including a second set of hidden layers;
generating, by the processor, a tenant model by combining the first set of hidden layers from the predictive model with a newly initialized third set of hidden layers, the third set of hidden layers receiving, as input, an output of the first set of hidden layers;
loading, by the processor, a tenanted training data set comprising interactions of users with a network search application;
training, by the processor, the tenant model by biasing the first set of hidden layers with the second set of hidden layers by adjusting bias terms of the first set of neural network hidden layers with corresponding bias terms of the second set of neural network hidden layers and training weights of at least the third set of hidden layers using the tenanted training data set; and
building, by the processor, an embedding index using the tenant model.
2. The method of claim 1 , wherein the tenanted training data set comprises a data set comprising interactions of users with a network search application.
3. The method of claim 2 , wherein the interactions include search queries and corresponding selections of search results.
4. The method of claim 1 , wherein biasing the first set of hidden layers with the second set of hidden layers comprises adjusting bias terms of the first set of hidden layers with corresponding bias terms of the second set of hidden layers.
5. The method of claim 1 , wherein biasing the first set of hidden layers with the second set of hidden layers comprises combining the second set of hidden layers with the first set of hidden layers.
6. The method of claim 1 , further comprising analyzing a size of the tenanted training data set and determining which layers in the tenant model to re-train based on the size of the tenanted training data set.
7. The method of claim 6 , wherein training the tenant model further comprises re-training the first set of hidden layers when the size is below a threshold.
8. The method of claim 1 , further comprising:
receiving a search query;
converting the search query to a search embedding;
building a search embedding from the search query;
identifying similar embeddings stored in the embedding index;
querying a document index using the search query to identify responsive documents; and
returning a set of search results selected from the similar embeddings and responsive documents.
9. A non-transitory computer-readable storage medium for tangibly storing computer program instructions capable of being executed by a computer processor, the computer program instructions defining steps of:
loading a predictive model, the predictive model including a first set of hidden layers;
loading a semantic model, the semantic model including a second set of hidden layers;
generating a tenant model by combining the first set of hidden layers from the predictive model with a newly initialized third set of hidden layers, the third set of hidden layers receiving, as input, an output of the first set of hidden layers;
loading a tenanted training data set comprising interactions of users with a network search application;
training the tenant model by biasing the first set of hidden layers with the second set of hidden layers by adjusting bias terms of the first set of neural network hidden layers with corresponding bias terms of the second set of neural network hidden layers and training weights of at least the third set of hidden layers using the tenanted training data set; and
building an embedding index using the tenant model.
10. The non-transitory computer-readable storage medium of claim 9 , wherein the tenanted training data set comprises a data set comprising interactions of users with a network search application.
11. The non-transitory computer-readable storage medium of claim 10 , wherein the interactions include search queries and corresponding selections of search results.
12. The non-transitory computer-readable storage medium of claim 9 , wherein biasing the first set of hidden layers with the second set of hidden layers comprises adjusting bias terms of the first set of hidden layers with corresponding bias terms of the second set of hidden layers.
13. The non-transitory computer-readable storage medium of claim 9 , wherein biasing the first set of hidden layers with the second set of hidden layers comprises combining the second set of hidden layers with the first set of hidden layers.
14. The non-transitory computer-readable storage medium of claim 9 , further comprising analyzing a size of the tenanted training data set and determining which layers in the tenant model to re-train based on the size of the tenanted training data set.
15. The non-transitory computer-readable storage medium of claim 14 , wherein training the tenant model further comprises re-training the first set of hidden layers when the size is below a threshold.
16. The non-transitory computer-readable storage medium of claim 9 , the steps further comprising:
receiving a search query;
converting the search query to a search embedding;
building a search embedding from the search query;
identifying similar embeddings stored in the embedding index;
querying a document index using the search query to identify responsive documents; and
returning a set of search results selected from the similar embeddings and responsive documents.
17. A device comprising:
a processor; and
a storage medium for tangibly storing thereon logic for execution by the processor, the logic comprising instructions for:
loading a predictive model, the predictive model including a first set of hidden layers;
loading a semantic model, the semantic model including a second set of hidden layers;
generating a tenant model by combining the first set of hidden layers from the predictive model with a newly initialized third set of hidden layers, the third set of hidden layers receiving, as input, an output of the first set of hidden layers;
loading a tenanted training data set; comprising interactions of users with a network search application
training the tenant model by biasing the first set of hidden layers with the second set of hidden layers by adjusting bias terms of the first set of neural network hidden layers with corresponding bias terms of the second set of neural network hidden layers and training weights of at least the third set of hidden layers using the tenanted training data set; and
building an embedding index using the tenant model.
18. The device of claim 17 , wherein biasing the first set of hidden layers with the second set of hidden layers comprises adjusting bias terms of the first set of hidden layers with corresponding bias terms of the second set of hidden layers.
19. The device of claim 17 , wherein biasing the first set of hidden layers with the second set of hidden layers comprises combining the second set of hidden layers with the first set of hidden layers.
20. The device of claim 17 , further comprising analyzing a size of the tenanted training data set and determining which layers in the tenant model to re-train based on the size of the tenanted training data set.