Project management for generative response engine contexts
The present technology pertains to managing contexts for generative response engines while enforcing a hierarchy of contexts based on the organization of the contexts into one or more smart folders. The present technology enables a user account to store at least two context items in a smart folder, where the context items may include instructions for a model, documents, or conversation threads. When a smart folder is selected by a user account, the at least two context items can be included in the context window to the generative response engine. A hierarchy of context items can be imputed by the generative response engine based on the structure of smart folders.
1 . A method comprising:
receiving, by a front end to a generative response engine, a selection of a smart folder by a first user account, wherein the smart folder groups at least two context items that are usable by the generative response engine in responding to prompts, wherein one of the at least two context items is a conversation thread between at least one user account and the generative response engine, and wherein the smart folder is associated with access privileges that grant access to the smart folder to the first user account and a second user account;
receiving, by the front end, a prompt from the first user account;
sending, by the front end, the prompt from the first user account and the at least two context items to the generative response engine;
receiving, by the front end, a first response output by the generative response engine based on the prompt from the first user account and the at least two context items;
outputting, by the front end, the response to the first user account and appending the first response to the conversation thread stored in the smart folder;
receiving, by the front end, a prompt from the second user account and a selection of the smart folder;
sending, by the front end, the prompt from the second user account to the generative response engine with the at least two context items and a personalization state of the second user account; and
receiving, by the front end, a second response output by the generative response engine based on the prompt from the second user account and the at least two context items, wherein the second response is personalized to the second user account based on the personalization state of the second user account.
2 . The method of claim 1 , wherein the at least two context items comprises at least two of: the conversation thread, a collaborative document, a knowledge base document, and an instruction to the generative response engine.
3 . The method of claim 2 , further comprising:
sending a first user account personalization state to the generative response engine with the at least two context items, wherein the first user account personalization state is included in a context window of the generative response engine with the at least two context items.
4 . The method of claim 1 , further comprising:
appending the second response to the conversation thread.
5 . The method of claim 4 , wherein when sending the prompt from the second user account, the front end does not send the first user account personalization state.
6 . A computing system comprising:
at least one processor; and
a memory storing instructions that, when executed by the at least one processor, configure the computing system to:
receive a selection of a smart folder by a first user account, wherein the smart folder groups at least two context items that are usable by a generative response engine in responding to prompts, wherein one of the at least two context items is a conversation thread between at least one user account and the generative response engine, and wherein the smart folder is associated with access privileges that grant access to the smart folder to the first user account and a second user account;
receive a prompt from the first user account;
send the prompt from the first user account and the at least two context items to the generative response engine;
receive a first response output by the generative response engine based on the prompt from the first user account and the at least two context items;
output the response to the first user account and appending the first response to the conversation thread stored in the smart folder;
receive a prompt from the second user account and a selection of the smart folder;
send the prompt from the second user account to the generative response engine with the at least two context items and a personalization state of the second user account; and
receive a second response output by the generative response engine based on the prompt from the second user account and the at least two context items, wherein the second response is personalized to the second user account based on the personalization state of the second user account.
7 . The computing system of claim 6 , wherein the smart folder is one of a set of smart folders organized in a nested hierarchy.
8 . The computing system of claim 7 , wherein the at least two context items comprises at least one instruction inherited from a parent folder of the smart folder and wherein the at least one instruction informs the generative response engine how to respond to a prompt.
9 . The computing system of claim 8 , wherein the smart folder includes at least one sub-folder, wherein the at least one sub-folder inherits the at least one instruction from the parent folder of the smart folder and at least one instruction of the smart folder.
10 . The computing system of claim 9 , wherein the instructions further configure the computing system to:
provide, to the generative response engine, the at least one instruction from the parent folder and the at least one instruction from the smart folder, wherein a hierarchy of the at least one instruction from the parent folder and the at least one instruction from the smart folder is imputed from nesting of the smart folder in the parent folder.
11 . The computing system of claim 6 , wherein the at least two context items comprises one or more documents stored as vectors in the smart folder.
12 . The computing system of claim 11 , wherein the response from the generative response engine is aided using retrieval-augmented generation (RAG) over the one or more documents.
13 . A non-transitory computer-readable medium comprising instructions that when executed by at least one processor, cause the at least one processor to:
receive a selection of a smart folder by a first user account, wherein the smart folder groups at least two context items that are usable by a generative response engine in responding to prompts, wherein one of the at least two context items is a conversation thread between at least one user account and the generative response engine, and wherein the smart folder is associated with access privileges that grant access to the smart folder to the first user account and a second user account;
receive a prompt from the first user account;
send the prompt from the first user account and the at least two context items to the generative response engine;
receive a response output by the generative response engine based on the prompt from the first user account and the at least two context items;
output the response to the user account and appending the response to the conversation thread stored in the smart folder;
receive a prompt from the second user account and a selection of the smart folder;
send the prompt from the second user account to the generative response engine with the at least two context items and a personalization state of the second user account; and
receive a second response output by the generative response engine based on the prompt from the second user account and the at least two context items, wherein the second response is personalized to the second user account based on the personalization state of the second user account.
14 . The non-transitory computer-readable medium of claim 13 , wherein the at least two context items comprises at least two of: the conversation thread, a collaborative document, a knowledge base document, and an instruction to the generative response engine.
15 . The non-transitory computer-readable medium of claim 14 , wherein the instructions further configure the at least one processor to:
send a first user account personalization state to the generative response engine with the at least two context items, wherein the first user account personalization state is included in a context window of the generative response engine with the at least two context items.
16 . The non-transitory computer-readable medium of claim 14 , wherein the smart folder is one of a set of smart folders organized in a nested hierarchy.
17 . The non-transitory computer-readable medium of claim 16 , wherein the at least two context items comprises at least one instruction inherited from a parent folder of the smart folder and wherein the at least one instruction informs the generative response engine how to respond to a prompt.
18 . The non-transitory computer-readable medium of claim 17 , wherein the smart folder includes at least one sub-folder, wherein the at least one sub-folder inherits the at least one instruction from the parent folder of the smart folder and at least one instruction of the smart folder.
19 . The non-transitory computer-readable medium of claim 18 , wherein the instructions further configure the at least one processor to:
provide, to the generative response engine, the at least one instruction from the parent folder and the at least one instruction from the smart folder, wherein a hierarchy of the at least one instruction from the parent folder and the at least one instruction from the smart folder is imputed from nesting of the smart folder in the parent folder.