Graphical user interface for generating large language model function buttons
This disclosure describes systems that generate a selection of large language model (LLM) function buttons in a floating widget within a web browser of a client device. The disclosed systems can generate or otherwise select the LLM function buttons to include based on context of a webpage within the web browser. Responsive to detecting an indication of an interaction with an LLM function button, the disclosed systems can generate a side panel within the web browser according to the LLM function button. In some embodiments, the disclosed systems can display and utilize a customized LLM function button responsive to detecting a certain webpage or content within the webpage. Further, in some embodiments, the disclosed systems can generate an LLM function button to perform a customized workflow responsive to detecting a certain webpage or content within the webpage.
1 . A computer-implemented method comprising:
receiving, from a client device displaying a webpage within a web browser, an indication of selecting a large language model (LLM) button generation option that is selectable to generate an LLM function button within the webpage that is selectable to autonomously generate a prompt to cause an LLM to autonomously perform a customized function based at least in part on content of the webpage;
in response to the indication of selecting the LLM button generation option, providing, for display within the web browser displayed on the client device, a button generation panel comprising fields to define parameters corresponding to the customized function of the LLM function button, the fields comprising:
an address option for defining one or more web addresses where the LLM function button appears; and
a function option for defining the customized function executed by the LLM upon selection of the LLM function button; and
generating, based on interactions with the fields of the button generation panel, the LLM function button within the webpage to be selectable to autonomously generate the prompt to cause the LLM to autonomously perform the customized function according to the parameters of the button generation panel.
2 . The computer-implemented method of claim 1 , further comprising defining the customized function executed upon selection of the LLM function button by:
receiving, from the client device displaying the webpage, an indication of selecting an action record option to record user account interaction with the webpage displayed within the web browser; and
in response to the indication of selecting the action record option, recording a set of user account interactions.
3 . The computer-implemented method of claim 2 , further comprising modifying the set of user account interactions to generate an adaptive set of user account interactions adaptable to differences in content within one or more webpages related to the webpage displayed within the web browser.
4 . The computer-implemented method of claim 3 , further comprising:
providing a description of the adaptive set of user account interactions for review in the button generation panel of the web browser;
generating a modified adaptive set of user account interactions by modifying the adaptive set of user account interactions responsive to feedback from the client device regarding the adaptive set of user account interactions; and
generating a prompt to provide to an LLM based on the modified adaptive set of user account interactions.
5 . The computer-implemented method of claim 1 , further comprising:
providing, within the button generation panel, a function adaptation option to adapt the customized function of the LLM function button to one or more webpages related to the webpage; and
adapting the customized function to the one or more webpages related to the webpage responsive to receiving an indication of an interaction with the function adaptation option.
6 . The computer-implemented method of claim 1 , further comprising displaying the LLM function button within a floating widget that overlays content of the webpage based on determining that a web address of the webpage matches the one or more web addresses where the LLM function button appears.
7 . The computer-implemented method of claim 1 , further comprising:
generating, based on detecting an indication of an interaction with the LLM function button, a side panel within the web browser; and
providing, within the side panel, a description of the customized function executed upon selection of the LLM function button.
8 . The computer-implemented method of claim 7 , further comprising:
executing the customized function responsive to receiving a confirmation from the client device to execute the customized function of the LLM function button.
9 . A system comprising:
at least one processor; and
at least one non-transitory computer readable storage medium storing instructions that, when executed by the at least one processor, cause the system to:
receive from a client device displaying a webpage within a web browser, an indication of selecting a large language model (LLM) button generation option that is selectable to generate an LLM function button within the webpage that is selectable to autonomously generate a prompt to cause an LLM to autonomously perform a customized function based at least in part on content of the webpage;
in response to the indication of selecting the LLM button generation option, provide, for display within the web browser displayed on the client device, a button generation panel comprising fields to define parameters corresponding to the customized function of the LLM function button, the fields comprising:
an address option for defining one or more web addresses where the LLM function button appears; and
a function option for defining the customized function executed by the LLM upon selection of the LLM function button; and
a function adaptation option to adapt the customized function of the LLM function button to one or more webpages related to the webpage; and
generate, based on interactions with the fields of the button generation panel, the LLM function button within the webpage to be selectable to autonomously generate the prompt to cause the LLM to autonomously perform the customized function according to the parameters of the button generation panel.
10 . The system of claim 9 , further comprising instructions that, when executed by the at least one processor, cause the system to:
receive via the function option, a natural language instruction defining the customized function executed upon selection of the LLM function button;
extract a workflow from the natural language instruction using a large language model, the workflow comprising a series of executable processes that, upon execution, accomplish the customized function defined via the function option; and
define the customized function according to the workflow extracted from the natural language instruction.
11 . The system of claim 9 , further comprising instructions that, when executed by the at least one processor, cause the system to:
provide, within the button generation panel, an interface element selectable to enable an LLM to access one or more content items stored within a content management system during execution of the customized function executed upon selection of the LLM function button.
12 . The system of claim 9 , further comprising instructions that, when executed by the at least one processor, cause the system to:
receive, from the client device displaying the webpage, an indication of selecting an action record option to record user account interaction with the webpage displayed within the web browser; and
in response to the indication of selecting the action record option, record a set of user account interactions.
13 . The system of claim 12 , further comprising instructions that, when executed by the at least one processor, cause the system to:
modify the set of user account interactions to generate an adaptive set of user account interactions adaptable to differences in content within one or more webpages related to the webpage displayed within the web browser.
14 . The system of claim 13 , further comprising instructions that, when executed by the at least one processor, cause the system to:
provide a description of the adaptive set of user account interactions for review in the button generation panel of the web browser;
generate a modified adaptive set of user account interactions by modifying the adaptive set of user account interactions responsive to feedback from the client device regarding the adaptive set of user account interactions; and
generate a prompt to provide to an LLM based on the modified adaptive set of user account interactions.
15 . A non-transitory computer-readable medium storing instructions thereon that, when executed by at least one processor, cause a computing device to:
receive, from a client device displaying a webpage within a web browser, an indication of selecting a large language model (LLM) button generation option that is selectable to generate an LLM function button within the webpage that is selectable to autonomously generate a prompt to cause an LLM to autonomously perform a customized function based at least in part on content of the webpage;
in response to the indication of selecting the LLM button generation option, provide, for display within the web browser displayed on the client device, a button generation panel comprising fields to define parameters corresponding to the customized function of the LLM function button, the fields comprising:
an address option for defining one or more web addresses where the LLM function button appears; and
a function option for defining the customized function executed by the LLM upon selection of the LLM function button; and
generate, based on interactions with the fields of the button generation panel, the LLM function button within the webpage to be selectable to autonomously generate the prompt to cause the LLM to autonomously perform the customized function according to the parameters of the button generation panel; and
display the LLM function button within a floating widget that overlays content of the webpage based on determining that a web address of the webpage matches the one or more web addresses where the LLM function button appears.
16 . The non-transitory computer-readable medium of claim 15 , further comprising instructions that, when executed by the at least one processor, cause the computing device to:
provide, within the button generation panel, a user interface element that is selectable to allow access to one or more content items within a content management system;
receive, via the function option, an instruction to extract data from the one or more content items; and
responsive to determining a selection of the LLM function button, extract the data according to the instruction.
17 . The non-transitory computer-readable medium of claim 15 , further comprising instructions that, when executed by the at least one processor, cause the computing device to:
generate, based on detecting an indication of an interaction with the LLM function button, a side panel within the web browser; and
provide, within the side panel, a description of the customized function executed upon selection of the LLM function button.
18 . The non-transitory computer-readable medium of claim 17 , further comprising instructions that, when executed by the at least one processor, cause the computing device to:
execute the customized function responsive to receiving a confirmation from the client device to execute the customized function of the LLM function button.
19 . The non-transitory computer-readable medium of claim 15 , further comprising instructions that, when executed by the at least one processor, cause the computing device to:
receive, from the client device displaying the webpage, an indication of selecting an action record option to record user account interaction with the webpage displayed within the web browser; and
in response to the indication of selecting the action record option, record a set of user account interactions.
20 . The non-transitory computer-readable medium of claim 19 , further comprising instructions that, when executed by the at least one processor, cause the computing device to:
modify the set of user account interactions to generate an adaptive set of user account interactions adaptable to differences in content within one or more webpages related to the webpage displayed within the web browser;
provide a description of the adaptive set of user account interactions for review in the button generation panel of the web browser;
generate a modified adaptive set of user account interactions by modifying the adaptive set of user account interactions responsive to feedback from the client device regarding the adaptive set of user account interactions; and
generate a prompt to provide to an LLM based on the modified adaptive set of user account interactions.