Systems for controllable summarization of content
A method of generating summaries of content items using one or more large language models (LLMs) is disclosed. A first content item is identified. The first content item includes a set of sub-content items. A level of abstraction is determined for the content item. A prompt is automatically engineered for providing to the one or more LLMs. The prompt includes a reference to the first content item and the level of the abstraction for the first content item. A response to the prompt is received from the LLM. The response includes a second content item. The second content item includes a representation of the first content item that is generated by the LLM. The representation omits or simplifies one or more of the set of sub-content items based on the level of abstraction. The representation is used to control an output that is communicated to a target device.
1. A system comprising:
one or more computer processors;
one or more computer memories;
a set of instructions stored in the one or more computer memories, the set of instructions configuring the one or more computer processors to perform operations, the operations comprising:
identifying a content item;
determining a level of abstraction for the content item;
providing a prompt to a large language model (LLM), the prompt including a reference to the content item and the level of the abstraction for the content item;
receiving a response to the prompt from the LLM, the response including a representation of the content item that is generated by the LLM, the representation representing the content item according to the level of abstraction; and
communicating the representation for presentation on a device.
2. The system of claim 1 , wherein the level of the abstraction is specified as an amount of content that the LLM is to include in the response relative to an amount of content in the content item.
3. The system of claim 2 , wherein the amount is specified as a percentage of the content in the content item.
4. The system of claim 1 , wherein the determining of the level of the abstraction is based on an input received via a graphical user interface.
5. The system of claim 1 , the operations further comprising, based on the level of abstraction transgressing a threshold value, requesting that the LLM generate information pertaining to one or more inferences pertaining to the content item for including in the representation.
6. The system of claim 5 , the operations further comprising requesting that the LLM use one or more external data sources to generate the information pertaining the one or more inferences.
7. The system of claim 1 , the operations further comprising providing an additional prompt to the LLM, the additional prompt requesting the LLM to generate an appropriate conversational response to the representation based on a context associated with the representation.
8. The system of claim 7 , wherein the context includes information pertaining to a sales call being handled in real time by a sales representative.
9. The system of claim 8 , wherein the content includes one or more statements made by a customer and one or more statement made by the sales representative.
10. The system of claim 9 , wherein the sales representative is an intelligent agent.
11. A method comprising:
identifying a content item;
determining a level of abstraction for the content item;
providing a prompt to a large language model (LLM), the prompt including a reference to the content item and the level of the abstraction for the content item;
receiving a response to the prompt from the LLM, the response including a representation of the content item that is generated by the LLM, the representation representing the content item according to the level of abstraction; and
communicating the representation for presentation on a device.
12. The method of claim 11 , further comprising, based on the level of abstraction transgressing a threshold value, requesting that the LLM generate information pertaining to one or more inferences pertaining to the content item for including in the representation.
13. The method of claim 12 , further comprising requesting that the LLM use one or more external data sources to generate the information pertaining the one or more inferences.
14. The method of claim 11 , further comprising providing an additional prompt to the LLM, the additional prompt requesting the LLM to generate an appropriate conversational response to the representation based on a context associated with the representation.
15. The method of claim 14 , wherein the context includes information pertaining to a sales call being handled in real time by a sales representative.
16. A non-transitory computer-readable storage medium storing a set of instructions that, when executed by one or more processors, causes the one or more processors to perform operations, the operations comprising:
identifying a content item;
determining a level of abstraction for the content item;
providing a prompt to a large language model (LLM), the prompt including a reference to the content item and the level of the abstraction for the content item;
receiving a response to the prompt from the LLM, the response including a representation of the content item that is generated by the LLM, the representation representing the content item according to the level of abstraction; and
communicating the representation for presentation on a device.
17. The non-transitory computer-readable storage medium of claim 16 , the operations further comprising, based on the level of abstraction transgressing a threshold value, requesting that the LLM generate information pertaining to one or more inferences pertaining to the content item for including in the representation.
18. The non-transitory computer-readable storage medium of claim 17 , the operations further comprising requesting that the LLM use one or more external data sources to generate the information pertaining the one or more inferences.
19. The non-transitory computer-readable storage medium of claim 16 , the operations further comprising providing an additional prompt to the LLM, the additional prompt requesting the LLM to generate an appropriate conversational response to the representation based on a context associated with the representation.
20. The non-transitory computer-readable storage medium of claim 19 , wherein the context includes information pertaining to a sales call being handled in real time by a sales representative.