Generating content highlighting work experience using a generative model
An online system receives orders including items from customers and allocates the orders to pickers. A picker obtains items included in an order from a customer and delivers the items to the customer to fulfill the order. To provide encouragement for pickers fulfilling orders, the online system generates a highlight reel of accomplishments of a picker fulfilling orders. The online system generates prompts for a generative model, such as a large language model, based on stored information describing order fulfillment by a picker. Content, such as text, generated in response to a prompt by the generative model includes one or more portions of the stored information describing order fulfillment is included in the highlight reel. A template for the highlight reel is selected for the picker, with the template identifying content displayed to the picker and an order in which the content is displayed.
1 . A method, performed at a computer system comprising a processor and a non-transitory computer readable medium, comprising:
storing, at the computer system, information describing historical order fulfillments by each of a plurality of pickers;
accessing, by the computer system, one or more templates for a highlight reel, wherein each template for a highlight reel includes one or more frames describing a picker's previous fulfillment of orders and one or more fields for inserting specific information about the picker's historical order fulfillments in the one or more of the frames of the template;
selecting, by the computer system, a picker from the plurality of pickers;
selecting a template for the selected picker based on one or more characteristics of the selected picker;
retrieving the information describing historical order fulfillments by the selected picker;
prompting a generative model to generate, based on the retrieved information describing historical order fulfillments by the selected picker, a value for each of the one or more fields for inserting specific information about the picker's historical order fulfillments in the one or more of the frames of the template;
generating the highlight reel for the selected picker, by inserting into the one or more fields of the one or more frames include the generated values from the generative model; and
transmitting the highlight reel from the computer system to a picker client device of the selected picker, wherein the transmitting causes the picker client device to display the highlight reel.
2 . The method of claim 1 , wherein selecting a template comprises selecting a template having one or more frames that include corresponding thresholds for information describing order fulfillment by the picker.
3 . The method of claim 2 , wherein generating the highlight reel for the selected picker comprises:
determining that a particular value generated by the generative model is less than a corresponding threshold; and
in response to determining that a particular value generated by the generative model is less than a corresponding threshold, omitting a frame from the highlight reel, wherein the omitted frame contains a field corresponding to the particular value.
4 . The method of claim 1 , wherein selecting a template for the selected picker based on one or more characteristics of the selected picker comprises:
selecting a template associated with a set of characteristics of pickers having at least a threshold amount of characteristics matching the one or more characteristics of the picker.
5 . The method of claim 1 , wherein selecting a template for the selected picker based on one or more characteristics of the selected picker comprises selecting a template that specifies a different portion of the information describing order fulfillment by the picker displayed on different frames and an order in which different frames are displayed.
6 . The method of claim 1 , wherein prompting a generative model comprises prompting a generative model to generate text data based on the information describing historical order fulfillments.
7 . The method of claim 1 , wherein prompting a generative model comprises prompting a generative model to generate an image based on the information describing historical order fulfillments.
8 . The method of claim 1 , wherein selecting a picker comprises selecting a picker having characteristics satisfying one or more criteria.
9 . The method of claim 1 , further comprising:
receiving, at the computer system, information from the picker client device describing interaction by the selected picker with a frame of the highlight reel; and
storing a label in association with a prompt generated for the frame of the highlight reel based on the information describing interaction by the selected picker with the frame of the highlight reel.
10 . A computer program product comprising a non-transitory computer readable storage medium having instructions encoded thereon that, when executed by a processor, cause the processor to perform steps comprising:
storing information describing historical order fulfillments by each of a plurality of pickers;
accessing, by the computer system, one or more templates for a highlight reel, wherein each template for a highlight reel includes one or more frames describing a picker's previous fulfillment of orders and one or more fields for inserting specific information about the picker's historical order fulfillments in the one or more of the frames of the template;
selecting, by the computer system, a picker from the plurality of pickers;
selecting a template for the selected picker based on one or more characteristics of the selected picker;
retrieving the information describing historical order fulfillments by the selected picker;
prompting a generative model to generate, based on the retrieved information describing historical order fulfillments by the selected picker, a value for each of the one or more fields for inserting specific information about the picker's historical order fulfillments in the one or more of the frames of the template;
generating the highlight reel for the selected picker, by inserting into the one or more fields of the one or more frames include the generated values from the generative model; and
transmitting the highlight reel from the computer system to a picker client device of the selected picker, wherein the transmitting causes the picker client device to display the highlight reel.
11 . The computer program product of claim 10 , wherein selecting a template comprises selecting a template having one or more frames that include corresponding thresholds for information describing order fulfillment by the picker.
12 . The computer program product of claim 11 , wherein generating the highlight reel for the selected picker comprises:
determining that a particular value generated by the generative model is less than a corresponding threshold; and
in response to determining that a particular value generated by the generative model is less than a corresponding threshold, omitting a frame from the highlight reel, wherein the omitted frame contains a field corresponding to the particular value.
13 . The computer program product of claim 10 , wherein selecting a template for the selected picker based on one or more characteristics of the selected picker comprises:
selecting a template associated with a set of characteristics of pickers having at least a threshold amount of characteristics matching the one or more characteristics of the picker.
14 . The computer program product of claim 10 , wherein selecting a template for the selected picker based on one or more characteristics of the selected picker comprises selecting a template that specifies a different portion of the information describing order fulfillment by the picker displayed on different frames and an order in which different frames are displayed.
15 . The computer program product of claim 10 , wherein prompting a generative model comprises prompting a generative model to generate text data based on the information describing historical order fulfillments.
16 . The computer program product of claim 10 , wherein prompting a generative model comprises prompting a generative model to generate an image based on the information describing historical order fulfillments.
17 . The computer program product of claim 10 , wherein selecting a picker comprises selecting a picker having characteristics satisfying one or more criteria.
18 . The computer program product of claim 10 , wherein the non-transitory computer readable storage medium further has instructions encoded thereon that, when executed by a processor, cause the processor to perform steps comprising:
receiving, at the computer system, information from the picker client device describing interaction by the selected picker with a frame of the highlight reel; and
storing a label in association with a prompt generated for the frame of the highlight reel based on the information describing interaction by the selected picker with the frame of the highlight reel.
19 . A system comprising:
a processor; and
a non-transitory computer readable storage medium having instructions encoded thereon that, when executed by the processor, cause the processor to perform steps comprising:
storing, at the computer system, information describing historical order fulfillments by each of a plurality of pickers;
accessing, by the computer system, one or more templates for a highlight reel, wherein each template for a highlight reel includes one or more frames describing a picker's previous fulfillment of orders and one or more fields for inserting specific information about the picker's historical order fulfillments in the one or more of the frames of the template;
selecting, by the computer system, a picker from the plurality of pickers;
selecting a template for the selected picker based on one or more characteristics of the selected picker;
retrieving the information describing historical order fulfillments by the selected picker;
prompting a generative model to generate, based on the retrieved information describing historical order fulfillments by the selected picker, a value for each of the one or more fields for inserting specific information about the picker's historical order fulfillments in the one or more of the frames of the template;
generating the highlight reel for the selected picker, by inserting into the one or more fields of the one or more frames include the generated values from the generative model; and
transmitting the highlight reel from the computer system to a picker client device of the selected picker, wherein the transmitting causes the picker client device to display the highlight reel.
20 . The system of claim 19 , wherein selecting a template comprises selecting a template having one or more frames that include corresponding thresholds for information describing order fulfillment by the picker.