System and method for managing message campaign data
View Patent ↗A server system comprising one or more processors and memory receives, from a client device, one or more messages for use in a message campaign, where the one or more messages include a plurality of annotations indicating human-identified features in the one or more messages. The server system initiates delivery of the message campaign to a plurality of users and receives campaign-feedback data that is indicative of user interaction, during the message campaign, that corresponds the features identified by the one or more annotations. After receiving the campaign-feedback data, the server system receives, from a requestor, a request for analysis of the features during the message campaign. In response, the server system obtains a campaign report that provides information on one or more correlations between the features and user interaction with the features during the message campaign and provides the campaign report to the requestor.
1. A method, comprising:
at a server system comprising one or more processors and memory:
receiving, from a client device, one or more message templates for use in generating messages for a message campaign that includes sending the one or more messages to a plurality of users, wherein the one or more message templates include a plurality of annotations indicating human-identified features in the one or more messages of the message campaign;
initiating delivery of the message campaign to the plurality of users;
receiving, from a plurality of client devices associated with the plurality of users, campaign-feedback data, wherein, the campaign-feedback data is indicative of user interaction, during the message campaign, that corresponds to presentation of at least one of the features identified by the one or more annotations;
removing personally identifiable information from at least a portion of the campaign-feedback data;
directing storage of the portion of the campaign-feedback data for which personally identifiable information has been removed to a remote storage area;
directing storage of an additional portion of campaign-feedback data for which personally identifiable information has not been removed to a local storage area;
after receiving the campaign-feedback data, receiving, from a requestor, a request for analysis of the features of the one or more messages during the message campaign; and
in response to receiving the request for analysis of the features of the one or more messages:
obtaining a campaign report that provides information on one or more correlations between the features and user interaction with the features during the message campaign; and
providing the campaign report to the requestor.
2. The method of claim 1 , wherein the plurality of annotations are incorporated into the content of the one or more messages of the message campaign.
3. The method of claim 2 , wherein:
a respective annotation of the plurality of annotations includes a start tag and an end tag in a respective message;
content of the respective message is in between the start tag and the end tag; and
the content of the respective message that is between the start tag and the end tag is associated with the annotation.
4. The method of claim 2 , including, prior to initiating delivery of the message campaign to the plurality of users, removing the plurality of annotations from the one or more messages.
5. The method of claim 1 , wherein, when a respective message is sent out as part of a messaging campaign, annotation information identifying features of the messages as being associated with different annotations is stored for later use in associating features with which a user has interacted with corresponding annotations.
6. The method of claim 1 , wherein:
during the message campaign a respective message in the one or more messages with a plurality of features is sent to a set of users;
the campaign-feedback data includes an indication of interactions by users in the set of users with the features in the respective message; and
the campaign report provides information comparing user engagement between different features in the respective message.
7. The method of claim 1 , wherein:
during the message campaign a first message with a plurality of features in a first arrangement is sent to a first set of users and a second message with the plurality of features in a second arrangement is sent to a second set of users;
the campaign-feedback data includes an indication of interactions by users in the first set of users with a respective feature in the first arrangement and an indication of the interaction by users in the second set of users with the respective feature in the second arrangement; and
the campaign report provides information comparing user engagement between the respective feature in the first arrangement and the respective feature in the second arrangement.
8. The method of claim 1 , wherein:
during the message campaign a first message with a plurality of features in a first arrangement is sent to a first set of users and a second message with the plurality of features in a second arrangement is sent to a second set of users;
the campaign-feedback data includes an indication of interactions by users in the first set of users with a first feature in a respective location in the first arrangement and an indication of the interaction by users in the second set of users with a second feature in the respective location in the second arrangement; and
the campaign report provides information comparing user engagement between the first feature in the respective location and the second feature in the respective location.
9. The method of claim 1 , wherein the annotations reflect the judgment of a human user.
10. The method of claim 1 , wherein, the message campaign includes messages sent using a plurality of different message types.
11. The method of claim 1 , wherein a respective message of the message campaign is generated by populating a message template of the one or more message templates with content that is customized for a recipient of the respective message.
12. A server system, comprising:
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
receiving, from a client device, one or more message templates for use in generating messages for a message campaign that includes sending the one or more messages to a plurality of users, wherein the one or more message templates include a plurality of annotations indicating human-identified features in the one or more messages of the message campaign;
initiating delivery of the message campaign to the plurality of users;
receiving, from a plurality of client devices associated with the plurality of users, campaign-feedback data, wherein, the campaign-feedback data is indicative of user interaction, during the message campaign, that corresponds to presentation of at least one of the features identified by the one or more annotations;
removing personally identifiable information from at least a portion of the campaign-feedback data;
directing storage of the portion of the campaign-feedback data for which personally identifiable information has been removed to a remote storage area;
directing storage of an additional portion of campaign-feedback data for which personally identifiable information has not been removed to a local storage area;
after receiving the campaign-feedback data, receiving, from a requestor, a request for analysis of the features of the one or more messages during the message campaign; and
in response to receiving the request for analysis of the features of the one or more messages:
obtaining a campaign report that provides information on one or more correlations between the features and user interaction with the features during the message campaign; and
providing the campaign report to the requestor.
13. The server system of claim 12 , wherein the plurality of annotations are incorporated into the content of the one or more messages.
14. The server system of claim 13 , wherein:
a respective annotation of the plurality of annotations includes a start tag and an end tag in a respective message;
content of the respective message is in between the start tag and the end tag; and
the content of the respective message that is between the start tag and the end tag is associated with the annotation.
15. The server system of claim 13 , including, prior to initiating delivery of the message campaign to the plurality of users, removing the plurality of annotations from the one or more messages.
16. The server system of claim 12 , wherein, when a respective message is sent out as part of a messaging campaign, annotation information identifying features of the messages as being associated with different annotations is stored for later use in associating features with which a user has interacted with corresponding annotations.
17. The server system of claim 12 , wherein:
during the message campaign a respective message in the one or more messages with a plurality of features is sent to a set of users;
the campaign-feedback data includes an indication of interactions by users in the set of users with the features in the respective message; and
the campaign report provides information comparing user engagement between different features in the respective message.
18. The server system of claim 12 , wherein:
during the message campaign a first message with a plurality of features in a first arrangement is sent to a first set of users and a second message with the plurality of features in a second arrangement is sent to a second set of users;
the campaign-feedback data includes an indication of interactions by users in the first set of users with a respective feature in the first arrangement and an indication of the interaction by users in the second set of users with the respective feature in the second arrangement; and
the campaign report provides information comparing user engagement between the respective feature in the first arrangement and the respective feature in the second arrangement.
19. The server system of claim 12 , wherein:
during the message campaign a first message with a plurality of features in a first arrangement is sent to a first set of users and a second message with the plurality of features in a second arrangement is sent to a second set of users;
the campaign-feedback data includes an indication of interactions by users in the first set of users with a first feature in a respective location in the first arrangement and an indication of the interaction by users in the second set of users with a second feature in the respective location in the second arrangement; and
the campaign report provides information comparing user engagement between the first feature in the respective location and the second feature in the respective location.